Databricks23.09.2024
Старший инженер-программист (платформа данных)
Зарплата не указана
Bengaluru
Обязанности
- 01Design and run the Databricks metrics store that enables all business units and engineering teams to bring their detailed metrics into a common platform for sharing and aggregation
- 02Design and run the cross-company Data Intelligence Platform, which contains every business and product metric used to run Databricks
- 03Develop tooling and infrastructure to efficiently manage and run Databricks on Databricks at scale, across multiple clouds, geographies and deployment types
- 04Design the base ETL framework used by all pipelines developed at the company
- 05Partner with our engineering teams to provide leadership in developing the long-term vision and requirements for the Databricks product
- 06Build reliable data pipelines and solve data problems using Databricks, our partner's products and other OSS tools
- 07Establish conventions and create new APIs for telemetry, debug, feature and audit event log data, and evolve them as the product and underlying services change
- 08Represent Databricks at academic and industrial conferences & events
Требования
- 016+ years of industry experience
- 024+ years of experience providing technical leadership on large projects similar to the ones described above - ETL frameworks, metrics stores, infrastructure management, data security
- 03Experience building, shipping and operating reliable multi-geo data pipelines at scale
- 04Experience working with and operating workflow or orchestration frameworks, including open source tools like Airflow and DBT or commercial enterprise tools
- 05Experience with large-scale messaging systems like Kafka or RabbitMQ or commercial systems
- 06Excellent cross-functional and communication skills, consensus builder
- 07Passion for data infrastructure and for enabling others by making their data easier to access
Условия
- 01Comprehensive benefits and perks that meet the needs of all of our employees
- 02Commitment to fostering a diverse and inclusive culture where everyone can excel
- 03Inclusive hiring practices and equal employment opportunity standards