Senior Software Engineer (Data Platform)
Skills
About the role
This is a senior backend engineering role building Databricks' internal Data Intelligence Platform, based in Bengaluru, India. It suits an experienced engineer who wants technical leadership on large-scale ETL frameworks, metrics stores and infrastructure management projects. Databricks, the Data and AI company, is hiring for this role on its Data Platform team.
What you’ll do
- Design and run the Databricks metrics store used company-wide
- Design and run the cross-company Data Intelligence Platform
- Develop tooling and infrastructure to run Databricks on Databricks across clouds and geographies
- Design the base ETL framework used by all internal pipelines
- Partner with engineering teams on long-term product vision and requirements
- Build and operate reliable data pipelines using Databricks and OSS tools
- Establish conventions and APIs for telemetry, debug, feature and audit event log data
- Represent Databricks at academic and industry conferences
What they’re looking for
- 6+ years of industry experience
- 4+ years providing technical leadership on large projects such as ETL frameworks, metrics stores or infrastructure management
- Experience building, shipping and operating reliable multi-geo data pipelines at scale
- Experience with orchestration frameworks such as Airflow or DBT
- Experience with large-scale messaging systems such as Kafka or RabbitMQ
- Excellent cross-functional and communication skills
Questions about this role
Is this role remote?
The posting does not state a remote option; the listed location is Bengaluru, India.
How many years of experience do I need?
6+ years of industry experience is required, including 4+ years providing technical leadership on similar large projects.
Related roles
Solutions Architect - Digital Native Business (Healthtech)
A remote Solutions Architect role at Databricks leading technical strategy for healthtech digital native accounts.
Sr. Solutions Architect - Travel and Hospitality
A remote pre-sales solutions architect role at Databricks focused on the Travel & Hospitality vertical. Suited to an experienced technical account leader with a big data and cloud background who has run large enterprise accounts in Retail or CPG.
Senior Software Engineer - Ingestion
A senior backend engineering role at Databricks building data ingestion connectors, based in Bengaluru. Suited to a distributed-systems engineer with database internals experience.
Senior Software Engineer - Data + AI Observability
A senior backend engineering role at Databricks building AI and data observability products, based in Bengaluru. Suited to an experienced distributed-systems engineer who wants to lead product milestones and mentor others.
Specialist Solutions Architect - AI/ML
Lead hybrid solutions architect role in Bengaluru for an AI/ML practitioner with at least five years of industry experience. The work combines customer architecture, GenAI and agent systems, MLOps, technical enablement, and product feedback.
Senior Software Engineer - DevOps Engineer
A senior DevOps engineering role at Wells Fargo in Bengaluru, building CI/CD pipelines and driving automation.