Senior Software Engineer - Ingestion
Skills
About the role
This is a senior backend engineering role building Lakeflow Connect, Databricks' data ingestion product, based in Bengaluru, India. It suits an experienced distributed-systems engineer with database internals background who wants to build point-and-click connectors extracting data from OLTP systems at scale. Databricks, the Data and AI company, is hiring for this role on its Lakeflow Connect team.
What you’ll do
- Build ready-to-use connectors for enterprise applications, databases, cloud storage and message queues
- Extract data from OLTP systems using incremental data capture and log parsing techniques
- Deliver a scalable, available, fault-tolerant engine processing hundreds of TB of data daily
- Perform low-level systems debugging, performance measurement and optimization on production clusters
- Influence architecture design and product roadmap, owning new projects
- Investigate and help prevent production issues
- Plan and lead complex technical projects spanning multiple teams
- Break down complex problems into potential solutions and de-risk through prototyping
What they’re looking for
- BS or higher in Computer Science or a related field
- 5+ years of production-level experience in Python, Java, Scala, C++ or a similar language
- Experience developing large-scale distributed systems from scratch
- Hands-on experience developing and operating backend systems
- Ability to contribute across all project phases with guidance from senior team members
Nice to have
- Experience with database replication, backup or transaction recovery at a major database vendor such as Microsoft SQL Server, Oracle or IBM
Questions about this role
Is this role remote?
The posting does not state a remote option; the listed location is Bengaluru, India.
How many years of experience do I need?
5+ years of production-level experience is required.
Do I need a degree?
A BS or higher in Computer Science or a related field is required.
Related roles
Solutions Architect - Digital Native Business (Healthtech)
A remote Solutions Architect role at Databricks leading technical strategy for healthtech digital native accounts.
Sr. Solutions Architect - Travel and Hospitality
A remote pre-sales solutions architect role at Databricks focused on the Travel & Hospitality vertical. Suited to an experienced technical account leader with a big data and cloud background who has run large enterprise accounts in Retail or CPG.
Senior Software Engineer (Data Platform)
A senior backend engineering role at Databricks building internal data platform and ETL infrastructure, based in Bengaluru. Suited to an engineer with technical leadership experience on large-scale data infrastructure projects.
Senior Software Engineer - Data + AI Observability
A senior backend engineering role at Databricks building AI and data observability products, based in Bengaluru. Suited to an experienced distributed-systems engineer who wants to lead product milestones and mentor others.
Specialist Solutions Architect - AI/ML
Lead hybrid solutions architect role in Bengaluru for an AI/ML practitioner with at least five years of industry experience. The work combines customer architecture, GenAI and agent systems, MLOps, technical enablement, and product feedback.
Senior Software Engineer - DevOps Engineer
A senior DevOps engineering role at Wells Fargo in Bengaluru, building CI/CD pipelines and driving automation.