Leads the team this role joins
Decides on early hires
Runs hiring at the company
From your own Gmail and LinkedIn.
How this role compares
One of 78 open Senior Data Engineer roles we are tracking today.
This posting does not state pay. The middle of the 16 that do advertises £90,000 – £110,000 a year.
Posted 10 days ago, with 38 of the others posted since and 39 still open from before.
Counted across the roles Frontrunner has open right now.
About the role
This is a full-time senior data engineering role in Noida, India, with hybrid working, for an engineer who builds data pipelines on Databricks. The role sits in IT Operations and reports to the Senior Manager of Business Insights and Analytics at Sumo Logic, an observability and security software company. It focuses on onboarding new data sources, integrating enterprise applications and delivering trusted datasets for analytics.
What you’ll do
- Design and maintain scalable pipelines on Databricks, Apache Spark, PySpark, Python, SQL and Delta Lake
- Build a medallion architecture with bronze, silver and gold layers
- Create reusable ingestion frameworks to add new data sources faster
- Build batch and near-real-time ingestion with incremental loads, CDC, schema evolution and error recovery
- Set up Databricks Workflows, Auto Loader and Lakeflow Spark Declarative Pipelines
- Tune Spark and Delta workloads for performance and compute cost
- Implement Unity Catalog governance, including access control, lineage, auditing and masking
- Support data flows on Amazon Redshift and EC2, including IAM, S3 access and deployments
- Guide team members and suggest improvements to standards and reliability
What they’re looking for
- 5+ years in data engineering or a related technical role, with production pipeline experience
- Strong hands-on Databricks skills, including troubleshooting and optimisation
- Strong Python, PySpark, SQL and Apache Spark
- Practical Delta Lake experience, including table management and incremental processing
- Experience with medallion architecture and analytics-ready datasets
- Experience with Databricks Workflows or similar orchestration tools
- Experience building ingestion pipelines and integrating REST APIs and databases
- Understanding of retries, idempotency, schema evolution, backfills and recovery
- Working knowledge of AWS, particularly IAM, S3 and secure connectivity
- Experience with Git, code reviews, automated testing and CI/CD
- Good communication and the ability to own solutions end to end
Nice to have
- Lakeflow Spark Declarative Pipelines, Auto Loader and advanced incremental ingestion
- Unity Catalog governance in practice
- Databricks Genie tools
- AI/ML, LLM, contextualisation or Amazon Bedrock experience
What’s on offer
- Hybrid working in Noida
- The posting does not state pay
Skills
Questions about this role
Is this role hybrid?
Yes, it is listed as hybrid in Noida.
How many years of experience are needed?
5 or more years in data engineering or a related technical role.
Which tools does the role use?
Databricks, Apache Spark, PySpark, Delta Lake, Unity Catalog, AWS and CI/CD tools.