Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store
RadcubePosted yesterday

Senior Data Engineer

Who we'd reach at RadcubeFound and reached by Power Apply
Best leadHiring manager

Leads the team this role joins

Recruiter

In-house, owns the opening

Head of the team

Director or head of the group

Power Apply

From your own Gmail and LinkedIn.

About the role

This is a senior data engineering role in Hyderabad, India, for engineers with six to ten years of experience building pipelines on AWS Glue, PySpark and Delta Lake. The job turns raw data in Amazon S3 into governed, high-quality enterprise datasets. The work includes orchestration, governance and production support alongside the build work.

What you’ll do

  • Build AWS Glue and PySpark transformations from raw to refined datasets in Amazon S3.
  • Apply schema enforcement, type conversion, PII tokenisation, deduplication and merges.
  • Build Delta Lake pipelines and, where needed, gold datasets and Redshift loads.
  • Orchestrate jobs with Airflow or AWS Step Functions, including completeness and failure checks.
  • Register datasets in Unity Catalog and support governance, metadata and consumer access.
  • Carry out reconciliation, performance tuning, unit testing and production troubleshooting.
  • Prepare CI/CD artifacts, deployment configuration, runbooks and technical documentation.

What they’re looking for

  • Python, PySpark, Spark SQL and strong SQL.
  • AWS Glue, Amazon S3, Delta Lake and Databricks.
  • ETL and ELT, data modelling and data quality validation.
  • Airflow or AWS Step Functions, with failure recovery experience.
  • Git, CI/CD, data reconciliation and production support.
  • Six to ten years of experience, which is the stated preference.

Nice to have

  • Unity Catalog.
  • Amazon Redshift.
  • Immuta.
  • ServiceNow integration.
  • Regulated-data experience.

Skills

Questions about this role

How many years of experience is needed?

Six to ten years is the stated preference.

Which tools does the job use?

AWS Glue, PySpark, Delta Lake, Databricks, Amazon S3 and Airflow or AWS Step Functions, with Redshift and Unity Catalog also mentioned.

Where is the job?

Hyderabad, India.