Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store
AgileEnginePosted 9 days ago

Data Engineer

Who we'd reach at AgileEngineFound and reached by Power Apply
Best leadHiring manager

Leads the team this role joins

Team lead

Runs the team day to day

Founder

Decides on early hires

Power Apply

From your own Gmail and LinkedIn.

About the role

This is a contract data engineering role that can be done fully remote from India, with the listing naming several cities across the country. It suits engineers with at least 5 years of hands on Databricks and PySpark work who can also build agentic workflows that automate data operations. The team builds pipelines and reusable frameworks on Databricks, GCP BigQuery and Delta Lake for global clients.

What you’ll do

  • Design and optimise ETL and ELT pipelines using Databricks, PySpark and SQL.
  • Build agentic workflows that handle data validation, issue detection, troubleshooting and workflow execution.
  • Connect agentic capabilities to existing Databricks, GCP, BigQuery and Delta Lake environments.
  • Create pipelines and reusable frameworks for new business requirements and datasets.
  • Add data quality checks, monitoring, validation and exception handling.
  • Tune PySpark and SQL workloads for speed, reliability and scale.
  • Support testing, deployment and production troubleshooting, and work with business and platform teams on automation ideas.

What they’re looking for

  • 5 or more years of hands on Databricks and PySpark experience.
  • Advanced SQL and data processing skills.
  • Hands on GCP experience, especially BigQuery.
  • Experience with Delta Lake and lakehouse architectures.
  • Solid understanding of ETL and ELT design, pipeline performance and data quality.
  • Experience building reliable production grade data solutions.
  • Working knowledge of testing, version control, deployment and production support.
  • Strong analytical and troubleshooting skills.
  • Upper intermediate English.

Nice to have

  • Experience building or integrating AI or agentic workflows and workflow automation.
  • Experience applying AI to data engineering, validation or troubleshooting.
  • Familiarity with orchestration and automation frameworks.
  • Experience creating reusable data engineering frameworks.
  • Experience putting AI enabled solutions into production with monitoring and human oversight.

What’s on offer

  • Fully remote work, with a local presence in India.
  • Compensation paid in INR, plus support for learning, education and wellness.
  • Work on modern technology for global clients.

Skills

Questions about this role

Is this role remote?

Yes, the posting describes it as remote work within India.

How many years of experience do I need?

The posting asks for at least 5 years of hands on Databricks and PySpark experience.

What type of contract is this?

It is a contract role.