Who we'd reach at AgileEngineFound and reached by Power Apply
Best leadHiring manager
Leads the team this role joins
Team lead
Runs the team day to day
Founder
Decides on early hires
From your own Gmail and LinkedIn.
About the role
This is a contract data engineering role that can be done fully remote from India, with the listing naming several cities across the country. It suits engineers with at least 5 years of hands on Databricks and PySpark work who can also build agentic workflows that automate data operations. The team builds pipelines and reusable frameworks on Databricks, GCP BigQuery and Delta Lake for global clients.
What you’ll do
- Design and optimise ETL and ELT pipelines using Databricks, PySpark and SQL.
- Build agentic workflows that handle data validation, issue detection, troubleshooting and workflow execution.
- Connect agentic capabilities to existing Databricks, GCP, BigQuery and Delta Lake environments.
- Create pipelines and reusable frameworks for new business requirements and datasets.
- Add data quality checks, monitoring, validation and exception handling.
- Tune PySpark and SQL workloads for speed, reliability and scale.
- Support testing, deployment and production troubleshooting, and work with business and platform teams on automation ideas.
What they’re looking for
- 5 or more years of hands on Databricks and PySpark experience.
- Advanced SQL and data processing skills.
- Hands on GCP experience, especially BigQuery.
- Experience with Delta Lake and lakehouse architectures.
- Solid understanding of ETL and ELT design, pipeline performance and data quality.
- Experience building reliable production grade data solutions.
- Working knowledge of testing, version control, deployment and production support.
- Strong analytical and troubleshooting skills.
- Upper intermediate English.
Nice to have
- Experience building or integrating AI or agentic workflows and workflow automation.
- Experience applying AI to data engineering, validation or troubleshooting.
- Familiarity with orchestration and automation frameworks.
- Experience creating reusable data engineering frameworks.
- Experience putting AI enabled solutions into production with monitoring and human oversight.
What’s on offer
- Fully remote work, with a local presence in India.
- Compensation paid in INR, plus support for learning, education and wellness.
- Work on modern technology for global clients.
Skills
Questions about this role
Is this role remote?
Yes, the posting describes it as remote work within India.
How many years of experience do I need?
The posting asks for at least 5 years of hands on Databricks and PySpark experience.
What type of contract is this?
It is a contract role.