Who we'd reach at OneFormaFound and reached by Power Apply
Best leadEngineering lead
Leads the team you would join
CTO
Signs off on engineering hires
Technical recruiter
Owns the opening
From your own Gmail and LinkedIn.
About the role
This is a remote, full-time data engineering role in India for engineers with at least three years of Python and PySpark experience. The work builds and tunes large-scale ETL pipelines on Azure Data Lake, Azure Databricks, and Azure Data Factory. It suits engineers who want to combine pipeline work with data governance tasks in Microsoft Purview.
What you’ll do
- Develop and tune PySpark ETL pipelines for large data volumes.
- Write, test, and maintain Python applications.
- Design data solutions together with data engineers, analysts, and developers.
- Build scalable data solutions on Azure Data Lake, Azure Databricks, and Azure Data Factory.
- Apply data classification, policy enforcement, and metadata extraction within Purview.
- Keep data flowing smoothly between systems alongside business teams.
- Diagnose slow Spark jobs and improve pipeline efficiency.
- Maintain data security, compliance, and quality according to good practice.
What they’re looking for
- Three or more years of Python and PySpark experience for big data processing.
- Experience working as a Python developer or in a similar role.
- Solid experience with Azure Data Lake and Azure Data Factory.
- Strong problem-solving skills and comfort working in agile teams.
- Clear communication and good teamwork.
What’s on offer
- Remote, full-time role based in India.
Skills
Questions about this role
Is this role remote?
Yes, it is listed as India (remote).
How many years of experience do I need?
At least three years of Python and PySpark experience is required.
Is Azure experience needed?
Yes, solid experience with Azure Data Lake and Azure Data Factory is required.