Azure Data Engineer (6 years To 12 years)
Skills
About the role
This is an on-site Azure data engineering role in Pune for someone with six to twelve years of experience building large-scale data platforms. You'll design and tune data models and PySpark pipelines across batch and real-time workloads using Azure Databricks, Azure Data Lake, and Azure Data Factory. The role also emphasizes software quality, SQL performance, workflow automation, and cloud data delivery.
What you’ll do
- Design, build, and optimize data pipelines and data models.
- Develop PySpark pipelines for large-scale batch and real-time processing.
- Use Python for data processing and analysis.
- Tune PySpark jobs and complex SQL queries for performance.
- Build cloud data workflows with Azure Databricks, Azure Data Lake, and Azure Data Factory.
- Apply testing practices and software engineering discipline.
- Automate workflows and support deployment and monitoring of data applications.
What they’re looking for
- Six to twelve years of experience in data engineering or related work.
- Strong data modeling experience with large datasets.
- Hands-on expertise with PySpark and Azure data services.
- Strong Python and SQL skills.
- Experience designing scalable, high-performance data pipelines.
- A graduate degree is listed in the education details.
Nice to have
- PowerShell, Bash, or Perl scripting.
- Power BI or another business-intelligence reporting tool.
- Agile or Scrum experience.
- Financial-sector experience.
- GitLab and CI/CD experience.
What’s on offer
- Full-time permanent employment in Pune.
- The posting lists five openings.
- The posting does not state a salary.
Questions about this role
Where is this Azure data engineer role based?
The role is based in Pune.
How much experience is required?
The posting title states six to twelve years of experience.
Which Azure technologies are required?
The posting names Azure Databricks, Azure Data Lake, and Azure Data Factory.
Is the role full time?
Yes. It is listed as full-time permanent employment.
Related roles
Lead Data Engineer – Databricks & AI | Remote Canada
Lead data engineer role for a financial services client, requiring 10+ years of Databricks expertise and experience collaborating with AI/ML teams to build scalable data infrastructure.
Data Engineer - Azure Data Factory & Snowflake
A Data Engineer role at Cognizant building Azure Data Factory and Snowflake pipelines, paying $115,000-$135,000 a year. Suits an experienced data engineer skilled in ADF, Snowflake, SQL and Python.
Principal Azure Data Engineer (12 to 15 yrs) (Python / PySpark / SQL/ DataBricks)
A principal Azure/Databricks data engineering role in India, building large-scale healthcare data platforms, fully remote. Suits a data engineer with 12-15 years of experience and strong healthcare-data background.
Data Engineer, Data Platform & ML (Remote)
A Poland-remote Data Engineer role building a cloud-based corporate data warehouse for business analytics and machine learning. It suits a data engineer with at least three years of experience in Python, SQL, warehouse design, and modern data tooling.
Data Analyst - Data Quality & Databricks
A data analyst role centered on data quality, profiling and reconciliation using Databricks, SQL and PySpark, open across Bangalore, Chennai and Pune for candidates with 7-11 years of experience.
Data Engineer, Data Platform & Machine Learning (Remote)
A Serbia-remote data engineering role building Tabby's corporate data warehouse, data integrations, and pipelines. It is intended for a data engineer with warehouse design, Python, SQL, and cloud data-stack experience.