Who we'd reach at ElementSkillFound and reached by Power Apply
Best leadHiring manager
Leads the team this role joins
Recruiter
In-house, owns the opening
Head of the team
Director or head of the group
From your own Gmail and LinkedIn.
About the role
This is a senior data engineering role based in Pune, with Ahmedabad also listed as a location. It suits engineers with 5 to 9 years of experience who can build large scale data ingestion and data platform work on AWS using Python. The work centres on moving structured and unstructured data reliably into storage, and on keeping the cloud environment secure and cost efficient.
What you’ll do
- Build and operate AWS data services such as S3, Glue, Lambda, Redshift and CloudWatch.
- Design and implement ingestion pipelines for structured and unstructured data sources.
- Create fault tolerant pipelines with validation, monitoring and error handling.
- Write production Python services, reusable libraries and automation for data workflows.
- Organise GCP environments to meet data sovereignty and data residency requirements.
- Tune cloud workloads for performance, reliability and cost.
- Take technical initiatives from design through production support, working with security and infrastructure teams.
What they’re looking for
- 5 or more years in data engineering, cloud engineering or a related field.
- Strong hands on AWS experience, including designing architecture for data workloads.
- Working knowledge of cloud networking, security, authentication and access control.
- Infrastructure as code experience, with Terraform preferred.
- Experience with data quality, monitoring, observability and production operations.
- Experience meeting data residency requirements in GCP environments.
- Experience building ingestion pipelines and secure data transfer or proxy solutions.
- Proficiency in Python for production applications and pipelines.
- Clear communication and the ability to work with minimal supervision.
Skills
Questions about this role
How much experience does this role need?
The role asks for 5 or more years in data engineering, cloud engineering or a related field, and the listed range is 5 to 9 years.
Where is this job based?
The listing names Pune and Ahmedabad, and the job is recorded in Pune.
Is this a full time job?
Yes, it is listed as a full time role.