Leads the team you would join
Leads the work day to day
Owns the opening
From your own Gmail and LinkedIn.
About the role
This is a remote, project-based freelance senior data engineering role open to candidates in India, with a 3-year minimum experience requirement. The work is building production data pipelines on AWS with EMR or Glue, Redshift, Athena, Presto and Airflow. The role suits engineers who can design data models and support customer cutovers as part of a delivery team. The employer is Mactores, a data analytics and cloud services firm.
What you’ll do
- Build and maintain production data pipelines on Amazon EMR or AWS Glue.
- Design data models and query solutions using Redshift or Snowflake, Athena and Presto.
- Build and maintain Airflow pipeline orchestration.
- Write PySpark and SQL for extraction, transformation and loading.
- Work with delivery teams and customers to design data solutions.
- Troubleshoot and tune pipelines for stability under production load.
- Support production cutovers.
- Document technical decisions for technical and non-technical stakeholders.
What they’re looking for
- A bachelor's degree in computer science, engineering or a related field.
- 3 or more years with PySpark and SQL.
- 2 or more years building pipelines with EMR or Glue.
- 2 or more years with data modelling and querying on Redshift or Snowflake, Athena and Presto.
- 1 or more years with Airflow orchestration.
- Strong problem-solving and communication skills.
- Ability to work independently and as part of a remote team.
Nice to have
- AWS Data Analytics Specialty certification.
- Agile development experience.
What’s on offer
- Remote, project-based freelance engagement.
- Work on production modernisation systems rather than staff augmentation.
- Exposure to Aedeon automation for source discovery, schema mapping, lineage and validation.
Skills
Questions about this role
Is this role remote?
Yes, the posting describes a remote, project-based freelance engagement.
How many years of experience does this role need?
The posting lists 3 or more years, with specific minimums for PySpark, SQL, EMR or Glue, and Airflow.
Do I need a certification?
An AWS Data Analytics Specialty certification is preferred, not required.