Data Platform Engineer with Terraform and AWS - Remote
Skills
About the role
This is a contract platform engineering role supporting a data platform built on Astronomer Astro, Databricks and AWS. It suits an experienced infrastructure or data-platform engineer comfortable working offshore against IST hours with light overlap for standups. The engagement is fully remote, staffed through Calance Software, and runs for an initial 12 months with likely extension.
What you’ll do
- Design, build and automate the data platform spanning Airflow/Astronomer Astro, Databricks and AWS
- Develop and support Airflow DAGs, deployments and environment configuration
- Administer Databricks workspaces, jobs, clusters, notebooks and Unity Catalog
- Manage AWS services including IAM, EKS, S3, Secrets Manager, Lambda and CloudWatch
- Provision and manage cloud/platform resources with Terraform
- Build CI/CD pipelines and deployment automation
- Build self-service and reusable platform patterns for application and data teams
- Integrate platforms across multiple AWS accounts and enterprise environments
- Document runbooks and implementation patterns and collaborate with onshore architects and stakeholders
What they’re looking for
- Strong Python experience for platform engineering and automation
- Hands-on Apache Airflow / Astronomer Astro experience
- Databricks administration and integration experience
- Solid AWS knowledge, especially IAM, EKS, S3, Secrets Manager, Lambda, CloudWatch and networking
- Strong Infrastructure as Code experience, preferably Terraform
- Familiarity with CI/CD tooling such as Harness
- Understanding of cloud security, IAM policies and secret management
- Experience integrating platforms across multiple AWS accounts
- Strong troubleshooting skills across infrastructure and integration layers
- Comfort with REST APIs, SDKs and Git-based development practices
- Strong communication skills for working with onshore stakeholders
What’s on offer
- Fully remote contract role for 12 months, likely to extend or become ongoing
- Standard Monday-Friday IST hours with occasional later standup calls
- 15-30 Lacs P.A.
Questions about this role
Is this role remote?
Yes, it is fully remote as a contractor.
How much does it pay?
15-30 Lacs P.A.
How many years of experience do I need?
The posting asks for 10 to 20 years of experience.
Is this a permanent job?
No, it is a 12-month contract likely to extend or become ongoing.
Related roles
Data Engineer, Data Platform & ML (Remote)
A Poland-remote Data Engineer role building a cloud-based corporate data warehouse for business analytics and machine learning. It suits a data engineer with at least three years of experience in Python, SQL, warehouse design, and modern data tooling.
Data Engineer, Data Platform & Machine Learning (Remote)
A Serbia-remote data engineering role building Tabby's corporate data warehouse, data integrations, and pipelines. It is intended for a data engineer with warehouse design, Python, SQL, and cloud data-stack experience.
Senior Data Engineer, Data Platform & ML (Remote)
A remote senior data engineering role in Yerevan focused on feature-store development, data services, streaming, and production data pipelines. It is suited to an engineer with scalable systems experience across data, machine learning, or backend development.
Lead Data Engineer – Databricks & AI | Remote Canada
Lead data engineer role for a financial services client, requiring 10+ years of Databricks expertise and experience collaborating with AI/ML teams to build scalable data infrastructure.
Senior Software Engineer (Data Platform)
A senior backend engineering role at Databricks building internal data platform and ETL infrastructure, based in Bengaluru. Suited to an engineer with technical leadership experience on large-scale data infrastructure projects.
Data Analyst - Data Quality & Databricks
A data analyst role centered on data quality, profiling and reconciliation using Databricks, SQL and PySpark, open across Bangalore, Chennai and Pune for candidates with 7-11 years of experience.