Leads the team you would join
Leads the work day to day
Owns the opening
From your own Gmail and LinkedIn.
About the role
This is a full-time remote Databricks data engineering role open to candidates in Asia, including India, South Asia and APAC. The work centres on building and maintaining data pipelines and ETL workflows on Databricks, with a focus on data quality and performance. The role sits within a data engineering function and involves working with cross-functional teams. The employer is Arting Digital, an IT services and consulting firm of 51-200 staff that helps clients use data and analytics for digital transformation.
What you’ll do
- Build and maintain scalable data pipelines with Databricks, Python and PySpark.
- Create and automate ETL workflows using Delta Live Tables.
- Tune Spark jobs through partitioning, shuffle management and performance work.
- Apply Delta Lake optimisation such as Z-Ordering and VACUUM.
- Manage orchestration with Airflow or Azure Data Factory.
- Keep data quality, governance and pipeline performance in good order.
- Work with cross-functional teams to deliver data engineering solutions.
What they’re looking for
- 3-6 years of data engineering experience.
- Strong SQL, Python and PySpark.
- Hands-on work with Databricks and Apache Spark.
- Understanding of Spark optimisation, partitioning and shuffling.
- Experience with Delta Lake, Z-Ordering and VACUUM.
- Experience building ETL pipelines with Delta Live Tables.
- Understanding of data governance and data quality.
Nice to have
- Knowledge of Apache Airflow or Azure Data Factory.
What’s on offer
- Full-time, remote working.
- Salary is open and not stated.
Skills
Questions about this role
Is this role remote?
Yes. The role is remote and open to candidates in India, Asia, South Asia and APAC.
How many years of experience do I need?
The posting asks for 3-6 years of data engineering experience.
What salary does it pay?
The salary is listed as open, so no figure is given.