Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store
Arting DigitalPosted 6 days ago

Mid-Senior Databricks Engineer

Who we'd reach at Arting DigitalFound and reached by Power Apply
Best leadEngineering manager

Leads the team you would join

Tech lead

Leads the work day to day

Technical recruiter

Owns the opening

Power Apply

From your own Gmail and LinkedIn.

About the role

This is a full-time remote Databricks data engineering role open to candidates in Asia, including India, South Asia and APAC. The work centres on building and maintaining data pipelines and ETL workflows on Databricks, with a focus on data quality and performance. The role sits within a data engineering function and involves working with cross-functional teams. The employer is Arting Digital, an IT services and consulting firm of 51-200 staff that helps clients use data and analytics for digital transformation.

What you’ll do

  • Build and maintain scalable data pipelines with Databricks, Python and PySpark.
  • Create and automate ETL workflows using Delta Live Tables.
  • Tune Spark jobs through partitioning, shuffle management and performance work.
  • Apply Delta Lake optimisation such as Z-Ordering and VACUUM.
  • Manage orchestration with Airflow or Azure Data Factory.
  • Keep data quality, governance and pipeline performance in good order.
  • Work with cross-functional teams to deliver data engineering solutions.

What they’re looking for

  • 3-6 years of data engineering experience.
  • Strong SQL, Python and PySpark.
  • Hands-on work with Databricks and Apache Spark.
  • Understanding of Spark optimisation, partitioning and shuffling.
  • Experience with Delta Lake, Z-Ordering and VACUUM.
  • Experience building ETL pipelines with Delta Live Tables.
  • Understanding of data governance and data quality.

Nice to have

  • Knowledge of Apache Airflow or Azure Data Factory.

What’s on offer

  • Full-time, remote working.
  • Salary is open and not stated.

Skills

Questions about this role

Is this role remote?

Yes. The role is remote and open to candidates in India, Asia, South Asia and APAC.

How many years of experience do I need?

The posting asks for 3-6 years of data engineering experience.

What salary does it pay?

The salary is listed as open, so no figure is given.