Leads the team you would join
Leads the work day to day
Owns the opening
From your own Gmail and LinkedIn.
About the role
This is a full-time senior data engineering role open to candidates in Brazil, working fully remote. The listing is posted by Jobgether, a recruiting platform, and the hiring company is not named on the page. You would build and run data pipelines and lakehouse architecture on Databricks, working with Spark, Delta Lake and Azure Data Factory. Applications are submitted through the employer's own applicant tracking system, which opens as an external form.
What you’ll do
- Design, build and maintain data engineering solutions on a Lakehouse architecture using a medallion layering approach
- Develop, tune and maintain data pipelines with Databricks, PySpark, Spark SQL and Apache Spark
- Implement data ingestion, processing and integration, including change data capture
- Build and manage pipeline orchestration and system integrations with Azure Data Factory
- Develop REST APIs, microservices and automation in Python
What they’re looking for
- Extensive professional experience delivering and maintaining production data engineering systems
- Advanced skills in PySpark, Spark SQL, Delta Lake and Apache Spark
- Hands-on experience with Delta Live Tables or Lakeflow Spark Declarative Pipelines, including change data capture
- Strong knowledge of Liquid Clustering, Auto Loader and Delta table optimization
- Advanced understanding of Unity Catalog, covering governance, security, lineage and access
- Proven experience designing scalable data architectures, particularly Lakehouse
What’s on offer
- Meal or food vouchers
- Medical and dental insurance
- Health insurance for pets
- Home office allowance for remote positions
- Onboarding welcome kit
- Life insurance
Skills
Questions about this role
Is this Databricks role fully remote?
Yes, the listing is fully remote and open to candidates in Brazil.
What skills does this role need?
The core requirements are advanced PySpark, Spark SQL, Delta Lake, Delta Live Tables, Unity Catalog and Lakehouse design, with Azure Data Factory and Python also part of the work.
Is a salary listed?
No, the listing does not provide a salary.