Lead Data Engineer – Databricks & AI | Remote Canada
Skills
About the role
This is a lead data engineering role focused on designing and operating scalable data infrastructure using Databricks for a major Canadian financial services client. It suits senior engineers with 10+ years of data engineering expertise who can lead technical initiatives, mentor teams and architect resilient data systems.
What you’ll do
- Lead design and development of scalable data engineering solutions using Databricks
- Build and maintain reliable data pipelines and processing workflows for complex datasets
- Develop data transformation and processing solutions supporting business requirements
- Optimize Databricks workloads for performance and cost efficiency
- Collaborate with AI/ML teams on data requirements and AI-driven initiatives
- Ensure data quality, reliability and consistency across all pipelines
- Provide technical leadership and mentor other data engineers
- Troubleshoot data engineering issues and provide technical solutions
What they’re looking for
- 10+ years of data engineering experience
- Strong hands-on expertise with Databricks
- Experience working on AI/ML-driven data initiatives
- Strong data pipeline development and design experience
- Experience designing scalable data engineering solutions
- Strong analytical and problem-solving abilities
- Excellent communication and technical leadership skills
Nice to have
- Azure Databricks experience
- Cloud-based data engineering background
- AI/ML project experience
- Financial services or banking domain experience
- Experience leading data engineering teams
What’s on offer
- Contract position
- Remote work in Canada
Questions about this role
What experience is required?
10+ years of data engineering experience with strong hands-on Databricks expertise.
Is this role remote?
Yes, this is a fully remote contract position in Canada.
Will I work with AI/ML teams?
Yes, you'll collaborate with AI/ML teams to support AI-driven data initiatives.
Related roles
Data Architect / Data Engineering Lead
A principal data architecture and engineering leadership role at UnitedHealth Group's Optum/LHI, based in Minnetonka, Minnesota. Suited to a senior data leader with deep Snowflake/Databricks and Airflow experience who wants to combine architecture ownership with hands-on delivery.
Data Analyst - Data Quality & Databricks
A data analyst role centered on data quality, profiling and reconciliation using Databricks, SQL and PySpark, open across Bangalore, Chennai and Pune for candidates with 7-11 years of experience.
Data Engineer, Data Platform & ML (Remote)
A Poland-remote Data Engineer role building a cloud-based corporate data warehouse for business analytics and machine learning. It suits a data engineer with at least three years of experience in Python, SQL, warehouse design, and modern data tooling.
Data Engineer, Data Platform & Machine Learning (Remote)
A Serbia-remote data engineering role building Tabby's corporate data warehouse, data integrations, and pipelines. It is intended for a data engineer with warehouse design, Python, SQL, and cloud data-stack experience.
Senior Data Engineer, Data Platform & ML (Remote)
A remote senior data engineering role in Yerevan focused on feature-store development, data services, streaming, and production data pipelines. It is suited to an engineer with scalable systems experience across data, machine learning, or backend development.
Lead Database Engineer
MoEngage is hiring an on-site lead database engineer in Bengaluru to operate and scale cloud database infrastructure. It suits an experienced MongoDB DBA with automation, performance engineering, incident response, and large-cluster operations experience.