Who we'd reach at NewnovationFound and reached by Power Apply
Best leadHiring manager
Leads the team this role joins
Founder
Decides on early hires
Head of talent
Runs hiring at the company
From your own Gmail and LinkedIn.
About the role
This is a full-time, remote role within Canada for a hands-on Azure Databricks architect who will design and tune Databricks Genie for natural language querying of enterprise data. The architect also leads design, governance and scaling of the company's Lakehouse platform on Azure. The work centres on Unity Catalog governance, Delta Lake pipelines and consumption cost control.
What you’ll do
- Design, configure and run production Genie Agents on top of Unity Catalog.
- Curate table and column metadata, semantic instructions, knowledge stores and trusted example queries so generated SQL is accurate.
- Architect batch and real-time pipelines on Azure Databricks across medallion layers, using PySpark, Spark SQL, Delta Lake and Delta Live Tables.
- Enforce row-level security, column masking, access control lists and audit controls so agents respect user permissions.
- Manage SQL warehouses, cluster policies and query tuning, and control Databricks and Genie budgets.
- Integrate Databricks with Azure Data Factory, ADLS Gen2, Event Hubs, Key Vault and Microsoft Entra ID.
- Standardize deployments with Databricks Asset Bundles, Terraform, or Azure DevOps and GitHub Actions.
- Work with analysts, domain leads and data engineers to turn business KPIs into annotated semantic models.
What they’re looking for
- Hands-on Azure Databricks architecture skills, with Genie Agents as a mandatory focus.
- Working knowledge of Unity Catalog governance, Delta Lake and Apache Spark (PySpark and Spark SQL).
- Experience with Azure data services and CI/CD tooling.
What’s on offer
- Full-time, remote work within Canada.
Skills
Questions about this role
Is this role remote?
Yes. The posting lists it as remote within Canada.
What is the main focus of the job?
Designing, configuring and tuning Azure Databricks Genie Agents on Unity Catalog, which let business users query enterprise data in natural language.