Senior Databricks Platform Engineer
Skills
About the role
This is a senior Databricks platform engineering role for a federal modernization program, open to candidates anywhere in the United States. It suits an experienced data platform engineer who can lead administration, optimization and governance of an enterprise-scale Databricks Lakehouse. The work spans data engineering, security, automation and cost management across a large-scale cloud data platform.
What you’ll do
- Design, configure and administer the enterprise Databricks Lakehouse Platform, including Unity Catalog and clusters
- Develop and optimize data pipelines and ETL/ELT processes using Spark, Delta Lake and Databricks Workflows
- Establish and govern Unity Catalog access-control structures aligned with security and compliance requirements
- Automate platform provisioning and deployments using Terraform, Python, SQL and Databricks APIs
- Monitor platform health and performance and troubleshoot pipeline issues
- Perform Spark and SQL performance tuning and workload optimization
- Implement cost-management strategies such as autoscaling and capacity forecasting
- Support platform upgrades, security audits and disaster-recovery controls
What they’re looking for
- A Master's degree with 12+ years general and 10+ years specialized experience (or equivalent experience in lieu of a degree)
- Strong hands-on experience administering the Databricks Lakehouse Platform, including Unity Catalog and cluster management
- Proficiency in Python, Bash and SQL
- Experience operating Databricks in AWS-based or hybrid cloud environments
- Experience with CI/CD and DevOps tooling
- Strong knowledge of cloud security, IAM and access controls within Databricks and Unity Catalog
Nice to have
- Observability tools such as Grafana, Prometheus, Datadog, CloudWatch or Elastic
- Docker, Kubernetes and microservices experience
- Familiarity with federal security and compliance processes including ATO and FedRAMP
- Databricks or AWS certifications
What’s on offer
- Salary range of $169,604-$229,464 based on experience and location
- Fully remote work from anywhere in the United States
- Full-time 40-hour week with no travel required
- Medical, dental and vision coverage, plus HSA options
- 401(k) with employer match
- Paid vacation, sick, personal and parental leave, plus 10 paid holidays
- Up to 160 hours of paid family leave in a rolling 12-month period
- Short- and long-term disability and life insurance coverage
Questions about this role
Is this role remote?
Yes, it's fully remote with the flexibility to work from any location in the United States.
How much does it pay?
The stated salary range is $169,604-$229,464 per year.
How many years of experience do I need?
A Master's degree with 12+ years of general experience and 10+ years of specialized experience is preferred, though equivalent experience may be considered.
Related roles
Lead Technical Project Manager
A remote lead technical project manager role overseeing SaaS implementations for automotive and heavy-duty industry clients.
Senior Business Analyst
A remote contract senior business analyst role in Canada, bridging clinical research business needs and delivery teams for a Jobgether partner company.
Lead Technical Project Manager
A fully remote lead technical project manager role in Canada, overseeing SaaS implementations for automotive and heavy-duty industry clients. Suits an experienced technical delivery leader who also manages a team of project managers.
Corporate Strategy Manager
A fully remote corporate strategy individual-contributor role in the United States, reporting to the Chief Strategy Officer. Suits someone with a consulting or strategy background who wants to build a corporate strategy function from the ground up.
Full-Stack AI Engineer
A remote, India-based full-stack AI engineering role building the retrieval, generation and orchestration behind an AI teaching companion for early-learning educators. Suits an engineer with 5+ years of experience and hands-on production RAG/LLM work.
Senior Marketing GTM Analytics Manager
A remote, Canada-based senior marketing analytics leadership role connecting funnel, attribution and revenue data for a B2B SaaS company.