DevOps Engineer
Skills
About the role
This is a remote data platform architecture role at Pythian, a consulting firm, where you both design and personally build lakehouse and warehouse solutions for clients. It suits a senior data engineer or architect who wants a hands-on role rather than a pure design position, working across Databricks, Fabric, Spark and Power BI. The role is titled DevOps Engineer on the posting but the responsibilities describe end-to-end data architecture and engineering.
What you’ll do
- Own end-to-end architecture across ingestion, lakehouse/warehouse layers, transformation, modeling and delivery
- Write and deploy pipelines, Spark and SQL transformations and data models
- Review code written by the rest of the team
- Design lakehouse architectures on Databricks or Fabric, including medallion layering and Delta table design
- Recommend the platform choice (Databricks, Fabric, or a mix) based on client needs
- Set up governance and access control using Unity Catalog, Purview or equivalent
- Design and build ingestion from databases, SaaS applications, APIs, files and legacy systems
What they’re looking for
- 8+ years in data engineering, including at least 3 years owning architecture and design decisions
- Proven hands-on delivery of platforms you both designed and built
- Deep hands-on experience with Databricks or Microsoft Fabric, plus working knowledge of the other
- Strong Spark and SQL skills
- Solid Python or equivalent production language experience
- Production experience with Delta Lake, medallion architecture and lakehouse patterns
- Power BI experience, including semantic model design
- Solid dimensional and semantic modeling skills
- Working knowledge of data governance: classification, lineage, cataloging and access control
- Experience with CI/CD, version control and testing practices for data work
Nice to have
- Azure Government or GCC High delivery experience
- Unity Catalog or Purview implementation experience
- Azure Data Factory, Synapse or Azure SQL background
- Consulting or client-facing delivery experience
- Experience in a regulated environment with compliance constraints
- Databricks or Microsoft certifications
What’s on offer
- Competitive total rewards package
- Fully remote work from home with no office travel requirement
- Training allowance and professional development days
- Home office equipment and an annual budget to personalize your workspace
- Annual wellness budget
- Generous paid vacation and sick days, plus a volunteer day
Questions about this role
Is this role remote?
Yes, the posting says you can work flexibly from home with no daily office travel requirement.
How many years of experience do I need?
Eight or more years in data engineering, including at least three years owning architecture and design decisions.
What tools does this role use?
Databricks or Microsoft Fabric, Spark, SQL, Python, Delta Lake and Power BI.
Related roles
Senior Software Engineer - DevOps Engineer
A senior DevOps engineering role at Wells Fargo in Bengaluru, building CI/CD pipelines and driving automation.
Solutions Engineer AI Engineer
Remote solutions engineering role in India for building conversational voice and video AI applications in life sciences. The role suits engineers with at least three years of Python, API, LLM, or AI solutions experience.
Engineer - Engine Reliability
Onsite engine-reliability engineering role in Chennai for an automotive product-development professional with two to nine years of relevant experience. The work covers powertrain calibration, testing, diagnostics, reliability, emissions, and vehicle integration.
Engineer Engine Design & Application
Automotive engine design and application engineer role in Chennai covering powertrain calibration, validation, emissions, and release targets. It suits an engineer with two to nine years of relevant experience and hands-on MATLAB, Simulink, CAN, UDS, and engine-testing skills.
Engineer Engine Cooling System
Automotive powertrain engineering role in Chennai for a professional with 2–9 years of cooling-system experience. The work covers calibration, validation, performance, emissions and durability targets.
Engineer - Engine Testing
Automotive engine-testing engineer role in Chennai for professionals who can plan and execute validation, analyse failures and support issue closure. The position suits candidates with hands-on experience in calibration, NVH, durability, instrumentation and test planning.