Leads the team you would join
Leads the work day to day
Owns the opening
From your own Gmail and LinkedIn.
How this role compares
One of 14 open Applied AI Engineer roles we are tracking today.
Posted november 2026, with 10 of the others posted since and 3 still open from before.
Counted across the roles Frontrunner has open right now.
About the role
A remote, full-time mid-level role for a backend engineer with at least five years of experience, who will build and run the gateway and release path for mpathic's production LLM services. mpathic builds infrastructure for safe, auditable AI systems, and much of its work serves healthcare and life sciences customers. The engineer reports to the CTO and works with platform engineering, the AI/ML team, research and Security and Compliance.
What you’ll do
- Build and run the gateway that routes production LLM requests, with usage logging, cost controls, failover and protected health information safeguards.
- Maintain the approved catalogue of models and providers, recording data retention, BAA coverage, version pinning and decisions.
- Version prompts and model configurations, and run evaluations in CI with staged rollout and rollback.
- Turn validated AI prototypes and their evaluation criteria into scalable, observable services.
- Monitor latency, cost, failures and quality, join the on-call rota and lead incident response for LLM services.
- Produce audit evidence for LLM changes under SOC 2, ISO 27001, HIPAA and FDA 21 CFR Part 11.
What they’re looking for
- At least five years of backend engineering, including production APIs and multi-tenant SaaS
- Experience shipping products on commercial LLM APIs, with prompt handling, structured outputs and tool use
- Experience building LLM evaluation pipelines connected to CI/CD release decisions
- Strong Python, cloud and infrastructure-as-code experience, and working knowledge of application security
Nice to have
- Experience in regulated domains such as healthcare or life sciences, including HIPAA, SOC 2, ISO 27001 or FDA 21 CFR Part 11
- Experience building an internal developer platform or paved road
- LLM-as-judge evaluation, red teaming or conversational analytics
- Training or fine-tuning models from scratch
- Node.js
What’s on offer
- Fully remote role
- Includes on-call and incident response for LLM-backed services
Skills
Questions about this role
Is this role remote?
Yes, the role is remote and open worldwide.
How many years of experience are needed?
At least five years of backend software engineering, including production APIs.
Does the role include on-call?
Yes, it includes on-call and incident response for LLM-backed services.