Who we'd reach at NetflixFound and reached by Power Apply
Best leadHiring manager
Leads the team this role joins
Team lead
Runs the team day to day
Founder
Decides on early hires
From your own Gmail and LinkedIn.
About the role
This is a senior, remote, full-time engineering role in the USA on Netflix's AI Observability team. The engineer builds reusable frameworks for monitoring model quality, evaluating LLM and agentic systems and integrating vendor tooling. The role suits senior engineers with AI or ML platform experience who can build libraries and services other teams adopt.
What you’ll do
- Build observability framework capabilities covering metrics, logs and distributed traces for ML and GenAI systems.
- Build primitives that let teams monitor model performance, data quality, drift and degradation.
- Build and extend evaluation frameworks for LLM and agentic systems, including LLM-as-a-judge and human-in-the-loop scoring.
- Lead build-versus-buy evaluations and own SDKs, connectors and APIs for vendor platforms.
- Build reusable libraries, SDKs and templates that make observability the default for new systems.
- Provide dashboarding, alerting and SLO building blocks for model performance, latency, cost and reliability.
What they’re looking for
- Experience in software, AI or ML, or platform engineering, with production observability, monitoring or ML and LLM evaluation.
- A record of designing standards, libraries or frameworks that other teams adopt.
- Strong Python skills and at least one of Java, Go or Scala, with production services experience.
- Experience operating ML models in production, including drift, performance and data quality.
- Hands-on experience with observability stacks such as Prometheus, Grafana, Datadog or OpenTelemetry.
- Understanding of distributed systems, microservices and at least one major cloud platform.
- Ability to work across ML, data, infrastructure and product teams.
- Experience with vendor integration and VPC deployment.
- An AI-native approach, using AI tools in design, development, testing and review.
Nice to have
- Experience with ML or LLM observability and evaluation tools such as Arize, Braintrust, LangFuse or Weights and Biases.
- Experience building or evaluating LLM or GenAI applications.
- Experience evaluating agentic systems, including tool use and task success.
What’s on offer
- Annual salary only, with no bonuses; employees choose the mix of salary and stock options each year.
- Salary range of USD 500,000 to 860,000, varying by location.
- Health plans, mental health support, 401(k) with employer match, stock option program, disability programs, health and flexible spending accounts, family-forming benefits and life and serious injury benefits.
- Paid leave of absence programs.
- Full-time hourly employees accrue 35 days of paid time off; salaried employees receive flexible time off.
Skills
Questions about this role
Is this role remote?
The posting lists the workplace as remote in the USA.
How much does it pay?
The stated range is USD 500,000 to 860,000 per year, varying by location.
Does the role include bonuses?
No. The posting says compensation is an annual salary with no bonuses, and employees choose the split with stock options.