Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store
LiteLLMPosted in November 2026

Senior Backend Engineer

Who we'd reach at LiteLLMFound and reached by Power Apply
Best leadHiring manager

Leads the team this role joins

Team director

Heads the group this role sits in

Recruiter

In-house, owns the opening

Power Apply

From your own Gmail and LinkedIn.

How this role compares

One of 38 open Senior Backend Engineer roles we are tracking today.

This one advertises $220,000 – $260,000 a year. The middle of the 8 that state a figure advertises $80,000 – $120,000 a year.

Posted november 2026, with 2 of the others posted since and 35 still open from before.

Counted across the roles Frontrunner has open right now.

About the role

This is a senior full-time onsite role in San Francisco, California, for backend engineers with at least two years of production experience. The engineer owns core parts of an open-source LLM gateway, including routing, authentication, caching, spend tracking, guardrails and observability. The company is a small, roughly twenty-person team behind a widely used Python SDK and proxy for calling LLM APIs.

What you’ll do

  • Own core proxy components from design through production, including incident response.
  • Find and remove classes of bugs such as race conditions, stale cache state and silently swallowed errors.
  • Make guardrail and policy checks logged, traceable and loud on failure.
  • Build guardrails that run inside the gateway to block common attacks on LLM APIs and agents.
  • Keep observability integrations accurate and efficient at high request volumes.
  • Help move performance-critical paths from Python to Rust.
  • Raise the team's standards for code review, testing and debugging.

What they’re looking for

  • At least two years building production backend systems with real ownership of something mission-critical.
  • Strong Python and experience with async or high-throughput services.
  • A record of making production systems more reliable through code.
  • Skill debugging across services, Postgres, Redis and distributed systems.
  • A strong sense of ownership for customer impact.
  • A bachelor's or master's degree in computer science or a related field, or equivalent proof of ability.

Nice to have

  • Rust, Go or C++ in production.
  • Time at a fast-growing startup with a large codebase.
  • Experience with LLM APIs, proxies or API gateways.
  • Open-source contributions.

What’s on offer

  • Base salary between $220,000 and $260,000, plus equity.
  • Health, dental and vision coverage.
  • Onsite work in San Francisco.

Skills

Questions about this role

Is this role onsite?

Yes. It is based in San Francisco, California.

What is the salary?

The base salary is listed as $220,000 to $260,000, plus equity.

How much experience do I need?

The posting asks for at least two years of backend experience in production.