Leads the team this role joins
Heads the group this role sits in
In-house, owns the opening
From your own Gmail and LinkedIn.
How this role compares
One of 38 open Senior Backend Engineer roles we are tracking today.
This one advertises $220,000 – $260,000 a year. The middle of the 8 that state a figure advertises $80,000 – $120,000 a year.
Posted november 2026, with 2 of the others posted since and 35 still open from before.
Counted across the roles Frontrunner has open right now.
About the role
This is a senior full-time onsite role in San Francisco, California, for backend engineers with at least two years of production experience. The engineer owns core parts of an open-source LLM gateway, including routing, authentication, caching, spend tracking, guardrails and observability. The company is a small, roughly twenty-person team behind a widely used Python SDK and proxy for calling LLM APIs.
What you’ll do
- Own core proxy components from design through production, including incident response.
- Find and remove classes of bugs such as race conditions, stale cache state and silently swallowed errors.
- Make guardrail and policy checks logged, traceable and loud on failure.
- Build guardrails that run inside the gateway to block common attacks on LLM APIs and agents.
- Keep observability integrations accurate and efficient at high request volumes.
- Help move performance-critical paths from Python to Rust.
- Raise the team's standards for code review, testing and debugging.
What they’re looking for
- At least two years building production backend systems with real ownership of something mission-critical.
- Strong Python and experience with async or high-throughput services.
- A record of making production systems more reliable through code.
- Skill debugging across services, Postgres, Redis and distributed systems.
- A strong sense of ownership for customer impact.
- A bachelor's or master's degree in computer science or a related field, or equivalent proof of ability.
Nice to have
- Rust, Go or C++ in production.
- Time at a fast-growing startup with a large codebase.
- Experience with LLM APIs, proxies or API gateways.
- Open-source contributions.
What’s on offer
- Base salary between $220,000 and $260,000, plus equity.
- Health, dental and vision coverage.
- Onsite work in San Francisco.
Skills
Questions about this role
Is this role onsite?
Yes. It is based in San Francisco, California.
What is the salary?
The base salary is listed as $220,000 to $260,000, plus equity.
How much experience do I need?
The posting asks for at least two years of backend experience in production.