Leads the team this role joins
Runs the team day to day
Decides on early hires
From your own Gmail and LinkedIn.
How this role compares
One of 27 open Software Engineer roles we are tracking today.
This posting does not state pay. The middle of the 11 that do advertises $125,000 – $155,000 a year.
Counted across the roles Frontrunner has open right now.
About the role
Software Engineer at Turing is a remote role listed for global and US candidates, aimed at experienced backend engineers. The team builds evaluation infrastructure for frontier AI labs, including benchmark datasets, large-scale agent evaluation runs and automated task quality checks. Work spans features across the stack, from data models and background jobs to user-facing screens. It suits engineers who can turn loosely defined requests into tested, dependable code.
What you’ll do
- Design and ship features end to end, covering data model, API, background workers and UI where needed.
- Build and improve agent and model evaluation, including sandboxed trials, scoring and result aggregation.
- Improve benchmark task quality checks, including verifiers and rubric or LLM-as-a-judge grading.
- Integrate new models, agents and benchmarks through general designs rather than special cases.
- Keep the system fast and reliable under growth through efficient queries, safe migrations and sound concurrency.
- Review teammates' pull requests against the engineering guidelines.
What they’re looking for
- 5 or more years building and operating production backend systems, including owning a service from design through on-call.
- A bachelor's degree or higher in software engineering, computer science or a related field.
- Strong Python, experience with Django or a similar framework, PostgreSQL and a task queue such as Celery.
- Hands-on LLM evaluation experience beyond calling a model API, including how benchmark tasks and agent trials are scored.
- Judgment about task quality, including spotting ambiguous instructions, weak verifiers and leaked answers.
- Sound design tradeoffs and clear written design and pull request notes.
- Comfort with a TypeScript and React frontend for changes that are visible in the UI.
Nice to have
- Experience running agents in sandboxed or containerized environments such as Docker, Kubernetes or cloud sandboxes.
- Experience with LLM-as-a-judge or rubric-based grading and reducing judge bias.
- Familiarity with coding agents and MCP.
- Experience with distributed job scheduling, concurrency limits or database locking at scale.
- Experience with Harbor, Terminal-Bench, SWE-bench, Inspect or a similar harness.
- Contributions to open source evaluation or infrastructure projects.
What’s on offer
- Base salary plus equity; the posting does not state the salary amount.
- Remote work.
- Opportunities to present work at conferences such as ICLR, ICML and NeurIPS.
- Collaboration with colleagues who have worked at large technology companies.
- Equal opportunity employer.
Skills
Questions about this role
Is this role remote?
Yes, the role is listed as remote, with global and US locations.
How much experience is needed?
The posting asks for 5 or more years of production backend experience.
Is LLM experience required?
Hands-on LLM evaluation experience is asked for, beyond simply calling a model API.