Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store

LLM-as-judge jobs

9 open roles for llm-as-judge, updated continuously as employers post them.

This market right now

Hiring most here right now:

Counted across the roles Frontrunner has open right now.

9 open roles
ProductPosted 5 days ago

Senior Data Scientist AI Evaluation

United StatesRemoteSenior$41,950 – $59,893 a year

A full-time remote senior role designing AI evaluation methods for a brokerage infrastructure company, suited to data scientists with 6 to 10 years of experience. The posted salary range is 41,950 to 59,893 USD per year.

Data scienceMachine learningLLM evaluationPython +5
We reach engineering manager, tech lead and technical recruiter Power Apply
GuidewirePosted in November 2026

AI Engineer- Applied AI

Full-time remote AI engineer role in the United States building and evaluating an AI voice agent for insurance claims intake, for a mid-level engineer with LLM application and evaluation experience.

LLM applicationsLLM evaluationLLM-as-judgeRAG +14
We reach technical recruiter, engineering manager and a team member Power Apply
Power Apply

Skip the portal. Reach the person hiring.

One tap and Frontrunner finds who hires for the role, writes in your voice, and sends from your own Gmail and LinkedIn.

Finds themHiring manager
WritesIn your voice
SendsGmail and LinkedIn
Tracks repliesIn one place
TrueFanPosted 10 days ago

Product Manager - Agentic Systems

Gurgaon/Gurugram, India · Gurgaon, IndiaManager

A full-time product manager role at TrueFan in Gurugram, India, for people with four to seven years of hands-on technical experience who want to design and ship agentic AI systems for enterprise video production.

Agentic AILarge Language ModelsPrompt EngineeringEvaluation Design +9
We reach hiring manager, team lead and founder Power Apply
ProofpointPosted 11 days ago

Senior AI Engineer

Hyderabad, IndiaOn-siteSenior

A senior, in-office AI engineering role in Hyderabad for someone with 6+ years of experience shipping production agentic AI systems. It suits senior engineers who design the architecture, evaluation and standards for LLM-based products and mentor others.

GoPythonLLMsAgentic AI +14
We reach technical recruiter, engineering manager and a team member Power Apply
Mpathic2Posted in November 2026

Applied AI Engineer

Remote · WorldwideRemoteMid level

A remote, full-time mid-level role building the gateway, evaluation gates and release path for LLM features at a trustworthy-AI company. Suited to backend engineers with five or more years of experience who have taken LLM features into production.

PythonLLM APIsPrompt engineeringStructured outputs +16
We reach engineering manager, tech lead and technical recruiter Power Apply

Every new role is checked against your skills, experience, place and pay. If they can't hire you, it never reaches you.

Oyster HRPosted 16 days ago

Senior AI Product Engineer

WorldwideRemoteSenior

A senior, fully remote role building and owning AI features for the Oyster AI assistant, open worldwide. It suits engineers with production LLM experience who can take complex AI work from design through evaluation and rollout.

Ruby on RailsReactLLMRetrieval-Augmented Generation +9
We reach CTO, engineering lead and technical recruiter Power Apply
OysterPosted in November 2026

Senior AI Product Engineer

18 countriesRemoteSenior

A senior, fully remote role building and owning LLM-powered features for Oyster AI, the company's customer and team assistant, open to candidates across 18 countries.

LLMRetrieval-augmented generationEvaluationLLM-as-judge +8
We reach technical recruiter, engineering manager and a team member Power Apply
PydanticDate not stated

Evals & Continuous Learning Engineer

Fully remoteRemoteMid level

A full-time remote role building evals and continuous learning tools for Pydantic's Logfire, for mid-level engineers with at least five years of experience. Applicants are asked to share a project, library, talk or blog post from the evals or AI space, and recruiters are not accepted.

LLM evaluationLLM-as-judgeObservabilityOpenTelemetry +11
We reach engineering manager, tech lead and technical recruiter Power Apply
Hunting 24x7
305,808

new roles this week. Frontrunner reads every one for you.

It never stops looking, and it only wakes you for the good ones.

AltaML Inc.Date not stated

AI Engineer (Brilliant Harvest)

Remote120,000 – 130,000 a year

Remote AI engineering role building production LLM agents and RAG features for the Brilliant Harvest platform, at $120,000 to $130,000 a year. Suits engineers with three or more years of experience who have shipped LLM applications and want to work on agents and retrieval quality.

PythonTypeScriptC#LLM Agents +14
We reach team lead, recruiter and a recent hire on the team Power Apply

Browse by role

Jobs by role and place

Remote jobs by role and country

Browse by location

Browse by work mode

Browse by employment type

Browse by seniority

Remote roles

Browse by skill

Browse by industry

Browse by product

Companies hiring