Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store

LLM evaluation jobs

99 open roles for llm evaluation, updated continuously as employers post them.

99 open roles
SS&C Fintech Services India Private LimitedPosted 13 days ago

Advanced Prompt Engineer

Hyderabad, IndiaOn-siteSenior

A senior on-site prompt engineering role in Hyderabad, India, for designing, testing, and optimizing prompts for foundation models in financial services and healthcare technology. Suits experienced engineers with 5-9 years of software or prompt development work and strong Python skills.

Prompt engineeringPythonLarge language modelsGPT-4 +16
We reach talent partner, hiring manager and a senior teammate Power Apply
MaintainXPosted 13 days ago

Applied AI Engineer

Austin, United States$152,000 – $271,000 a year

A full-time applied AI engineering role in Austin, Texas, building LLM generation and evaluation for maintenance documents at MaintainX, suited to engineers with production GenAI and eval experience.

Prompt engineeringStructured outputTool useRetrieval-augmented generation +8
We reach technical recruiter, engineering manager and a team member Power Apply
Power Apply

Skip the portal. Reach the person hiring.

One tap and Frontrunner finds who hires for the role, writes in your voice, and sends from your own Gmail and LinkedIn.

Finds themHiring manager
WritesIn your voice
SendsGmail and LinkedIn
Tracks repliesIn one place
SS&C TechnologiesPosted 13 days ago

Advanced Prompt Engineer

Hyderabad, IndiaOn-siteSenior

A senior on-site prompt engineering role in Hyderabad focused on evaluated, guarded prompts for LLM applications at SS&C. It suits engineers with five to nine years of experience who combine prompt design with Python tooling.

Prompt engineeringPythonPydanticInstructor +12
We reach team director, hiring manager and recruiter Power Apply
Joblet-AIPosted 14 days ago

Senior Python Developer

INRemoteSenior

A remote senior Python contract for engineers who write code and evaluate AI model outputs for a large language model project. It suits developers with several years of Python and strong testing and concurrency skills.

PythonAsynchronous ProgrammingMultithreadingUnit Testing +11
We reach hiring manager, recruiter and the person who posted the job Power Apply
TRM LabsPosted in November 2026

Senior AI Engineer (AI Automation)

BR, United StatesRemoteSenior

A senior, fully remote role building AI agents and internal automations for TRM Labs' product, marketing and design teams. It suits experienced engineers who can ship production code and drive adoption of the tools they build.

PythonTypeScriptAI AgentsAgentic AI +12
We reach CTO, engineering lead and technical recruiter Power Apply

Every new role is checked against your skills, experience, place and pay. If they can't hire you, it never reaches you.

EvolutionIQPosted in November 2026

Senior Machine Learning (ML) Engineer (CCC Casualty / Claims Intelligence)

RemoteSenior$180,000 – $225,000 a year

A senior remote machine learning engineering role at CCC Intelligent Solutions, building and evaluating statistical and LLM-based models for auto injury claims. It suits engineers with five or more years of experience who can ship models to production and prove with data whether they work.

Machine LearningStatistical ModelingLarge Language ModelsRetrieval-Augmented Generation +12
We reach hiring manager, team lead and founder Power Apply
Smart BricksPosted 14 days ago

AI Engineer (Forward Deployed)

IndiaRemote₹2,000,000 – ₹2,800,000 a year

A full-time remote role building agentic AI and RAG systems for real estate investors, aimed at engineers with two to four years of experience. It suits engineers who can work directly with clients and take prototypes to production quickly.

PythonTypeScriptLangChainLangGraph +7
We reach hiring manager, recruiter and the person who posted the job Power Apply
Software EstrategicoPosted 15 days ago

Senior AI Quality Engineer (LLM Evaluation & Automation)

WorldwideRemoteSenior

A senior remote role open worldwide for an engineer who builds and runs evaluation harnesses and release gates for LLM-based agents.

LLM EvaluationTest AutomationBenchmark DesignRegression Testing +6
We reach technical recruiter, engineering manager and a team member Power Apply
Hunting 24x7
306,344

new roles this week. Frontrunner reads every one for you.

It never stops looking, and it only wakes you for the good ones.

Software EstrategicoPosted 15 days ago

Agent Quality / Evals Engineer

WorldwideRemote

Full-time remote role owning the evaluation harness and release quality gate for AI agents, with thresholds that block regressions. Suits engineers experienced in evaluating LLM and other non-deterministic systems who can automate benchmarks in CI.

LLM evaluationBenchmark designTest automationCI/CD +4
We reach recruiter, hiring manager and head of the team Power Apply
OpenTrain AIPosted 16 days ago

Senior Software Engineer, C++ LLM Eval/Repo Validation

India · PakistanRemoteSenior

A remote, three-month contractor role for senior C++ engineers who evaluate how language models handle real bug fixes and repositories. It requires at least 20 hours a week with four hours of Pacific Time overlap, and the listing does not state a pay rate.

C++GitDockerSoftware Testing +7
We reach hiring manager, recruiter and the person who posted the job Power Apply
BolterPosted 17 days ago

AI Researcher

WorldwideRemote

A full-time AI Researcher role open worldwide at an early-stage agent platform, focused on designing evaluations and experiments that make agents reliable.

LLM EvaluationAI AgentsAgentic SystemsTool Use +6
We reach team director, hiring manager and recruiter Power Apply
Patronus AIPosted 18 days ago

Expert: Software Engineer – AI Evaluation (Task-based Contract, Remote)

Yemen · Iraq · Saudi Arabia · Iran · Syria · ArmeniaRemoteMid level$50 – $100 an hour

A remote, task-based contract for software engineers with at least two years of experience who design and grade coding tasks for AI models. It is paid hourly and suits people who can work flexibly alongside other commitments.

Software EngineeringSystem DesignPythonJava +9
We reach recruiter, hiring manager and head of the team Power Apply
FocusedPosted 18 days ago

Data Engineer, AI

Chicago, United StatesHybridSenior$145,000 – $175,000 a year

Data Engineer, AI role at Focused in Chicago, in-office three days a week, building Databricks pipelines for an enterprise AI platform. Pays 145,000-175,000 USD and suits engineers with five or more years in data engineering who work with Python, SQL and Spark.

DatabricksApache SparkDelta LakePython +16
We reach founder, head of talent and hiring manager Power Apply
EVBPosted 19 days ago

Business Operations Expert

WorldwideRemote$90 an hour

A remote contract paying up to $90 per hour for operations specialists who can design gradable benchmark tasks for AI systems. It suits practitioners with five or more years of hands-on operations work and strong English.

Business OperationsProcess DesignOperations ReportingWorkflow Management +8
We reach team lead, recruiter and a recent hire on the team Power Apply
HarveyPosted 20 days ago

Research Engineer / Scientist, Data & Evals

Remote — WorldwideRemote$230,000 – $450,000 a year

A full-time remote research role at Harvey for engineers building data and evaluation systems for legal AI. It suits engineers with strong Python and measurement skills who want to work with researchers and legal experts.

PythonData PipelinesSynthetic DataLLM Evaluation +5
We reach team director, hiring manager and recruiter Power Apply
FICOPosted 20 days ago

Applied AI Engineer

Remote · US-eligibleRemoteMid level$105,000 – $165,000 a year

A remote, full-time mid-level role for engineers who want to make LLM-powered consumer features measurable, safe and reliable, with a base pay range of $105,000 to $165,000.

PythonJavaSpring BootLarge language models +16
We reach recruiter, hiring manager and head of the team Power Apply
INFOBUSPosted 20 days ago

Middle AI Engineer (Python/TypeScript, AI agent)

RemoteMid level

A fully remote mid-level role building AI agents, tool use and MCP integrations for an online travel booking company. It suits Python or TypeScript engineers with at least two years of commercial experience who enjoy debugging agent failures.

PythonTypeScriptAI agentsTool use +12
We reach founder, head of talent and hiring manager Power Apply
CleraDate not stated

Safety Testing Associate

Worldwide remote — Open worldwideRemoteEntry level$30 – $60 an hour

A fully remote, full-time safety testing role for people who can push AI models past their guidelines and document the results. Suits testers with 0-5 years of experience in security, policy or trust and safety work.

Red TeamingPrompt InjectionJailbreakingLarge Language Models +9
We reach recruiter, hiring manager and head of the team Power Apply
Joblet-AIDate not stated

AI Research Engineer

IndiaRemote$200,000 – $260,000 a year

A full-time remote role for engineers with three or more years of experience who design benchmarks and evaluation methods for coding agents. It suits people who enjoy research, rigorous measurement and software engineering.

PythonC++LLM EvaluationBenchmark Design +10
We reach CTO, engineering lead and technical recruiter Power Apply
Blend360Date not stated

Lead AI Engineer - Agentic Engineering

Senior

A lead AI engineering role in Hyderabad, India, for senior engineers who build production agentic systems and use AI coding agents across the software lifecycle. It suits engineers with 6+ years of experience who can also mentor others and set technical direction.

PythonLangGraphLangChainCrewAI +16
We reach team director, hiring manager and recruiter Power Apply
G-PDate not stated

Senior AI Product Manager, Evals & AnnotationsNew

United StatesRemoteSenior$200,000 – $250,000 a year

A senior remote product manager role at Arize AI owning evaluations and annotation workflows for AI developers. It suits product managers with technical depth and developer-tool experience.

Product ManagementLLM EvaluationHuman-in-the-LoopPrototyping +7
We reach talent partner, hiring manager and a senior teammate Power Apply
G-PDate not stated

Senior Machine Learning (ML) Engineer (CCC Casualty / Claims Intelligence)

Chicago, United StatesRemote or on-siteSenior$180,000 – $225,000 a year

A senior ML role in Chicago or remote in the US, building statistical and LLM models for auto injury claims at CCC. It suits engineers with five or more years of experience who can measure whether AI products work and what they are worth.

PythonSQLMachine LearningStatistical Modeling +8
We reach engineering manager, tech lead and technical recruiter Power Apply
PydanticDate not stated

Evals & Continuous Learning Engineer

Fully remoteRemoteMid level

A full-time remote role building evals and continuous learning tools for Pydantic's Logfire, for mid-level engineers with at least five years of experience. Applicants are asked to share a project, library, talk or blog post from the evals or AI space, and recruiters are not accepted.

LLM evaluationLLM-as-judgeObservabilityOpenTelemetry +11
We reach founder, head of talent and hiring manager Power Apply
AltaML Inc.Date not stated

AI Engineer (Brilliant Harvest)

Remote120,000 – 130,000 a year

Remote AI engineering role building production LLM agents and RAG features for the Brilliant Harvest platform, at $120,000 to $130,000 a year. Suits engineers with three or more years of experience who have shipped LLM applications and want to work on agents and retrieval quality.

PythonTypeScriptC#LLM Agents +14
We reach team lead, recruiter and a recent hire on the team Power Apply
‹ Previous Page 4 of 5 Next ›

Browse by role

Jobs by role and place

Remote jobs by role and country

Browse by location

Browse by work mode

Browse by employment type

Browse by seniority

Remote roles

Browse by skill

Browse by industry

Browse by product

Companies hiring