Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store

LLM evaluation jobs

99 open roles for llm evaluation, updated continuously as employers post them.

99 open roles
WeekdayPosted 6 days ago

Senior AI Engineer (FDE Heavy)

INRemoteSenior₹7,000,000 – ₹10,000,000 a year

A senior, full-time, remote AI Engineer role in India building multi-agent and RAG systems for enterprise clients, for engineers with five or more years of experience.

PythonLangChainLangGraphMulti-agent Systems +5
We reach team lead, recruiter and a recent hire on the team Power Apply
CodatPosted 6 days ago

Senior AI Engineer

RemoteRemote or on-siteSenior£98,000 – £115,000 a year

A senior remote AI engineering role at Codat building LLM agents and evaluation for commercial banking. It suits senior engineers who have shipped LLM features and can measure whether they work.

Large language modelsLLM evaluationAI agentsModel Context Protocol +8
We reach engineering manager, tech lead and technical recruiter Power Apply
Power Apply

Skip the portal. Reach the person hiring.

One tap and Frontrunner finds who hires for the role, writes in your voice, and sends from your own Gmail and LinkedIn.

Finds themHiring manager
WritesIn your voice
SendsGmail and LinkedIn
Tracks repliesIn one place
Weekday AIPosted 7 days ago

Senior AI Engineer (FDE Heavy)

IndiaRemoteSenior₹7,000,000 – ₹10,000,000 a year

This senior remote role in India is for an engineer with at least five years of experience building multi-agent LLM systems and RAG pipelines for enterprise clients. It requires strong Python, LangChain and LangGraph skills.

PythonLangChainLangGraphRAG +8
We reach hiring manager, team lead and founder Power Apply
CleraPosted 7 days ago

Expert Talent Pool, Evals and Benchmarks (Associate)

RemoteMid level30 – 60 an hour

A fully remote, hourly talent pool role for early-career specialists who design AI model evaluations, write rubrics and grade model outputs. It suits people with up to five years of experience in QA, assessment, data analysis or research support.

Rubric designBenchmark designAI model evaluationLLM evaluation +10
We reach founder, head of talent and hiring manager Power Apply
Global AI Research LabsPosted in November 2026

AI Prompt Evaluator & Machine Learning Model Response Grader

United StatesRemote

This remote evaluation role has candidates score and justify AI model responses for accuracy, logic and safety. It suits graduates with strong written English and analytical skills.

LLM EvaluationFact-checkingTechnical WritingRLHF +1
We reach team lead, recruiter and a recent hire on the team Power Apply

Every new role is checked against your skills, experience, place and pay. If they can't hire you, it never reaches you.

Bolt.newPosted 7 days ago

Senior Applied AI Engineer

United StatesRemoteSenior

A senior remote AI engineering role building coding agents for the Bolt.new app builder. It suits engineers who have shipped LLM agents to production and have strong prompt engineering skills.

LLM agentsPrompt engineeringAI agentsTool use +10
We reach founder, head of talent and hiring manager Power Apply
RemotepromspPosted 7 days ago

Manager, Software Engineering - reputed company Assistant

Sweden · United StatesRemoteManager$180,000 – $200,000 a year

Remote US engineering manager role leading a team of five to six software and test engineers on an AI assistant for a legal document management platform. It suits a senior leader with seven or more years of engineering experience who has worked with large language models and agents.

Engineering ManagementTeam LeadershipLarge Language ModelsAI Agents +10
We reach hiring manager, team lead and founder Power Apply
FICOPosted in November 2026

Principal Harness Engineer

United KingdomRemoteSenior

Senior remote role in the UK at FICO focused on harness engineering: building the tooling, guides and quality controls that keep AI coding agent output correct. Suits engineers with deep architecture and testing experience who have worked with AI coding agents.

Harness engineeringAI coding agentsClaude CodeCodex +12
We reach CTO, engineering lead and technical recruiter Power Apply
Hunting 24x7
305,808

new roles this week. Frontrunner reads every one for you.

It never stops looking, and it only wakes you for the good ones.

Anuvaya LabsPosted 8 days ago

Member of Technical Staff - Applied AI Research

New Delhi, IndiaOn-sitePrincipal

A full-time, on-site applied AI research role in New Delhi that fine-tunes language models for Hindi and other Indian languages and gets them working in production. It suits engineers who have trained or evaluated LLMs and who can ship systems, not just experiments.

LLM fine-tuningIndic NLPHindiMultilingual NLP +11
We reach talent partner, hiring manager and a senior teammate Power Apply
IDeaSPosted 8 days ago

Product Manager - Generative AI

San Francisco, United StatesRemoteMid level

IDeaS is hiring a remote, mid-level Product Manager to define and deliver generative AI features for hospitality software. It suits product managers with three or more years of experience who can tie AI capabilities to measurable customer outcomes.

Product managementGenerative AILarge language modelsPrompt engineering +10
We reach hiring manager, recruiter and the person who posted the job Power Apply
TalentmatePosted 8 days ago

Artificial Intelligence Engineer

Gurugram, IndiaOn-siteMid level

A mid-level full-time AI agent engineering role in Gurugram, India, for engineers with three or more years of experience, based in an early-stage startup. It suits engineers who want to build agent systems from scratch and are happy working in-office six days a week.

PythonasyncioFastAPIDjango +12
We reach team director, hiring manager and recruiter Power Apply
IDeaSPosted 8 days ago

Product Manager - Generative AI

United StatesRemoteMid level

A remote, mid-level product manager role in the United States, owning generative AI features for hospitality analytics software. It suits product managers with three or more years of experience who can turn AI capabilities into trusted, measurable enterprise products.

Product ManagementGenerative AILarge Language ModelsRetrieval-Augmented Generation +10
We reach talent partner, hiring manager and a senior teammate Power Apply
DistantPosted in November 2026

Applied AI Engineer

Remote

A fully remote, long-term applied AI role building conversational agents and simulations for learner-facing e-learning products. It suits engineers who build LLM applications with strong testing and an awareness of compliance.

Prompt engineeringRetrieval-augmented generationLLM evaluationAgentic workflows +11
We reach team director, hiring manager and recruiter Power Apply
KakePosted 9 days ago

Senior AI/LLM Engineer (Python)

Hyderabad, India · حيدرأباد, IndiaRemoteSenior

A senior, fully remote contract role for Python engineers who build LLM and RAG applications and take them to production. It suits people in India who can overlap with US Pacific working hours.

PythonFastAPILLM APIsOpenAI API +14
We reach talent partner, hiring manager and a senior teammate Power Apply
HiringBlazePosted 9 days ago

Artificial Intelligence Engineer - LLM Models

Hyderabad, IndiaHybridMid level

A hybrid LLM and AI engineering role in Hyderabad for engineers with five to eight years of experience building RAG and agentic systems, open to candidates who can join within 30 days.

Retrieval-augmented generationLarge language modelsOpenAI APIAnthropic Claude +11
We reach hiring manager, recruiter and the person who posted the job Power Apply
Ruby LabsPosted 9 days ago

AI Engineer

Ukraine · MoldovaRemote

A remote AI engineering role for TypeScript developers who ship LLM features with evaluation and reliability in mind. Candidates should be within about 4 hours of CET, and the arrangement is an independent contractor agreement.

TypeScriptNode.jsCloudflare WorkersHono +15
We reach talent partner, hiring manager and a senior teammate Power Apply
delaPlexPosted 9 days ago

Lead ML Engineer – Classical ML & GenAI/RAG

Barbados · St. Pierre & Miquelon · Greenland · Jamaica · Dominican Republic · CubaRemoteSenior

A full-time remote senior role building and running classical ML models in production, with GenAI and RAG as a secondary skill. Suited to hands-on engineers with five or more years of ML experience who can work through ambiguous requirements.

Machine learningClassical MLPythonSQL +16
We reach engineering manager, tech lead and technical recruiter Power Apply
VodafonePosted in November 2026

Agentic AI Lead

Pune, IndiaSenior

A senior agentic AI lead role in Pune for Vodafone's HR assistant, covering multi-agent systems, RAG and evaluation. It suits engineers with 8 years of experience who can also mentor teams.

Agentic AIMulti-Agent SystemsRetrieval-Augmented GenerationModel Context Protocol +12
We reach hiring manager, recruiter and the person who posted the job Power Apply
JobgetherPosted 9 days ago

Data Annotator - Applied AI Engineer

IndiaRemoteMid level$30 – $80 an hour

A part-time, fully remote role in India evaluating and annotating LLM, RAG and agent systems for an AI project. It suits applied AI engineers with two to six years of experience who can judge AI code and outputs.

LLM evaluationData annotationRAGPython +14
We reach hiring manager, team lead and founder Power Apply
Built In (job listing aggregating platform)Posted 9 days ago

Senior Consultant, AI/ML Engineering - AstraZeneca

Bangalore, IndiaHybridSenior

Bangalore senior AI/ML engineering role for generative, agentic and classical ML work in AstraZeneca's commercial business, with applications closing 19 November 2026.

Generative AIAgentic AILarge Language ModelsRetrieval-Augmented Generation +16
We reach CTO, engineering lead and technical recruiter Power Apply
AstraZeneca PLCPosted 9 days ago

Senior Consultant, AI/ML Engineering

Bangalore, IndiaHybridSenior

Hybrid senior AI/ML engineering role in Bangalore leading generative, agentic and classical ML work for AstraZeneca's commercial teams, with applications closing 19 November 2026.

Generative AIAgentic AILarge Language ModelsRetrieval-Augmented Generation +16
We reach talent partner, hiring manager and a senior teammate Power Apply
Coursera + UdemyPosted 9 days ago

LLMops Engineer

Pune, IndiaRemote or on-siteMid level

A mid-level remote or hybrid LLMOps role in India, with the team based in Pune, focused on running LLM systems reliably in production. It suits backend and DevOps engineers with four or more years of experience who can operate non-deterministic AI systems.

PythonJavaTypeScriptGo +16
We reach hiring manager, recruiter and the person who posted the job Power Apply
ZscalerPosted 9 days ago

Software Engineering Architect, Machine Learning

Bengaluru, IndiaHybridPrincipal

A hybrid principal architecture role in Bengaluru designing enterprise agentic AI platforms within a zero trust security company, suited to architects with 12+ years of distributed systems experience who still write production code.

Distributed systemsAgentic AIMulti-agent orchestrationModel Context Protocol +10
We reach hiring manager, team lead and founder Power Apply
PolygonPosted 9 days ago

AI Platform Engineer

Remote

A remote, full-time platform engineer role at Polygon building and operating AI agent infrastructure. It suits senior engineers with more than five years of experience who have shipped LLM systems to real users.

TypeScriptPythonGoModel Context Protocol +16
We reach technical recruiter, engineering manager and a team member Power Apply
‹ Previous Page 2 of 5 Next ›

Browse by role

Jobs by role and place

Remote jobs by role and country

Browse by location

Browse by work mode

Browse by employment type

Browse by seniority

Remote roles

Browse by skill

Browse by industry

Browse by product

Companies hiring