Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store

LLM evaluation jobs

99 open roles for llm evaluation, updated continuously as employers post them.

99 open roles
CrestaPosted 10 days ago

AI Agent Evaluation Engineer

Canada · United StatesRemoteMid level

A remote evaluation role for Canada and US candidates with 3+ years of experience, who will define and measure quality for Cresta's AI receptionist agents. It suits engineers who can read LLM agent traces, build judges and regression suites in Python, and write clear guidelines.

LLM EvaluationEvaluation RubricsLLM-as-a-JudgeGolden Datasets +11
We reach team lead, recruiter and a recent hire on the team Power Apply
ZipPosted in November 2026

Product Manager, GTM AI Systems

San Francisco, United StatesHybridManager

A full-time hybrid product role in San Francisco that owns AI tools and agents for sales, marketing, customer success and sales ops at an enterprise procurement platform. Suited to product managers with six or more years of B2B SaaS experience who can also build prototypes.

Product managementGTM strategySales operationsSalesforce +13
We reach team director, hiring manager and recruiter Power Apply
Power Apply

Skip the portal. Reach the person hiring.

One tap and Frontrunner finds who hires for the role, writes in your voice, and sends from your own Gmail and LinkedIn.

Finds themHiring manager
WritesIn your voice
SendsGmail and LinkedIn
Tracks repliesIn one place
Bertelsmann SE & Co. KGaAPosted in November 2026

Senior Infrastructure Engineer, AI & ML, Penguin Random House (Open to Remote) (

United StatesRemoteSenior$185,000 – $210,000 a year

A senior, fully remote infrastructure role in the United States for an engineer with 5+ years of production experience and a focus on AWS and ML deployment tooling. It suits people who can build self-service platforms that help data scientists ship models safely and quickly.

AWSCloud InfrastructureCI/CDMLOps +10
We reach CTO, engineering lead and technical recruiter Power Apply
Bidgely, IncPosted 10 days ago

Software Engineer 3 - GenAI

India Head OfficeRemoteSenior

A senior remote GenAI engineering role at Bidgely, building a LangGraph-based multi-agent assistant for utility customers. Suits engineers with six to ten years of experience who have shipped LLM features and can lead design and reviews.

PythonJavaLangGraphLangChain +16
We reach hiring manager, team lead and founder Power Apply
POLYGON LABSPosted 10 days ago

AI Platform Engineer

EMEA - RemoteRemoteSenior

A senior remote platform role for EMEA engineers who build AI agent infrastructure for a blockchain payments company. It suits engineers with five or more years of experience who have put LLM agents into production and can build the guardrails and evaluations around them.

TypeScriptPythonGoModel Context Protocol +14
We reach talent partner, hiring manager and a senior teammate Power Apply

Every new role is checked against your skills, experience, place and pay. If they can't hire you, it never reaches you.

WkPosted 10 days ago

Senior Enterprise Software Engineer -AI Operations

Chennai, INSenior

A staff-level senior AI engineering role in Chennai, building enterprise AI on Amazon Bedrock and Azure AI Foundry. It suits engineers with 6-8 years of experience who can set technical direction and mentor others.

Amazon BedrockMicrosoft Azure AI FoundryAmazon Bedrock AgentCoreAzure AI Agent Service +16
We reach CTO, engineering lead and technical recruiter Power Apply
Polygon BridgePosted 10 days ago

AI Platform Engineer

EMEA - RemoteRemote

A full-time, remote AI Platform Engineer role for experienced engineers across EMEA and the USA, building the platform behind the company's agents. It suits engineers who have shipped LLM systems and agent tooling and who know identity, guardrails and observability.

AI agentsModel Context ProtocolLLM evaluationOAuth +16
We reach technical recruiter, engineering manager and a team member Power Apply
Bidgely, IncPosted 10 days ago

Software Engineer 3 - GenAI

India Head OfficeRemoteSenior

A senior, full-time remote GenAI engineering role building multi-agent LLM systems for utility customer assistants at Bidgely. Suits experienced engineers with six to ten years of backend and LLM production experience who can lead design reviews.

PythonJavaLangChainLangGraph +16
We reach team lead, recruiter and a recent hire on the team Power Apply
Hunting 24x7
306,344

new roles this week. Frontrunner reads every one for you.

It never stops looking, and it only wakes you for the good ones.

WorleyPosted 11 days ago

Senior Principal Digital Solutions Consultant

Bengaluru, IndiaPrincipal

A senior principal consulting role in Bengaluru, India, for a solutions leader with twelve to fifteen or more years of experience, designing AI products for Worley's priority projects. It suits people who can link business discovery with architecture and production delivery.

Generative AIAgentic AIMachine learningRetrieval-augmented generation +14
We reach talent partner, hiring manager and a senior teammate Power Apply
HellopatientPosted in November 2026

AI Agent Product Manager, Agent Deployment

Austin, United StatesRemoteManager$110,000 – $145,000 a year

A full-time remote AI agent product manager role tied to Austin, Texas, building and running healthcare voice agents for patient communication. It suits product people with a conversational design or voice background and at least one year of building AI agents.

Conversational AIVoice AIPrompt EngineeringAI Agents +10
We reach CTO, engineering lead and technical recruiter Power Apply
HackerRankPosted in November 2026

Senior Deep Learning Research Engineer

Bengaluru, India · Sterling, United StatesSenior

A senior research engineering role at HackerRank in Bengaluru and Sterling, VA, for deep learning researchers working on hiring AI. It suits candidates with 3-7 years of experience and a graduate degree who can turn papers into production models.

Deep LearningPyTorchJAXNeural Architectures +16
We reach talent partner, hiring manager and a senior teammate Power Apply
AlignerrPosted in November 2026

Senior Machine Learning Engineer

RemoteSenior$60 – $80 an hour

A remote hourly contract role for a senior ML practitioner to write and review reasoning traces that train LLMs, paying $60-$80 per hour for 10-40 hours a week.

Large language modelsReasoning tracesLLM evaluationData annotation +2
We reach engineering manager, tech lead and technical recruiter Power Apply
GleanPosted 11 days ago

Product Manager, AI

San Francisco Bay Area, United StatesHybridManager$160,000 – $240,000 a year

A full-time hybrid product manager role in the San Francisco Bay Area focused on LLM strategy, model vendors and customer adoption for an enterprise AI platform. Suited to product managers with four or more years of experience in enterprise SaaS.

Product managementLLM evaluationModel selectionCapacity planning +8
We reach team lead, recruiter and a recent hire on the team Power Apply
RemotobotPosted 11 days ago

Senior Agentic Ai Engineer Nda - GT

nullRemoteSenior

A full-time, remote senior agentic AI engineering role building a conversational analytics platform on governed client data. It suits engineers with six or more years of experience and at least two years in agentic AI.

PythonAgentic AILangChainLangGraph +14
We reach team director, hiring manager and recruiter Power Apply
MedtronicPosted 11 days ago

IT Developer - LLM Engineer

Hyderabad, IndiaOn-siteMid level

A full-time onsite LLM engineering role in Hyderabad, India, for an IT developer who fine-tunes, evaluates and deploys large language models at Medtronic. It suits engineers with 3+ years of ML or software experience and 2+ years of hands-on generative AI work.

Large Language ModelsFine-TuningLoRAQLoRA +15
We reach CTO, engineering lead and technical recruiter Power Apply
SS&C TechnologiesPosted 11 days ago

Generative AI Developer, Engineer, Analyst

IndiaRemoteEntry level

A remote, full-time junior-to-mid GenAI engineering role in India for building LLM applications on internal platforms at a financial services technology company. Suits candidates with roughly two to three years of LLM and analytics work who can code and write clearly in English.

Generative AILarge language modelsPrompt engineeringFew-shot prompting +11
We reach technical recruiter, engineering manager and a team member Power Apply
FactsetPosted 11 days ago

Senior Software Engineer

Hyderabad, INSenior

A senior individual contributor role in Hyderabad building AI, LLM and agentic platform features for FactSet's buy-side data and managed services tools. It suits Python engineers with five to eight years of experience and strong PostgreSQL and system design skills.

PythonPostgreSQLLLM evaluationLangGraph +12
We reach CTO, engineering lead and technical recruiter Power Apply
ProofpointPosted 11 days ago

Senior AI Engineer

Hyderabad, IndiaOn-siteSenior

A senior, in-office AI engineering role in Hyderabad for someone with 6+ years of experience shipping production agentic AI systems. It suits senior engineers who design the architecture, evaluation and standards for LLM-based products and mentor others.

GoPythonLLMsAgentic AI +14
We reach technical recruiter, engineering manager and a team member Power Apply
CitiPosted in November 2026

Risk Modeling Solutions - Full-stack GenAI - Assistant Vice President

Director

A senior, full-time GenAI engineering role on Citi's Risk Modeling Solutions team, building agentic and RAG systems in Python. Suits engineers with about six years of software and ML experience who can work within risk and governance constraints.

PythonFastAPILangChainLangGraph +16
We reach team lead, recruiter and a recent hire on the team Power Apply
SUPABASEPosted 12 days ago

Software Engineer - AI Tooling

Remote, GlobalRemoteSenior

A senior, remote-worldwide software engineering role on Supabase's AI Tooling team, building MCP, agent and assistant tooling with evaluation built in. It requires five or more years of professional experience and strong TypeScript and Postgres skills.

TypeScriptJavaScriptnpmES modules +12
We reach CTO, engineering lead and technical recruiter Power Apply
OpenTrain AIPosted 12 days ago

Senior Software Engineer, Part-Time AI Review

WorldwideRemoteSenior

A part-time, remote contractor role for senior software engineers to review and evaluate AI-generated code, open worldwide. Suits engineers who want flexible, feedback-focused AI training work.

Code ReviewPythonJavaScriptJava +10
We reach recruiter, hiring manager and head of the team Power Apply
Mpathic2Posted in November 2026

Applied AI Engineer

Remote · WorldwideRemoteMid level

A remote, full-time mid-level role building the gateway, evaluation gates and release path for LLM features at a trustworthy-AI company. Suited to backend engineers with five or more years of experience who have taken LLM features into production.

PythonLLM APIsPrompt engineeringStructured outputs +16
We reach engineering manager, tech lead and technical recruiter Power Apply
SsctechPosted 13 days ago

Advanced Prompt Engineer

Hyderabad, INMid level

An experienced prompt engineering role in Hyderabad, India, building and evaluating structured, guarded LLM prompts for financial and healthcare software. It suits engineers with five to nine years of Python and foundation model experience.

Prompt EngineeringPythonLarge Language ModelsGPT-4 +14
We reach engineering manager, tech lead and technical recruiter Power Apply
‹ Previous Page 3 of 5 Next ›

Browse by role

Jobs by role and place

Remote jobs by role and country

Browse by location

Browse by work mode

Browse by employment type

Browse by seniority

Remote roles

Browse by skill

Browse by industry

Browse by product

Companies hiring