Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store
RemoteJobsOnePosted in November 2026

Member of Technical Staff, Coding Agent Research & Evaluations – Remote (Worldwi

Who we'd reach at RemoteJobsOneFound and reached by Power Apply
Best leadHiring manager

Leads the team this role joins

Recruiter

In-house, owns the opening

Head of the team

Director or head of the group

Power Apply

From your own Gmail and LinkedIn.

About the role

This is a senior, full-time remote research role for engineers with at least three years of experience, open to candidates in several listed countries including Canada, France, Germany, India, the Netherlands, the Philippines, the United Kingdom and the United States. The work centres on measuring and improving frontier coding agents through benchmarks, scoring methods and datasets. The team is an AI research group that connects model evaluation with software engineering and training improvements.

What you’ll do

  • Design and own evaluation frameworks for coding agents, including benchmark specifications, scoring methods, rubrics and quality standards.
  • Lead research projects that measure and improve coding model performance across varied software engineering tasks.
  • Build high-quality datasets, reference examples and evaluation protocols.
  • Analyse model behaviour and failure patterns, and turn findings into training and evaluation changes.
  • Build tooling and pipelines for large-scale experiments, data generation, review and evaluation.
  • Set practices for reproducible, rigorous coding-agent assessment.
  • Work with researchers, engineers and applied AI teams on experiments.
  • Contribute to technical reports, benchmark studies and client-facing research.

What they’re looking for

  • A strong software engineering background, with Python, C++ or a similar language.
  • At least three years in software engineering, machine learning, AI research, evaluation or a related field.
  • Experience designing, reviewing or validating assessments, benchmarks, coding tasks or evaluation methods.
  • Familiarity with large language models, coding agents, reinforcement learning or model evaluation.
  • Experience building tooling and automating workflows through systematic experimentation.
  • Strong analytical skills and clear written and spoken communication.
  • Comfort working in fast-moving research settings with ambiguity.

Nice to have

  • Experience with frontier AI systems, coding agents or evaluation research.
  • Experience designing benchmarks or datasets for machine learning at scale.
  • Experience with agentic workflows, tool use, reinforcement learning or post-training.
  • Publications, open-source work or technical leadership in AI, machine learning or software engineering.

What’s on offer

  • Base salary between $200,000 and $260,000 USD.
  • Eligibility for equity compensation and possible performance bonuses.
  • Health insurance premium reimbursement of up to 100%, paid time off, and a 401(k) plan with company match.

Skills

Questions about this role

Is this role remote?

Yes. It is a fully remote position open to candidates in several listed countries.

How much does it pay?

The base salary is $200,000 to $260,000 USD, plus equity eligibility and possible bonuses.

How many years of experience do I need?

At least three years in software engineering, machine learning, AI research, evaluation or a related discipline.