Get Started
Hunting for you, 24x7Get the iPhone app

Your hunt runs in your pocket, and tells you the moment a strong match opens.

Download on theApp Store
OpenTrain AIPosted 4 days ago

Member of Technical Staff, Coding Research

Who we'd reach at OpenTrain AIFound and reached by Power Apply
Best leadHiring manager

Leads the team this role joins

Recruiter

In-house, owns the opening

Head of the team

Director or head of the group

Power Apply

From your own Gmail and LinkedIn.

About the role

This is a part-time, remote contract role for senior research engineers who evaluate coding models and coding agents, open to applicants in 52 countries. Pay is USD 86.54-125 per hour, and applicants apply through OpenTrain, which passes them to the hiring company's own form. The work centers on benchmark design, evaluation frameworks and investigating where coding systems fail.

What you’ll do

  • Design evaluation frameworks with benchmark specifications, scoring methods, rubrics and quality standards.
  • Lead research measuring coding-model performance across software engineering tasks.
  • Create datasets, reference examples and evaluation procedures for reliable assessment.
  • Investigate model behavior and failure modes, then feed the findings into training and evaluation work.
  • Build tools and infrastructure for experiments, data generation, review workflows and evaluation pipelines.
  • Set repeatable practices for assessing coding agents.
  • Design experiments with research and engineering collaborators, and report results in technical reports and benchmark studies.

What they’re looking for

  • Fluent English.
  • Strong software engineering skills in Python, C++ or a comparable language.
  • Experience designing, reviewing or validating technical assessments, benchmarks, coding tasks or evaluation methods.
  • Familiarity with LLMs, coding agents, reinforcement learning or model evaluation.
  • Ability to build tools, automate workflows and draw insights from complex technical systems.
  • Clear written and verbal communication, including explaining technical findings to different audiences.

Nice to have

  • Coding-agent research or experience with advanced AI systems.
  • Benchmark or dataset design at scale.
  • Agent workflows, tool use, reinforcement learning or post-training methods.
  • Publications, open-source contributions or technical leadership in AI, machine learning or software engineering.

What’s on offer

  • USD 86.54-125 per hour.
  • Part-time contract engagement.
  • Fully remote work.

Skills

Questions about this role

How much does it pay?

USD 86.54-125 per hour.

Which programming languages does the role need?

Python, C++ or a comparable language.

How do I apply?

Create a free OpenTrain account and add your resume, then complete the hiring company's form, which asks for your resume, LinkedIn profile, phone number, location and answers to two screening questions. A short AI interview follows.