Leads the team you would join
Signs off on engineering hires
Owns the opening
From your own Gmail and LinkedIn.
About the role
This is a full-time, remote AI research engineer role for people with three or more years of experience in software engineering, machine learning or model evaluation, open to candidates in India. The job is designing the benchmarks, rubrics and evaluation methods that measure coding agents and guide how they improve. The team works on frontier coding agents, so the work sits between AI research, software engineering and model evaluation.
What you’ll do
- Own evaluation frameworks for coding agents, including benchmark specs, scoring methods, rubrics and quality bars
- Lead research into measuring and raising coding model performance across software engineering tasks
- Build datasets, golden examples and evaluation protocols for frontier coding systems
- Study model behaviour and failure modes, then turn findings into training and evaluation changes
- Build tooling for large-scale experiments, data generation, review and evaluation pipelines
- Set methodology standards for reproducibility and measurement quality in coding-agent assessment
- Collaborate with researchers, engineers and applied AI teams on experiments
- Contribute to technical reports, benchmark studies and client-facing research
What they’re looking for
- Strong software engineering background with Python, C++ or a comparable language
- Three or more years in software engineering, machine learning, AI research, evaluation or a related field
- Experience designing, reviewing or validating technical assessments, benchmarks, coding tasks or evaluation methods
- Familiarity with large language models, coding agents, reinforcement learning or model evaluation
- Ability to build tooling, automate workflows and improve technical processes
- Strong analytical skills for investigating model behaviour
- Clear written and verbal communication for technical and non-technical audiences
- Comfort working in fast-moving research environments with ambiguity
Nice to have
- Experience with frontier AI systems, coding agents or evaluation research
- Interest in how data, evaluations and feedback shape model capability
- A record of driving ambiguous projects from concept to delivery
- Experience designing benchmarks or datasets for machine learning at scale
- Familiarity with agentic workflows, tool use, reinforcement learning or post-training
- Publications, open-source contributions or technical leadership in AI or software
What’s on offer
- Base salary range of USD 200,000 to 260,000 per year
- Equity compensation for all employees
- Possible performance-based bonuses
- Up to 100% reimbursement of health insurance premiums
- Paid time off
- 401(k) plan with company match
Skills
Questions about this role
Is this role remote?
Yes, the role is listed as remote and full-time.
How much does it pay?
A base salary range of USD 200,000 to 260,000 per year, plus equity and possible performance bonuses.
How many years of experience are needed?
Three or more years in software engineering, machine learning, AI research, evaluation or a related field.