Leads the team you would join
Signs off on engineering hires
Owns the opening
From your own Gmail and LinkedIn.
About the role
This is a remote contract role for software engineers who train and evaluate AI models by writing technical tasks and reviewing model-generated code. It suits engineers with paid experience in AI training or model evaluation, strong Python skills and a public record of technical work. The engagement is run by Xperteez Technology, is ongoing, and lists an immediate start.
What you’ll do
- Write realistic software engineering tasks that test advanced AI models.
- Prepare task instructions, reproducible environments, reference solutions, tests and grading criteria.
- Assess model-generated code for correctness, robustness and completeness.
- Spot problems in implementation, debugging, dependencies, performance, testing and reproducibility.
What they’re looking for
- Prior paid experience training, evaluating, benchmarking or improving AI systems.
- Strong practical Python.
- Professional experience in at least one further language, such as Java, JavaScript, TypeScript, Rust, C++, C# or Go.
- A solid grasp of software design, debugging, testing, version control and dependency management.
- Public evidence of skill, such as substantial GitHub or GitLab work, open-source contributions, programming-competition results, published tools or technical write-ups.
Nice to have
- Experience writing AI training tasks, reference solutions, tests, graders or benchmark problems.
- Experience reviewing other AI trainers' submissions.
- A Codeforces rating around 1900 or higher, or strong results in another programming competition.
- Working knowledge of Linux, Docker, CI/CD, command-line tools or sandboxed environments.
- Prior work on long-horizon or agentic coding evaluations.
- Availability to start immediately.
What’s on offer
- A remote, ongoing contract.
- Pay between USD 124,800 and USD 249,600 per year.
Skills
Questions about this role
Is this role remote?
Yes, it is a remote contract.
How much does it pay?
The listing gives USD 124,800 to 249,600 per year.
How many years of experience do I need?
Three years is listed.
How do I get hired?
Submit your application with AI-training experience and public technical evidence, complete an AI interview with technical and integrity checks, then go through a hiring-manager review and project onboarding.