Leads the team this role joins
Runs the team day to day
Decides on early hires
From your own Gmail and LinkedIn.
About the role
This is a remote contract role for machine learning engineers with prior paid experience training or evaluating AI systems, with a location requirement of the United States. You would write demanding machine learning tasks, judge AI-generated code and analyses, and find technical faults in model output. The commitment is 15 or more hours per week on a flexible schedule.
What you’ll do
- Create realistic machine learning engineering tasks intended to challenge advanced AI models.
- Write task instructions, reproducible environments, reference solutions and evaluation criteria.
- Assess AI-generated code, experiments, analyses and technical deliverables for correctness and reliability.
- Identify problems such as data leakage, faulty validation, unstable training, performance limits and reproducibility gaps.
- Give actionable feedback to improve model performance and evaluation standards.
What they’re looking for
- Prior paid professional experience training, evaluating, benchmarking or improving AI systems.
- Strong practical Python skills.
- Hands-on experience with frameworks such as PyTorch, JAX, TensorFlow, scikit-learn, XGBoost, LightGBM or similar.
- A solid understanding of machine learning workflows, model validation, training methods and performance evaluation.
- Publicly verifiable proof of expertise, such as GitHub projects, competition results, Hugging Face models or datasets, publications or open-source contributions.
Nice to have
- Experience creating AI training tasks, reference answers, rubrics, graders or benchmark problems.
- Experience reviewing technical submissions from other AI trainers.
- Kaggle Expert, Master or Grandmaster status, or strong results in other technical competitions.
- Publications or open-source machine learning contributions.
- Experience with long-horizon or agentic AI evaluations.
- Availability to begin immediately.
What’s on offer
- Fully remote contract engagement on a flexible schedule.
- Pay listed at 50-90 USD in the posting's FAQ, while the main listing hides salary.
Skills
Questions about this role
Is this role remote?
Yes, it is fully remote, with a location requirement of the United States.
How many hours per week are needed?
15 or more hours per week, on a flexible schedule.
How do I apply?
Apply through the employer's site. The process includes an AI interview covering technical and integrity checks, a hiring manager review, and then project onboarding.
What proof of experience is expected?
Publicly verifiable work such as GitHub projects, competition results, Hugging Face models, publications or open-source contributions.