Who we'd reach at RemoteJobsOneFound and reached by Power Apply
Best leadHiring manager
Leads the team this role joins
Recruiter
In-house, owns the opening
Posted this job
Put the opening up
From your own Gmail and LinkedIn.
About the role
This is a remote contract role for mid-level engineers with paid AI-training or evaluation experience, open to candidates in 55 countries including Canada. The work is writing challenging computational engineering tasks and judging how advanced AI models handle engineering problems. Pay is hourly at $60-120 USD, paid per accepted task, with at least 15 hours per week expected.
What you’ll do
- Write computational engineering tasks that test advanced AI models.
- Produce task instructions, reproducible environments, reference solutions and evaluation criteria.
- Assess model-generated code, calculations, simulations, designs and analyses for correctness.
- Identify failures and set objective standards for correct solutions.
What they’re looking for
- Prior paid experience training, evaluating, benchmarking or improving AI systems on engineering or technical work.
- Deep expertise in at least one engineering specialization.
- Strong programming or scripting ability, with Python strongly preferred.
- Hands-on use of computational methods for analysis, simulation, modelling, optimization, testing or automation.
- A record of producing or checking technical results with clear, reproducible answers.
- Public evidence of skill, such as production designs, validated simulations, publications, open-source code or competition results.
Nice to have
- A master's degree, PhD or substantial professional experience in a relevant engineering discipline.
- Experience creating AI-training tasks, rubrics, graders or benchmark problems.
- Experience reviewing other trainers' technical submissions.
- Familiarity with command-line tools, solver APIs and programmatic engineering software.
- Experience validating results against calculations, measurements or physical tests.
- Experience with long-horizon or agentic AI evaluations.
- Availability to start immediately.
What’s on offer
- Hourly rate of $60-120 USD, paid per accepted task.
- Output-based compensation, with task availability and completion time that may vary.
- Flexible schedule of 15 or more hours per week.
Skills
AI model evaluationAI trainingBenchmarkingPythonComputational engineeringEngineering simulationOptimizationTask designEvaluation criteriaCode evaluationCommand line toolsSolver APIsAgentic AI
Questions about this role
Is this role remote?
Yes. It is fully remote and open to candidates in 55 countries, including Canada.
How is it paid?
At $60-120 USD per hour, paid per accepted task, based on output.
Do I need AI training experience?
Yes. Prior paid experience training, evaluating or benchmarking AI systems is required.