Leads the team you would join
Owns the opening
On the team, can refer you
From your own Gmail and LinkedIn.
About the role
This is a part-time remote contract role for software engineers who write coding tasks used to test how well AI models write code. It is open to candidates in 52 countries and pays per accepted task, at 50 to 100 USD per hour equivalent. The engineer designs realistic bug, feature, refactoring, and performance problems, along with reproducible environments and checks that reject hard-coded answers. Work is under 20 hours per week, and previous AI work is not required.
What you’ll do
- Write realistic coding problems based on repositories you know well.
- Create tasks covering bugs, feature requests, refactors, and performance issues that require judgment rather than lookup or boilerplate.
- Build reproducible development environments for each task.
- Write verifiers that accept several valid implementations while rejecting incomplete, wrong, or hard-coded solutions.
- Provide a valid reference solution for each task.
- Flag tasks that are unclear or too hard to verify consistently.
What they’re looking for
- Hands-on expertise in at least one of Python, Java, Rust, Go, C++, or TypeScript.
- Strong understanding of algorithms, data structures, and software engineering principles.
- Ability to debug complex systems, fix bugs, deliver optimizations, and explain technical decisions in documentation.
- Professional fluency in English.
Nice to have
- Large-codebase refactoring or legacy system modernization.
- Substantial feature delivery on real repositories.
- Experience with reproducible environments or performance-sensitive systems.
- Interest in AI and its technical challenges.
What’s on offer
- Pay of 50 to 100 USD per hour equivalent, paid per task that meets project specifications.
- Part-time contract work of under 20 hours per week.
- Fully remote arrangement.
Skills
Questions about this role
How much does it pay?
It pays 50 to 100 USD per hour equivalent, paid per task that meets project specifications.
How many hours per week does it take?
Less than 20 hours per week.
How do I apply?
Apply in about two minutes, then complete a short AI interview. For technical roles this includes a coding challenge, and passing it qualifies you for paid tasks.