Who we'd reach at AskableFound and reached by Power Apply
Best leadHiring manager
Leads the team this role joins
Founder
Decides on early hires
Head of talent
Runs hiring at the company
From your own Gmail and LinkedIn.
About the role
This is a remote contract role, open worldwide, for experienced software engineers who turn a real change in a known codebase into an AI coding task. The tasks are used to measure and train AI coding models, so they need to be difficult for models and still fair for a capable engineer. Payment is made per task that passes review, and you can take on as many tasks as you want.
What you’ll do
- Propose a real change from a repository you know well and get it approved.
- Prepare the repository in its pre-change state, then write the brief, the correct solution and the grading checks.
- Confirm that the checks reject lazy, wrong and shortcut solutions.
- Run the task against leading AI models until strong models often fail.
- Revise the task through review, which often takes more than one round.
What they’re looking for
- 2 or more years of professional software engineering.
- Code merged into a public open-source repository, or a private codebase you own (not employer or client code).
- Strong skill in at least one of Python, TypeScript, Go, Rust, Java or C++.
- Solid knowledge of Docker, Linux, Git and automated testing.
- Frequent use of an AI coding tool.
- Ability to explain a change clearly and concisely.
- At least 10 hours a week, starting now.
- A secure personal or work computer, not a public or shared one.
Nice to have
- Writing tests, rubrics or evaluation criteria, ideally for AI models.
- Deep expertise in one area such as databases, compilers, distributed systems, security or infrastructure.
- Experience building agent tasks or RL environments.
What’s on offer
- US$400-US$1,000 for each task that passes quality review, paid directly.
- A minimum of one task a week, around 10 hours a week.
- Remote work from any location.
- Askable's contract terms apply after your proposal is qualified.
Skills
Questions about this role
Is this role open worldwide?
The listing says worldwide and remote, with any location accepted.
How is the work paid?
US$400-US$1,000 per task that passes review, paid directly to you.
How many years of experience are needed?
At least 2 years of professional software engineering.
What is the time commitment?
About 10 hours a week, with a minimum of one task a week.