Runs the team day to day
In-house, owns the opening
Joined the team recently
From your own Gmail and LinkedIn.
About the role
This is a remote contract for experienced business operations practitioners who design benchmark tasks that test how well AI systems handle operational work. It suits people with five or more years of hands-on operations, reporting, process design or workflow management who can write objective grading criteria. Pay is up to $90 per hour equivalent, at about 10 hours per task, and the listing states there are no geographic restrictions.
What you’ll do
- Design realistic, multi-step business operations tasks drawn from reporting, process design and workflow management.
- Write objective grading criteria so two qualified reviewers would reach the same verdict.
- Build tasks that need judgment, where the right answer depends on reading supporting materials accurately.
- Create or source supporting files such as spreadsheets, system exports, process documents and operational reports.
- Flag tasks that are ambiguous or cannot be graded instead of submitting them.
- Deliver approved tasks on schedule and at the required quality.
What they’re looking for
- Five or more years of direct ownership of business operations, operations reporting, process design or workflow management, not supervisory-only or adjacent exposure.
- Experience creating or applying SOPs, QA checklists, process documentation, service level definitions or training assessments.
- Strong Excel skills and the ability to reason across several documents at once.
- Strong written and spoken English, at least B2, with C1 preferred.
Nice to have
- Experience evaluating AI or LLM output.
What’s on offer
- Fully remote contract work.
- Flexible, task-based hours.
- Pay of up to $90 per hour equivalent.
- The listing states there is no country allowlist and no timezone requirement.
Skills
Questions about this role
Can I apply from any country?
The listing states there are no geographic restrictions and no timezone requirement. Strong English at B2 minimum, with C1 preferred, is required.
How much does it pay?
Up to $90 per hour equivalent, at about 10 hours per task.
Do I need AI experience?
No prior AI experience is needed, though AI or LLM evaluation experience is a plus.
How do I apply?
Apply, complete the screening questions and the role's AI interview, then go through onboarding with the Talent Ops team.