Leads the team this role joins
In-house, owns the opening
Put the opening up
From your own Gmail and LinkedIn.
About the role
This is a senior Python developer role on a one-month contract assignment, listed as remote with an India location. The work supports a project with a foundational large language model company, producing training and evaluation data for its models. You would write Python code and run model evaluations, rankings and rationales rather than building or fine-tuning the models yourself. Contract work carries no medical or paid leave, and the commitment is at least 20 hours a week with a four-hour overlap with Pacific time.
What you’ll do
- Design, build and maintain Python code used to train and tune AI models.
- Run evaluations that benchmark model performance and analyze the results.
- Evaluate and rank model responses across many domains against set criteria.
- Write clear rationales that explain each evaluation.
- Lead supervised fine-tuning work, including building and maintaining task-specific datasets.
- Work with researchers and annotators on reinforcement learning from human feedback and reward model refinement.
What they’re looking for
- At least 3 years of strong hands-on Python experience.
- Industry experience with code quality, formatting and software best practices.
- Experience with Python testing, including unit, integration and property-based tests.
- Knowledge of multithreading and asynchronous programming in Python.
- Ability to refactor architecture without introducing regressions.
- Strong debugging skills, including memory and concurrency issues.
- Fluent conversational and written English.
What’s on offer
- Contractor assignment with no medical or paid leave.
- One-month contract, with an expected start date the following week.
- Three time commitment options: 20, 30 or 40 hours per week.
- Evaluation takes about 75 minutes across two rounds: a 60-minute technical interview and a 15-minute cultural and offer discussion.
Skills
Questions about this role
Is this role remote?
Yes, the posting lists the role as remote.
How many years of experience do I need?
At least 3 years of strong experience with Python is required.
What type of engagement is it?
It is a one-month contractor assignment with no medical or paid leave.
How many hours per week are required?
At least 20 hours per week, with a minimum of 4 hours a day and a 4-hour overlap with PST. Options are 20, 30 or 40 hours.