Senior Machine Learning Engineer
Skills
About the role
This is a senior machine learning engineering role at Atlassian, on the Rovo Chat Quality team, for someone who builds evaluation and production ML systems for AI agents. The role can be done in-office or remotely, with the listing anchored to San Francisco. You would work on datasets, automated judges, experimentation platforms and quality signals for Atlassian's Rovo AI agents.
What you’ll do
- Architect and build production ML and evaluation systems including datasets, simulations, automated judges and experimentation platforms
- Advance Rovo's agentic capabilities across reasoning, planning, tool use, retrieval and memory
- Identify systemic failure modes, ship interventions and measure customer impact
- Make technical decisions on model choice, prompting, fine-tuning and system architecture balancing quality, latency and cost
- Lead cross-organizational initiatives with ML, engineering, product and design partners
- Mentor other engineers and raise the bar on AI product quality standards
What they’re looking for
- Track record architecting and shipping large-scale ML or AI systems with measurable impact
- Deep experience with LLM-powered products, agentic systems, model evaluation and dataset development
- Strong production engineering skills in a modern ML stack
- Technical leadership setting direction and influencing across teams
- Excellent product and technical judgment balancing quality, speed, safety and cost
What’s on offer
- Base pay $171,063-$269,075 depending on geographic zone
- Eligible for benefits, bonuses, commissions and equity
- Health and wellbeing resources
- Paid volunteer days
Questions about this role
Is this role remote?
It can be done in-office or remote; Atlassian can hire in any country where it has a legal entity.
How much does it pay?
Base pay ranges from $171,063 to $269,075 depending on geographic pay zone.
What team would I join?
The Rovo Chat Quality team within Atlassian's Rovo + AI organization.
How this role compares
One of 8 open Senior Machine Learning Engineer roles we are tracking today.
Posted yesterday, and nothing like it has been posted since and 7 still open from before.
Related roles
Principal Machine Learning Engineer
A principal machine learning engineering role at Atlassian setting technical vision for the Rovo Chat AI agent, open remotely from Seattle. Suited to a highly experienced ML engineer who wants to lead evaluation and agentic AI strategy across the company.
Senior Machine Learning Engineer
A senior machine learning engineering role at Atlassian building evaluation and agentic AI systems for the Rovo product, open remotely. Suited to an experienced ML engineer who wants to remain hands-on while setting technical direction.
Senior Data Scientist — Machine Learning
Atlassian is hiring a senior data scientist in Bengaluru to develop machine learning for search, recommendations, and AI assistants. The role suits candidates with 5 to 10 years of experience in production ML, Python, and NLP or LLM systems.
Senior Machine Learning Engineer, Ad Tech Engineering
Senior hybrid machine learning role in Bengaluru for an experienced engineer building AI systems for Roku's advertising platform. You'll work on multimodal ad understanding, brand safety, moderation, creative generation, and large-scale model serving.
Senior Machine Learning Engineer - Advertising Engineering
Senior hybrid machine learning engineering role in Bengaluru focused on Roku's advertising data and AI platform. You'll build large-scale ML systems and agentic generative AI features for targeting, measurement, reporting, and optimization.
Senior Machine Learning Engineer (TechTree)
Remote senior machine learning engineer role in Warszawa or Kraków focused on real-time disinformation detection and production ML infrastructure. The position suits an engineer who can own models, data systems, deployment, and monitoring rather than working only on research prototypes.