Skip to main content
Atlassian

Principal Machine Learning Engineer

RemoteWorldwide
Published
Role
Fullstack
Experience
Senior
Employment
Full-time
$236.7k–$309k/yr
Check eligibility

Open to Worldwide. Set where you work from to check your eligibility.

No BS summary

Principal ML Engineer in the Rovo & AI Engineering org, contributing to Rovo Chat, leading technical vision, building production ML and evaluation systems, advancing agentic capabilities, and leading cross-organizational initiatives.

Core skills

LLM/agentic systems/model evaluation/experimentation/dataset development

Required skills

production engineeringML stack

What you'll do

  • Set the technical vision for how Atlassian measures and improves Rovo Chat, translating qualities such as helpfulness, correctness, judgment, and reliability into rigorous evaluation strategies.
  • Architect and build production ML and evaluation systems that operate at scale, including datasets, simulations, automated judges, regression suites, experimentation platforms, and online quality signals.
  • Advance the state of Rovo's agentic capabilities across reasoning, planning, tool selection and use, action correctness, retrieval, memory, and long-horizon execution.
  • Close the loop between evaluation and product impact: identify systemic failure modes, develop interventions, ship them to production, and establish whether they improved customer outcomes.
  • Make high-leverage technical decisions across model choice, prompting, fine-tuning, data strategy, system architecture, and inference; balancing quality with latency, reliability, safety, and cost.
  • Lead ambitious, cross-organizational initiatives with ML, engineering, product, analytics, research, and design partners, creating clarity and momentum where neither the problem nor the solution is well defined.
  • Establish reusable methods, systems, and quality standards that raise the bar not only for Rovo Chat, but for AI-powered experiences across Atlassian.
  • Multiply the impact of other engineers through technical leadership, design reviews, mentorship, and a compelling long-term vision for how we build and evaluate world-class AI products.

What they require

  • A track record of architecting and shipping large-scale ML or AI systems that deliver measurable customer and business impact.
  • Deep experience with LLM-powered products, agentic systems, model evaluation, experimentation, and dataset development.
  • Strong production engineering skills and the ability to remain hands-on in a modern ML stack.
  • Principal-level technical leadership: setting direction, influencing across teams, and leading complex initiatives from ambiguity to production.
  • Excellent product and technical judgment, including balancing quality, speed, reliability, safety, latency, and cost.
  • The ability to communicate complex ideas clearly and raise the effectiveness of engineers around you through mentorship and technical leadership.
  • 7+ years of experience as a software developer
  • Experience building customer facing Gen AI Applications at scale
  • Experience pushing the state of the art to achieve breakthrough quality and reliability
  • Deep understanding of Machine Learning projects lifecycle
  • Experience leading and supporting senior engineers and working cross functionally

Benefits

  • health and wellbeing resources
  • paid volunteer days
  • benefits, bonuses, commissions, and equity

At Atlassian, we're motivated by a common goal: to unleash the potential of every team. Our software products help teams all over the planet and our solutions are designed for all types of work. Team collaboration through our tools makes what may be impossible alone, possible together.

SoftwareEnterpriseatlassian.com/
$236.7k–$309k/yr