Senior Machine Learning Engineer, AI-Native Evaluation & Search

About the Position

Atlassian is looking for a Senior Machine Learning Engineer to join our Search & Intelligence organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian’s AI products.

Responsibilities

• Develop and productionize machine learning systems for search, retrieval, ranking, conversational experiences, and AI agents.
• Own projects across the ML lifecycle, from problem definition and data development through experimentation, evaluation, deployment, and continuous improvement.
• Make evaluation a first-class part of AI development by defining quality, building evaluation datasets and benchmarks, analyzing model behavior, and using results to guide product and engineering decisions.
• Collaborate with product managers, software engineers, data scientists, research scientists, and platform teams.
• Independently solve complex problems, contribute to technical direction, and mentor other engineers.

Requirements

• A Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field, or equivalent experience.
• At least 4 years of experience developing and deploying machine learning or AI systems in production.
• Strong Python skills and experience with Java, Kotlin, TypeScript, or another production language.
• Experience with SQL and large-scale data processing technologies such as Spark.
• Experience building, evaluating, deploying, and scaling models with large datasets.
• Experience designing evaluation strategies, analyzing model quality, and using results to guide improvements.
• Familiarity with cloud-based ML and data platforms such as AWS or Databricks.
• Ability to independently solve ambiguous problems and deliver practical, production-quality solutions.
• Strong communication and collaboration skills.
• An agile mindset and commitment to continuous improvement.

Nice to Have

• Experience building AI-native products, RAG systems, conversational assistants, or tool-using agents.
• Experience with evaluation-driven development, benchmarks, regression testing, human evaluation, or LLM-as-a-judge.
• Experience evaluating agent planning, tool use, task completion, or multi-step reasoning.
• Experience with search relevance, ranking, recommendations, personalization, embeddings, or NLP.
• Experience fine-tuning, post-training, evaluating, or optimizing large language models.
• Experience with ML platforms, model serving, data pipelines, observability, or responsible AI.
• Experience mentoring engineers or influencing technical direction within a team.

We Offer

• Competitive base pay ranging from $171,063 - $269,075 per year, depending on the geographic pay zone.
• A wide range of perks and benefits designed to support you, your family, and to help you engage with your local community.
• Flexible work arrangements, including the option to work remotely, in an office, or a combination of both.
• Health and wellbeing resources, paid volunteer days, and more.

About the Company

At Atlassian, we're motivated by a common goal: to unleash the potential of every team. Our software products help teams all over the planet and our solutions are designed for all types of work. Team collaboration through our tools makes what may be impossible alone, possible together.

We believe that the unique contributions of all Atlassians create our success. To ensure that our products and culture continue to incorporate everyone's perspectives and experience, we never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines.

To provide you the best experience, we can support with accommodations or adjustments at any stage of the recruitment process. Simply inform our Recruitment team during your conversation with them.

To learn more about our culture and hiring process, visit go.atlassian.com/crh.

In line with local law, identity verification (which may include use of biometric data) is a condition of employment with Atlassian for employment fraud purposes.