Staff Software Engineer - Agentic AI Compute

About the Position

We are looking for experienced and motivated engineers who are up for a new challenge to be part of a team building the compute platform for AI at scale!

Agentic AI is changing what CPU performance means in the cloud. As AI systems evolve from individual model calls towards complex, distributed workflows, performance increasingly depends on efficiently orchestrating models, data, tools and services across the whole system.

You will join a diverse, dedicated and inclusive group based in Arm's vibrant office at the heart of Manchester. Your work will help ensure the latest developments in AI take full advantage of Arm Neoverse platforms and pioneering cloud-server technologies like AGI-CPU, our CPU for next-generation AI data centers. Together with teams from across Arm, the open source community, and our partners, you will be accelerating AI and helping build the future of computing on Arm.

We work on the full stack, from applications and frameworks, to compilers, libraries, and assembly; we encourage everyone in the team to get involved in all parts. The team has a wide remit, but we are all aligned on a common goal. We trust and empower engineers with the autonomy to identify and solve problems without silos and with the support of their team mates.

Responsibilities

• Design and develop scalable backend services
• Write clean, maintainable code
• Collaborate with frontend team
• Debug complex issues and identify performance opportunities
• Understand end-to-end application and system performance
• Be responsible for the delivery of sophisticated technical work involving multiple contributors

Requirements

• Excellent software engineering and programming skills, preferably C++ and Python
• Eager to dive into unfamiliar software stacks and codebases
• Familiarity with Linux development environments, profiling, debugging and performance analysis
• An interest in understanding end-to-end application and system performance, from higher-level applications through runtimes and libraries to the underlying hardware
• Experience being responsible for the delivery of sophisticated technical work involving multiple contributors
• A degree in a computational or numerate subject, or equivalent experience

Nice to Have

• Experience with ML frameworks and LLM inference, such as PyTorch, vLLM, SGLang, llama.cpp or similar
• Experience analysing and optimizing CPU performance in heterogeneous CPU + accelerator systems
• Familiarity with agentic AI frameworks and protocols
• Understanding of CPU bottlenecks in agentic workloads
• Understanding of databases, vector search and retrieval systems
• Familiarity with containers and cloud/server infrastructure
• Familiarity with batching, scheduling, KV-cache management, collective communications and distributed AI workloads
• Practical understanding of parallel programming
• Comfortable working across abstractions in the stack, from low-level optimisation to high level operators
• Experience engaging with the open-source community and contributing to large open-source software projects
• Experience optimizing software for AArch64/Arm servers, including SIMD technologies such as Neon™, SVE and SME

Interpersonal Strengths

• Strong and clear communication skills
• Able to work independently, make pragmatic decisions and navigate ambiguity and change
• People management or mentoring experience - wellbeing, performance review, supporting career development and coaching

We Offer

You will receive an attractive reward package with generous stock awards. We also know that people do their best work when they feel rested and psychologically safe, so we have a progressive leave policy including generous parental leave, days of care and 4 weeks of sabbatical every 4 years. We are flexible on working hours, and allow hybrid working. We strive to provide an open and accepting environment where you are encouraged to share your ideas and opinions; which enables collective innovation and creativity, and supports your professional and personal growth.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Please note this role does not meet the eligibility requirements for sponsorship, and therefore the successful candidate must have the right to work in the UK without relying on sponsorship by Arm.

About the Company

Working in software engineering at Arm is about shaping a future of technology for which we don't yet have words. Our engineers lead innovation in physical IP, AI and machine learning, cloud architecture, automotive tech, and every aspect of computing that matters.

Spanning software's full spectrum, from compilers to AI-powered IoT and beyond, your code can enable virtually anything to be produced on silicon. Whether you're developing award-winning VR gaming or life-enhancing medical equipment, you can improve the lives of millions by being your brilliant self at Arm.

At Arm, you'll influence 100% of the world's connected devices and all their applications. From healthcare and infrastructure to virtual reality, you'll affect nearly all industries worldwide, racing toward new milestones and achievements together.

Salary Range

£97,300 - £131,700 per year

Apply

Apply Now