Software Engineer - AI Agentic Compute

About the Position

We are looking for curious and motivated engineers to join us in building the compute platform for AI at scale!

Job Description

Agentic AI is changing what CPU performance means in the cloud. As AI systems evolve from individual model calls towards complex, distributed workflows, performance increasingly depends on efficiently orchestrating models, data, tools, and services across the whole system.

You will join a diverse, dedicated, and inclusive group based in Arm's vibrant office at the heart of Manchester. Your work will help ensure the latest developments in AI take full advantage of Arm Neoverse platforms and pioneering cloud-server technologies like AGI-CPU, our CPU for next-generation AI data centers. Together with teams from across Arm, the open-source community, and our partners, you will be accelerating AI and helping build the future of computing on Arm.

We work on the full stack, from applications and frameworks to compilers, libraries, and assembly; we encourage everyone in the team to get involved in all parts. The team has a wide remit, but we are all aligned on a common goal. We trust and empower engineers with the autonomy to identify and solve problems without silos and with the support of their teammates.

Responsibilities

• Design and develop scalable backend services
• Write clean, maintainable code
• Collaborate with frontend team

Requirements

• Strong software engineering and programming skills, preferably C++ and Python
• Eager to dive into unfamiliar software stacks and codebases, debug complex issues, and identify performance opportunities
• Familiarity with Linux development environments, profiling, debugging, and performance analysis
• A degree in a computational or numerate subject, or equivalent experience

Nice to Have

• Experience with ML frameworks and LLM inference, such as PyTorch, vLLM, SGLang, llama.cpp, or similar
• Experience using heterogeneous CPU + accelerator systems
• Familiarity with agentic AI frameworks and protocols
• An interest in understanding end-to-end application and system performance, from higher-level applications through runtimes and libraries to the underlying hardware
• Understanding of CPU bottlenecks in agentic workloads
• Understanding of databases, vector search, and retrieval systems
• Familiarity with containers and cloud/server infrastructure
• Understanding of parallel programming, collective communications, or distributed AI workloads
• Experience engaging with the open-source community
• Familiarity with SIMD technologies, such as Neon™, SVE, and SME

We Offer

• Competitive salary: £55,300 - £74,800 per year
• Generous stock awards
• Progressive leave policy including generous parental leave, days of care, and 4 weeks of sabbatical every 4 years
• Flexible working hours and hybrid working options
• An open and accepting environment where you are encouraged to share your ideas and opinions

About the Company

At Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible. Our 10x mindset is about curiosity, ambition, and creating impact that will be used by millions. We learn fast, prioritize collaboration, and turn bold ideas into real technology. We look for people who are inspired by this way of working and want to grow in an environment where bold ideas are welcomed. Discover how the 10x mindset shapes life at Arm: 10x Mindset

Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.