Senior Software Engineer - Agentic AI Compute
Primary stack
Nice to have's
Job description
About the Position
We are looking for enthusiastic and motivated engineers who want to be part of a team building the compute platform for AI at scale!
Agentic AI is changing what CPU performance means in the cloud. As AI systems evolve from individual model calls towards complex, distributed workflows, performance increasingly depends on efficiently orchestrating models, data, tools, and services across the whole system.
You will join a diverse, dedicated, and inclusive group based in Arm's vibrant office at the heart of Manchester. Your work will help ensure the latest developments in AI take full advantage of Arm Neoverse platforms and pioneering cloud-server technologies like AGI-CPU, our CPU for next-generation AI data centers. Together with teams from across Arm, the open-source community, and our partners, you will be accelerating AI and helping build the future of computing on Arm.
We work on the full stack, from applications and frameworks to compilers, libraries, and assembly; we encourage everyone in the team to get involved in all parts. The team has a wide remit, but we are all aligned on a common goal. We trust and empower engineers with the autonomy to identify and solve problems without silos and with the support of their teammates.
Responsibilities
- Design and develop scalable backend services
- Write clean, maintainable code
- Collaborate with frontend team
- Debug complex issues and identify performance opportunities
- Understand end-to-end application and system performance
Requirements
- Strong software engineering and programming skills, preferably C++ and Python
- Eager to dive into unfamiliar software stacks and codebases
- Familiarity with Linux development environments, profiling, debugging, and performance analysis
- An interest in understanding end-to-end application and system performance, from higher-level applications through runtimes and libraries to the underlying hardware
- A degree in a computational or numerate subject, or equivalent experience
Nice to Have
- Experience with ML frameworks and LLM inference, such as PyTorch, vLLM, SGLang, llama.cpp, or similar
- Experience analyzing and optimizing CPU performance in heterogeneous CPU + accelerator systems
- Familiarity with agentic AI frameworks and protocols
- Understanding of CPU bottlenecks in agentic workloads
- Understanding of databases, vector search, and retrieval systems
- Familiarity with containers and cloud/server infrastructure
- Familiarity with batching, scheduling, KV-cache management, collective communications, and distributed AI workloads
- Understanding of parallel programming
- Comfortable working across abstractions in the stack, from low-level optimization to high-level operators
- Experience engaging with the open-source community and contributing to large open-source software projects
- Experience optimizing software for AArch64/Arm servers, including SIMD technologies such as Neon™, SVE, and SME
We Offer
- Attractive reward package with generous stock awards
- Progressive leave policy including generous parental leave, days of care, and 4 weeks of sabbatical every 4 years
- Flexible working hours and hybrid working options
- Open and accepting environment encouraging idea sharing and collective innovation
- Support for professional and personal growth
About the Company
At Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible. Our 10x mindset is about curiosity, ambition, and creating impact that will be used by millions. We learn fast, prioritize collaboration, and turn bold ideas into real technology. We look for people who are inspired by this way of working and want to grow in an environment where bold ideas are welcomed. Discover how the 10x mindset shapes life at Arm: https://careers.arm.com/10x-mindset
Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Salary Range
£73,500 - £99,500 per year
Apply
View Location
Our Hiring Process
Power the Future on Arm
Working in software engineering at Arm is about shaping a future of technology for which we don't yet have words. Our engineers lead innovation in physical IP, AI and machine learning, cloud architecture, automotive tech, and every aspect of computing that matters.
Spanning software's full spectrum, from compilers to AI-powered IoT and beyond, your code can enable virtually anything to be produced on silicon. Whether you're developing award-winning VR gaming or life-enhancing medical equipment, you can improve the lives of millions by being your brilliant self at Arm.
Drive Change on Arm
At Arm, you'll influence 100% of the world's connected devices and all their applications. From healthcare and infrastructure to virtual reality, you'll affect nearly all industries worldwide, racing toward new milestones and achievements together.
Revolutionary Benefits
Health and Wellness
We create a safe space for you to nurture both your physical and mental wellbeing.
Work and Life Success
We empower people to experience life beyond the boundaries of standard work patterns.
Financial Rewards
We provide benefits beyond a competitive salary to reward our people for their dedication and contributions.
Development and Support
We foster professional and personal development, building a supportive community where everyone can thrive.
See all Rewards and Benefits
Life at Arm
Life in the office doesn’t get any better, especially when those offices are as sleek as ours and the people in them are innovative and supportive. Combine that with our focus on delivering as One Arm, and you’ll experience the kind of collaboration and togetherness that’s rare to find elsewhere. We share so much in common, not least a passion for progress, but we also celebrate each other's diversity.
Discover Life at Arm
Our Stories
Join our Talent Community, Unlock Opportunities
Subscribe to receive Arm communications directly to your inbox. Stay connected to be the first to hear about updates from our community and exciting roles that align with your skills.
Share this job:
Get Job Alerts
Can’t find the job you’re seeking? Register to be notified as soon as new jobs become available. Enter your email, select your preferred job category and/or location, then click Add to set your preferences and Subscribe to create your job alert.
Select a job category and/or location from the lists of options. Then click “Add” to create your job alert.
Job Category
Location
- Software Engineering, Manchester, England, United Kingdom
By submitting your information, you acknowledge that you have read our privacy policy, and consent to receive email communication from Arm.
© Arm Germany. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.