Principal Software Engineer, AI Frameworks
Primary stack
Job description
About the Position
Principal Software Engineer, AI Frameworks
Senior • Remote
USD $220,800 - $331,200/yr
Description
We are seeking a Principal Software Engineer, AI Frameworks to lead the technical vision and architecture for AI frameworks and the serving stack for frontier OpenAI models at Microsoft. This role involves performance, benchmarking, and developer-productivity capabilities at cloud scale. You will drive cross-team execution and hands-on implementation of optimizations for NVIDIA and AMD GPUs and Microsoft silicon to improve model velocity, reliability, and hardware utilization. You will also build measurement, automation, observability, and reusable platform mechanisms that turn one-off analyses into durable capabilities.
Responsibilities
- Own the technical vision, architecture, roadmap, and multi-release execution strategy for critical AI framework and performance/benchmarking or developer-productivity capabilities.
- Lead technical alignment across teams by shaping architecture and priorities, resolving competing requirements, and ensuring clear decisions and measurable outcomes.
- Mentor engineers and build technical leadership capacity through high standards for quality and maintainability and an inclusive engineering culture.
- Steer ambiguous, cross-stack investigations spanning models, frameworks, compilers, runtimes, systems, services, and silicon; set priorities and resolve trade-offs.
- Provide hands-on technical leadership via prototypes, critical-path implementation, design/code reviews, complex debugging, and operational readiness.
- Establish common measurement, automation, observability, and engineering mechanisms to scale platform capabilities.
- Drive measurable improvements in model onboarding velocity, runtime performance, reliability, hardware utilization, and Azure capacity efficiency.
Requirements
- Bachelor’s Degree in Computer Science or a related technical field and 8+ years of technical engineering experience coding in languages such as C++ or Python (or equivalent experience).
- Ability to meet Microsoft security screening requirements, including the Microsoft Cloud Background Check, and pass it upon hire/transfer and every two years thereafter.
- Demonstrated experience serving as a technical lead for complex cross-team initiatives (strategy, architectural decisions, stakeholder alignment, end-to-end execution to production).
- Robust/extensive experience designing and shipping complex, high-performance or distributed software systems.
- Deep foundation in software architecture, computer architecture, and accelerator-aware optimization.
- Advanced experience with LLM inference frameworks or AI accelerator kernel optimizations.
- Proven track record of creating reusable platforms and scaling engineering practices across teams.
We Offer
- Competitive base pay range for the U.S.: USD $165,600–$296,400 per year (with different ranges for specific locations such as San Francisco Bay area and New York City metro).
- Eligibility for benefits and other compensation.
- Minimum posting duration of 5 days; applications accepted on an ongoing basis until the position is filled.
About the Company
At Microsoft, we are committed to innovation and excellence in technology. Our mission is to empower every person and every organization on the planet to achieve more. Join our team and help us shape the future of AI and cloud computing.
© MindPal. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
Recruitment & HR Tech,AI & Automation,Fintech,E-learning,Healthcare,E-commerce
About the Company MindPal is a project initiated by Sky Gate Company, designed to address challenges in IT recruitment by connecting companies with candidates through a unique platform. The company focuses on delivering talent, technology, and traction to clients, having successfully partnered with over 250 businesses globally. MindPal specializes in AI-driven digital transformation, offering scalable solutions for startups and enterprises across various industries. Products, Services & Tech Stack Core Solutions AI Agents & Assistants: Intelligent AI agents that automate tasks, manage workflows, and provide real-time support. MVP Development: Transforming business ideas into working products for quick testing and validation. AI Consulting: Expert guidance on AI strategy and implementation. Chatbots: Custom conversational bots for user engagement and support. SaaS Solutions: Scalable cloud-based products tailored to business needs. AI Automation: Tools for optimizing workflows and increasing operational efficiency. Technologies & Frameworks Ruby on Rails React TypeScript Docker Heroku Django Angular Python VOIP Jenkins Project Scope & Target Clients Client Base Verticals: Fintech, e-learning, healthcare, e-commerce. Client Types: Startups and established Fortune 500 corporations. Engineering Scale Scope: Full-stack digital product consulting and partnership. Complexity: Projects range from MVP development to full-scale SaaS solutions.