Staff / Principal Machine Learning Engineer, Serving - Switzerland

About the Position

Staff / Principal Machine Learning Engineer, Serving - Switzerland

Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads. Join our team in Switzerland to contribute to our mission of powering experiences for hundreds of millions of users daily.

Responsibilities

• Design and develop scalable backend services
• Optimize inference frameworks and techniques
• Implement model acceleration strategies
• Develop high-performance systems using C++, CUDA, Rust, or highly optimized Python
• Manage distributed systems and scaling solutions
• Collaborate with research and production teams to ensure models run reliably

Requirements

• Inference Optimization: Deep understanding of modern serving frameworks and techniques like vLLM or TRT-LLM.
• Model Acceleration: Hands-on experience with quantization, distillation, caching strategies, continuous batching, paged attention, and speculative decoding.
• High-Performance Systems: Proficiency in C++, CUDA, Rust, or highly optimized Python. Ability to profile code and optimize performance on NVIDIA GPUs.
• Distributed Systems & Scaling: Experience with Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference, and handling thousands of concurrent connections.
• Public work: Non-trivial systems programming projects, open-source contributions to major inference engines, or deep-dive technical write-ups.
• Full-cycle ownership: Ability to take a model from research to production, containerize it, optimize its serving, and ensure reliable operation.
• Background: PhD in CS, Physics, Math, or equivalent practical experience building backend or ML systems.
• Professional fluency in English: Required for daily collaboration with US-based leadership and engineering teams.

Who Thrives Here

• Comfortable with ambiguity and building your own roadmap
• Bias for impact over theoretical optimizations
• Obsessed with understanding the "why" behind every decision
• Thrives on deep context and fundamental logic

We Offer

• Remote work within Switzerland
• Full-time, permanent employment
• Employment via Employer of Record (EOR)
• Potential U.S. visa and relocation support for future relocation to the San Francisco Bay Area

About the Company

Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. Our models and infrastructure support consumer applications across various sectors, including companions, healthcare, fitness, education, media, and more. We've raised more than $125M from top-tier investors and have been recognized by CB Insights and LinkedIn.

Apply Now

If you are passionate about realtime AI and ready to make a significant impact, apply now to join our innovative team in Switzerland.