Staff / Principal Machine Learning Engineer, Serving - USA
Job description
About the Position
Staff / Principal Machine Learning Engineer, Serving - USA
Join Inworld, a leading research lab in realtime voice models, based in Mountain View, California, USA. We are seeking a Staff / Principal Machine Learning Engineer to optimize our state-of-the-art realtime voice models and contribute to cutting-edge AI applications.
Responsibilities
- Optimize realtime voice models for performance and scalability.
- Develop and implement advanced inference techniques.
- Collaborate with cross-functional teams to deploy models in production.
- Contribute to research and development of state-of-the-art models.
Requirements
- Inference Optimization: Deep understanding of modern serving frameworks and techniques.
- Model Acceleration: Hands-on experience with quantization, distillation, caching strategies, continuous batching, paged attention, and speculative decoding.
- High-Performance Systems: Proficiency in C++, CUDA, Rust, or highly optimized Python.
- Distributed Systems & Scaling: Experience with Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference, and handling thousands of concurrent connections.
- Public work: Non-trivial systems programming projects, open-source contributions, or technical write-ups.
- Full-cycle ownership: Ability to take a model from research to production.
- Background: PhD in CS, Physics, Math, or equivalent practical experience in backend or ML systems.
We Offer
- Competitive base salary range: $270,000+
- Bonus
- Equity
- Comprehensive benefits
- Relocation assistance
- Flat structure, fast iterations, minimal process theater
About the Company
Inworld is a research lab of top researchers and engineers, building the world’s top-ranked realtime voice models. Our models power the largest consumer-facing AI applications across various categories, representing hundreds of millions of end users. We've raised over $125M from top-tier investors and have been recognized by CB Insights and LinkedIn.
We believe in the power of in-person collaboration to solve the hardest problems and foster a strong team culture. We offer relocation assistance and look forward to you joining us in our Mountain View office.
Apply Now
If you are passionate about AI and want to make a significant impact, apply now to join our innovative team at Inworld.
© Inworld AI. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
Inworld AI is a startup based in Silicon Valley and working on a developer platform for creating AI-powered virtual characters to populate immersive realities including the metaverse, VR/AR, games, and virtual worlds.Inworld AI is funded by top-tier investors including Kleiner Perkins, CRV, and Meta.Prior to Inworld AI, our team has pioneered the conversational AI technologies market, building innovative conversational AI products and platforms, includingAPI.AI(now known as Google Dialogflow), that are now being used by millions of developers.We are continuing to build out our incredibly talented team, with experts in generative language models, emotions, speech synthesis, multimodal interaction, design, and 3D animation.Press release:venturebeat.com/... riven-virtual-charactersJoin and help us build the future!
More at Inworld AI
All 15 rolesFounding AI Solutions Engineer- USA
Inworld AI · United States
Product Lead - USA
Inworld AI
Founding Growth Lead - USA
Inworld AI · United States
Senior / Lead Research Scientist - Serbia
Inworld AI · Serbia