Senior Product Manager - Inference Platform
Primary stack
Job description
About the Position
We are looking for a Senior Product Manager - Inference Platform to join our team at Nebius. This role is fully remote within the United States.
About Nebius
Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.
Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.
Responsibilities
- Own the roadmap and outcomes for a part of the inference platform, aligning several cross-functional engineering teams across advanced model optimization, inference performance, model delivery, reliability, and enterprise features.
- Work with engineering and research to make inference more scalable, reliable and cost-efficient, and turn that into capabilities customers can depend on.
- Stay close to customers through research, interviews and hands-on PoCs, especially in managed enterprise.
- Track the market: open-source models, inference economics, and how businesses actually apply AI. Turn what you see into product bets.
Requirements
- Experience shipping technical platform products, with the seniority to lead work across multiple engineering teams.
- Real technical depth in how AI inference works, including model serving, distributed systems and production infrastructure. You think problems through yourself rather than relying on engineers to define them.
- Strong communication and expectations management across engineering, research, sales, support and leadership. You write crisp PRDs, RFCs and release notes.
- B2B/enterprise experience with technical buyers.
- Comfort with ambiguity and shifting scope
Nice to Have
- Post-training experience, including training draft models.
- Experience with third-party technical partnerships.
We Offer
- Health insurance: 100% company-paid medical, dental, and vision coverage for employees and families.
- 401(k) plan: Up to 4% company match with immediate vesting.
- Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers.
- Remote work reimbursement: Up to $85/month for mobile and internet.
- Disability & life insurance: Company-paid short-term, long-term and life insurance coverage.
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
Pay Transparency
We offer competitive compensation and benefits packages. Actual compensation will be determined based on job-related factors, including experience, skills, qualifications, the level at which the candidate is hired, and geographic location, consistent with applicable law.
Base Compensation Range
$228,000-$285,000 USD
About the Company
Fast moving - Bold thinking - Constant growth - Meaningful impact - Trust and real ownership - Opportunity to shape the future of AI
Equal Opportunity Statement
Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.
Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire.
If you need accommodations during the application process, please let us know.
© Nebius Germany. This job description was sourced from the employer's public career page. TheJob is not the employer — we index the posting and route candidates to the source. All content rights and hiring decisions belong to the employer.
More at Nebius Germany
All 673 rolesSystem Engineer (Compute Node)
Nebius Germany · Netherlands +1
Software Engineer in Hardware Infrastructure
Nebius Germany · Netherlands +1
Site Reliability Engineer in Hardware Infrastructure
Nebius Germany · Netherlands +1
Senior Technical Program Manager - New Data Center Launches
Nebius Germany · Netherlands +1