About the Position

Senior Staff Machine Learning Engineer - DevOps

Location: Santa Clara, United States

Work Persona: On-site (2 days per week in office)

Responsibilities

Lead the architecture, optimization, and operational excellence of our AI inference platform.
Own the end-to-end inference lifecycle-from onboarding cutting-edge models to deploying optimized inference engines in production across multiple backends on Kubernetes infrastructure.
Architect the intelligent gateway layer using Envoy and ext_proc to enforce access control, provide observability, and enable advanced request routing.

Requirements

Technical Expertise:
- Expertise in Go or Python, OOP, Design Patterns, time and space-efficient algorithms.
- Experience building new products that use challenging algorithms.
- Expertise in coding efficient, object-oriented, modularized, and quality software.
- Knowledge of core AI/ML techniques and algorithms.
- Knowledge of unit testing, profiling, and code tuning.
DevOps:
- Deploy, scale, and operate services in production Kubernetes environments, including Helm-based deployments and CI/CD pipelines.
- Own observability for what you build-meaningful metrics, useful logs, real tracing, and alerts that fire on customer impact rather than on noise.
- Debug and resolve production incidents independently, participate in on-call, run root-cause analysis, and operate against defined service level objectives.
AI Skills:
- Confident use of AI coding assistants such as GitHub Copilot or Cursor, paired with the critical eye to review AI-generated code.
- AI-assisted debugging and trace analysis, and a clear understanding of the data privacy rules governing what goes into a prompt.

Nice to Have

Experience with Envoy and ext_proc for intelligent gateway architecture.

We Offer

Compensation:
- Base pay of $201,300 - $352,300, plus equity (when applicable), variable/incentive compensation, and benefits.
Benefits:
- Health plans, including flexible spending accounts.
- 401(k) Plan with company match.
- ESPP, matching donations.
- Flexible time away plan and family leave programs.

About the Company

It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone-freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow-helping 85% of the Fortune 500® work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started.

Join us to put AI to work for people.

Equal Opportunity Employer

ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, age, disability, gender identity, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.

Accommodations

We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [email protected] for assistance.

Export Control Regulations

For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities.

Senior Staff Machine Learning Engineer - DevOps

Job description