Senior ML Operations Engineer

About the Position

We are looking for a Senior ML Operations Engineer to join SPD Technology, a global software product development company that creates cutting-edge tech solutions driving clients’ growth. In this role, you will support teams building and deploying AI-driven solutions, helping them overcome common challenges in the ML development, deployment, and support lifecycle.

About Us

At SPD Technology, we bring together a team of like-minded people who are driven by the desire to bring value through their work, united in their commitment to high performance and delivering custom, cutting-edge tech solutions that drive clients’ growth. We empower our people with a culture of excellence and enable them with the opportunity to uphold their accountability to contribute on each level. We value humanity and collaboration, encourage professional and personal growth, and foster a supportive and flexible work environment where everyone’s contribution is welcomed.

About the Role

As a Senior ML Operations Engineer, you will support teams building and deploying AI-driven solutions, helping them overcome common challenges in the ML development, deployment, and support lifecycle. This role offers autonomy in decision-making, encouraging a proactive approach to solving complex issues and finding optimal solutions for scalable systems.

Responsibilities

• Serve as a force multiplier for development teams by creating golden paths that remove roadblocks and improve ideation and innovation.
• Collaborate with other engineers, product managers, and internal stakeholders in an Agile environment.
• Provide mentorship, technical guidance, and perform code reviews for team members.
• Design and deliver on projects end-to-end with little to no guidance.
• Provide support to teams building and deploying AI applications by addressing common pain points in the ML lifecycle.
• Learn constantly and be passionate about discovering new tools, technologies, libraries, and frameworks (commercial and open source), that can be leveraged to improve PitchBook’s AI capabilities.
• Support the vision and values of the company through role modeling and encouraging desired behaviors.
• Participate in various cross-functional company initiatives and projects as requested.
• Contribute to strategic planning in a way that ensures the team is building exceptional products that bring real business value.
• Evaluate frameworks, vendors, and tools that can be used to optimize processes and costs with minimal guidance.

Requirements

• Degree in Computer Science, Information Systems, Machine Learning, or a similar field preferred (or equivalent practical experience).
• 5+ years of hands-on software development experience with Python (Java experience with strong Python proficiency also considered).
• 4+ years of experience designing and building distributed software systems and architectures.
• 3+ years of hands-on experience deploying and operating Machine Learning services in production.
• Experience supporting ML lifecycle operations including post-deployment monitoring and maintenance.
• Experience in cloud-native stack, with a practical understanding of containerization technologies such as Kubernetes and Docker.
• Demonstrated experience with SQL and NoSQL database design and implementation.
• Ability to decompose complex problems into iterative, well-defined solutions.
• Strong problem-solving abilities with a focus on building scalable, efficient, and maintainable systems.
• Strong communication and collaboration skills, with the ability to engage effectively with internal customers across various cultures and regions.
• Ability to be a team player who can also work independently.
• Experience working across multiple development teams is a plus.

Nice to Have

• Experience with cloud platforms (AWS, Google Cloud Platform, or Azure).
• Proficiency in GitOps practices and CI/CD pipeline development and management.
• Observability and monitoring: Integration experience with observability tools (Prometheus, Grafana) and building instrumented, production-ready systems.
• LLM Infrastructure: Experience provisioning and managing Large Language Models through managed services (Azure OpenAI, Google Vertex AI, Amazon Bedrock).
• LLM Tooling: Hands-on experience with LLM gateways (LiteLLM) and agentic frameworks (LangGraph, LangSmith, or similar).
• Vector Systems: Practical experience with vector embedding models and vector databases (Pinecone, Weaviate, Milvus, pgvector).
• RAG Systems: Experience building Retrieval-Augmented Generation systems and evaluating both retrieval quality and generation performance.
• Cloud-native experience with services like Amazon SageMaker, Google Vertex AI, or Azure ML.
• Familiarity with ML frameworks and tools: PyTorch, TensorFlow, scikit-learn.
• Experience with data infrastructure: Redis, Elasticsearch, Apache Kafka.
• ML experiment tracking and model management: Weights & Biases, MLflow, KubeFlow.
• API development with FastAPI or similar frameworks.
• Java programming experience is a plus.

We Offer

• Join the team of experts who create custom, cutting-edge tech solutions for world-renowned businesses, fueling client growth.
• Experience an agile and flexible working environment with fully remote work and a flexible working schedule.
• Embrace the opportunity for personal and professional growth with performance and merit reviews, elevate your skills with personal development plans, and individual learnings through the corporate library, public speaking support, and more.
• Be among like-minded people who care about what they do and how they do it. Collaborate with top-notch experts who are always ready to help and support you through any challenges. Join company-wide tech and cultural events, and contribute to meaningful CSR initiatives that resonate with your values.

Interview Steps

1. Pre-Screening with the recruiter
2. Tech Interview (ML Fundamentals, Software Engineering) + Live Coding (up to 1.5 hours)
3. ML System Design Interview (up to 60 min)
4. Interview with Engineering Manager (60 min)
5. Final Client Interview (60 min)

Apply Now

Kateryna Leonova

Middle Talent Acquisition Specialist