LLMOps Engineer

About the Position

We are seeking a Senior LLMOps Engineer with 4+ years of experience in cloud-based software/data/ML engineering to join our global SaaS technology provider.

Responsibilities

• Design and maintain ingestion, chunking, embedding, and indexing pipelines for LLM training and RAG datasets using LangChain or equivalent frameworks.
• Manage the lifecycle of prompt templates, embedding models, LLM chains, and evaluators; support benchmarking of foundation models and retrieval strategies.
• Build and operate AI infrastructure (Azure AI Foundry, Azure OpenAI, Azure App Services) including secure hosting for RAG apps, vector databases, and agent runtimes.
• Define CI/CD pipelines for LLM artefacts (datasets, prompts, model configs, eval suites) via Azure DevOps, in collaboration with DevOps engineers.
• Establish observability for LLM systems (telemetry, latency, cost, hallucination rates, retrieval quality) using LangSmith or equivalent; integrate automated evaluation and quality gates into CI/CD.
• Apply responsible AI, privacy, access control, and logging standards; support red-team testing for prompt injection and model risks.
• Partner with AI developers, Portfolio Architects, and Product Owners to integrate LLM/RAG components into product features and shape the technical roadmap.
• Stay current on LLMOps, RAG optimization, and vector search trends; help establish early LLMOps best practices as the organization scales.

Requirements

• 4+ years in software/data/ML engineering or DevOps, preferably cloud-based.
• Strong Python; hands-on with LangChain, Semantic Kernel, or equivalent AI frameworks.
• Experience operating Azure AI Foundry, Azure OpenAI, Azure App Services, Azure Storage.
• Familiarity with vector databases and retrieval pipelines (Azure AI Search, Pinecone, Chroma, Redis Vector).
• Strong CI/CD, version control, and environment management skills (Azure DevOps preferred).
• Experience with Kubernetes (AKS) and containerized deployments.
• Experience with observability tooling (Azure Monitor, logging, tracing, metrics).
• Bachelor’s in CS/Software/Data Engineering or equivalent experience; strong problem-solving and cross-team communication skills.

Nice to Have

• Front-end/service development skills (React, TypeScript, C#).

We Offer

• Opportunity to work with a global SaaS technology provider specializing in governance, compliance, entity management, and operational software for financial services organizations.
• Remote work from Romania.
• Competitive salary and benefits.

About the Company

EDUROM Recruitment is a specialized Tech Recruitment Agency, successfully matching Romanian IT professionals with clients across Europe and the USA since 2008. Part of the Edurom Group, which assists organizations in achieving outstanding results through Human Resources and Management Consulting services.