Lead Azure DevOps Engineer

About the Position

We are seeking a Lead Azure DevOps Engineer to drive the deployment, integration, and operation of AI/LLM gateway technologies within enterprise environments, ensuring secure, scalable, and resilient production systems.

Responsibilities

• Deploy and manage AI/LLM gateway technologies such as LiteLLM, Citadel, or Azure APIM AI Gateway
• Integrate models and providers into gateway solutions to support enterprise-scale operations
• Configure routing, policy enforcement, and token/rate controls across gateway infrastructure
• Establish observability and resilience mechanisms to maintain production stability
• Implement LLM routing and broker logic to optimize model performance and reliability
• Enforce enterprise policies, including PII detection and redaction, to ensure compliance and security
• Take ownership of gateway implementation projects and deliver functional solutions rapidly
• Collaborate with cross-functional teams to align gateway operations with organizational security standards
• Monitor and troubleshoot production systems to ensure continuous availability

Requirements

• 5+ years of hands-on engineering experience with AI/LLM gateway technologies, including deployment, integration, and production operations
• Expertise in Azure API Management, Azure DevOps, and Azure AI Content Safety
• Proficiency in LiteLLM and other LLM gateway platforms
• Knowledge of LLM security, PII detection and redaction, and enterprise policy enforcement
• Understanding of LLM routing, broker logic, and token/rate control mechanisms
• Skills in observability, resilience engineering, and production system operations
• Capability to take ownership and deliver functional gateway implementations rapidly
• English proficiency at B2 level or higher

What We Offer

• Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
• Opportunity to work abroad for up to two months per year
• Relocation opportunities within our offices in 55+ countries
• Corporate and social events
• Leadership development, career advising, soft skills, and well-being programs
• Certifications, including GCP, Azure, and AWS
• Unlimited access to EPAM's internal learning database
• Free English classes with certified teachers
• Participation in the Employee Stock Purchase Plan
• Monetary bonuses for engaging in the referral program
• Comprehensive medical & family care package
• Trust days per year for personal needs
• Discounts for fitness clubs and sports programs
• Benefits package (sports activities, a variety of stores and services)

About the Company

We connect like-minded people, delivering innovative solutions to industry leaders and making a global impact.