Lead AI Platform Engineer

About the Position

We are seeking a Lead AI Platform Engineer to lead the design and evolution of a next-generation AI Gateway platform that enables secure, scalable and governed access to Large Language Models (LLMs) and agentic workflows across the enterprise in a SAAS environment. This role owns the end-to-end architecture covering MCP (Model Context Protocol), agents, multi-provider LLM integrations, authentication and authorization, semantic caching, rate limiting, guardrails and reusable frameworks for agent and tool development.

Responsibilities

• Develop the AI Gateway platform, including MCP, agents, LLM routing, governance and observability
• Translate business and product requirements into clear problem statements, architectural designs and scalable technical solutions
• Design extensible frameworks for MCP server capabilities and integrations as well as agent orchestration and reusable agent skills
• Architect gateway capabilities such as semantic caching for LLM responses, rate limiting, quotas and traffic governance and guardrails and validation layers for safe LLM/MCP usage
• Design and review authentication and authorization models, including multiple OIDC-based flows, identity propagation and token-based access control for MCP and LLM traffic
• Build prototypes and reference implementations to validate architectural decisions and guide engineering teams
• Partner with multiple product teams integrating with the AI Gateway, providing architecture guidance, best practices and integration patterns
• Review designs and code, providing actionable feedback to ensure quality, performance, scalability and security
• Define and review CI/CD best practices using modern GitHub-based pipelines
• Architect and review Kubernetes-based deployment models, ensuring scalability, resiliency and production readiness

Requirements

• 5+ years of software engineering experience
• Proven experience designing and delivering large-scale distributed systems or platform products
• Proficiency in Golang and Python
• Familiarity with AI-centric development with a strong emphasis on quality gates and architecture patterns to enforce agentic behavior in producing quality code
• Deep understanding of AI gateways, AI/LLM platforms or middleware systems, including routing, governance and scalability
• Experience with microservices and service-oriented architectures for multi-tenant SAAS environments, PostgreSQL for transactional data and Redis for caching and distributed coordination
• Strong background in authentication and authorization systems, particularly OAuth-based approaches
• Demonstrated ability to independently drive problem definition, architecture, prototype and execution guidance
• Experience designing platforms and frameworks used by multiple product teams
• English proficiency at B2 level or higher

Nice to Have

• Experience with MCP (Model Context Protocol), agentic platforms or AI orchestration frameworks
• Knowledge or know-how in working with EDA software
• Prior work on LLM gateways, API gateways or AI middleware platforms
• Experience building generic developer frameworks or SDKs adopted across teams
• Familiarity with guardrails, semantic caching, prompt/response optimization and LLM cost control techniques

We Offer

• Remote work in Armenia
• Opportunity to work on cutting-edge AI technologies
• Collaborative and innovative work environment

About the Company

[Company description if present]