Senior AI Engineer

About the Position

Join EPAM Malaysia as a Senior AI Engineer and lead the charge in creating cutting-edge AI solutions that solve complex, real-world problems. You’ll design and deploy scalable ML pipelines using ML frameworks and data platforms while harnessing the power of cloud platforms. Collaborate with cross-functional teams to transform business challenges into innovative data-driven solutions, leveraging your expertise in Python, SQL, and MLOps frameworks.

Responsibilities

• Design and implement end-to-end AI systems including inference pipelines, agent workflows, and tool-calling architectures
• Build and manage context orchestration for LLMs, covering system prompts, memory, retrieval, and structured inputs
• Engineer latency-aware and cost-efficient fallback strategies across models and providers
• Develop backend services for prompt routing, response handling, and tool execution using Python or Node.js
• Implement observability for AI systems including logging, metrics, tracing, and quality monitoring
• Maintain CI/CD pipelines for safe, repeatable deployments of AI services
• Integrate and deploy AI-powered software solutions into scalable enterprise environments, translating business requirements into robust system designs
• Collaborate with cross-functional teams, ensure compliance with data protection and AI governance, and document architectures and implementation decisions

Requirements

• Solid software engineering experience with hands-on work with AI/ML or LLM systems, and a Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field
• Proficient in Python, with experience in SQL or NoSQL databases, REST APIs, and backend integration
• Demonstrated expertise in LLM-based solution development, prompt engineering, NLP, semantic models, and agent-style architectures
• Skilled in fine-tuning and evaluating LLMs, building automated AI pipelines for training, testing, deployment, and monitoring
• Experience with the Spark or Apache ecosystem, scalable data and AI architectures, and cloud computing platforms
• Proficient in containerization technologies such as Docker and Kubernetes with experience in GPU orchestration and cost optimization
• Familiarity with CI/CD pipelines, DevOps tooling, and enterprise-scale architectures
• Strong analytical thinker and communicator, results-driven, customer-focused, and actively following new AI advancements and industry best practices

Nice to Have

• Experience integrating with LLM APIs from providers like OpenAI, Claude, or comparable platforms
• Direct involvement in building or maintaining Retrieval-Augmented Generation (RAG) systems, including work with vector databases and embedding pipelines
• Familiarity with model safety measures, implementation of AI guardrails, or responsible AI best practices

We Offer

By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021, 2022, and 2023. Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters. You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices. We offer a transparent career path and an individual roadmap to engineer your future and accelerate your journey. At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us.