Job Description, Responsibilities & Requirements
About the Position
EPAM seeks a talented Senior Prompt Engineer to join our team and collaborate with a client in the insurance sector, offering a flexible hybrid work arrangement.
As a Prompt Engineer, you will play a key role in advancing Generative AI adoption within the organization. This involves designing, developing and optimizing prompts for large language models (LLMs), building AI-powered solutions and scaling Generative AI operations across business domains. You will work with cross-functional teams to turn innovative ideas into practical and scalable AI products.
Responsibilities
- Design prompt logic and orchestration flows for GenAI use cases such as chatbot, CMD and DN creation
- Apply RAG (Retrieval-Augmented Generation) and Agentic AI principles to production scenarios
- Support AI Governance activities including documentation, validation and Responsible AI compliance
- Collaborate with cross-functional teams to create scalable and efficient GenAI solutions
Requirements
- 5+ years of experience as a Data Scientist
- Expertise in prompt engineering and LLM orchestration
- Understanding of RAG architecture and agent-based GenAI systems
- Familiarity with AI governance frameworks, validation techniques and responsible AI principles
- Proficiency in Python, LLM APIs such as OpenAI and Azure OpenAI and orchestration tools like LangChain and Semantic Kernel
- Fluency in English
Nice to Have
- Knowledge of Azure AI services such as Azure Cognitive Search, Azure ML and Azure OpenAI
- Familiarity with DevOps pipelines and API integration
- Background in large-scale enterprise environments and agile delivery