Quality Architect

About the Position

We're seeking a Quality Architect with 12-15 years of IT experience to design and implement test automation frameworks for AI/ML systems.

Responsibilities

• Design large-scale solutions with in-depth technical detail
• Collaborate closely with business stakeholders to determine project requirements
• Design TA solutions that are maintainable, extensible, modular, and aligned with industry best practices (SOLID, design patterns, etc.) for implementation by project or program teams
• Build and maintain TA frameworks, solutions, and shared formats usable across all company projects and programs
• Define and execute comprehensive test automation strategies, including roadmap, tools, framework, and approach
• Develop and maintain documentation covering automation processes, workflows, and configurations
• Assess and choose the most suitable test automation tools for various purposes
• Guide the definition, selection, and expansion of test automation architecture frameworks
• Track and report key quality metrics, including defect density, test coverage, and release cycle times across manual, automated, and performance testing
• Supervise manual and automated testing efforts to validate functional, integration, regression, and performance aspects
• Lead continuous improvement initiatives in test processes, tools, and techniques to support digital transformation
• Conduct architecture reviews and audits
• Determine project requirements and goals needed to achieve a "go-live" solution
• Participate hands-on in pre-sale activities such as proposals, RFPs, RFIs, and demos
• Maintain direct communication with customers throughout solution architecture design and implementation

Requirements

• 12 to 15 years of IT experience
• Knowledge of GenAI tools, testing AI/ML-based systems, using LLMs, MCPs, RAG, and evaluating Agents through DeepEval/Ragas
• Proficiency in at least one programming or scripting language, with preference for Java, C#.NET, or Python
• Familiarity with JavaScript and TypeScript
• Strong grasp of industry trends and best practices
• Proactive mindset and leadership skills in architecture engagement

Skills

• Quality Architecture
• Test Automation Framework Architecture
• Clean Code
• Design patterns & guidelines
• GenAI Applications Testing
• Retrieval-Augmented Generation (RAG)
• Large Language Models (LLM)
• Test Automation Engineer in AI/ML testing
• Presales

We Offer

• Opportunity to work on technical challenges that may impact across geographies
• Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications
• Opportunity to share your ideas on international platforms
• Sponsored Tech Talks & Hackathons
• Unlimited access to LinkedIn learning solutions
• Possibility to relocate to any EPAM office for short and long-term projects
• Focused individual development
• Benefit package:
  • Health benefits
  • Retirement benefits
  • Paid time off
  • Flexible benefits
• Forums to explore beyond work passion (CSR, photography, painting, sports, etc.)

About the Company

[Company description if present]