AI Test Automation Lead

About the Position

As an AI Test Automation Lead, you will lead AI-powered Quality Engineering and test automation solutions, including developing testing strategies and frameworks, integrating testing into CI/CD pipelines, validating AI behavior and integrations, and promoting responsible AI practices across complex insurance and retirement systems.

Responsibilities

• Create and maintain test cases for prompt-driven applications, AI agents, RAG systems, and workflow orchestration platforms
• Design, build, and maintain automated test frameworks for AI applications and services
• Develop automated evaluation pipelines to assess AI responses, workflows, and model behavior
• Drive automation-first quality strategy and lead automation solutions across programs
• Design scalable automation architectures spanning UI, API, Mobile, and Database layers
• Develop and implement GenAI-powered solutions for automated test design, code generation, execution, and defect analysis
• Test AI agents, copilots, APIs, workflow engines, MCP integrations, and tool-calling capabilities
• Leverage AI and ML tools to enhance test coverage, improve efficiency, and reduce regression cycles
• Leverage GitHub Copilot and Claude to enable AI-assisted automation and enforce CI/CD quality gates
• Integrate automated AI and regression test suites into CI/CD pipelines to support continuous integration and rapid model updates
• Collaborate with cross-functional teams and mentor engineers on GenAI, Agentic AI, automation, model deployment, and AI safety best practices

Work Model

We believe hybrid work is the way forward as we strive to provide flexibility wherever possible. Based on this role’s business requirements, this is a hybrid position requiring 3 days a week in a client or Cognizant office in Toronto or Kitchener location. Regardless of your working arrangement, we are here to support a healthy work-life balance through our various wellbeing programs.

Key Skills

• Test Automation Architecture
• GenAI & LLMs
• GitHub Copilot
• CI/CD & DevOps
• Quality Analytics
• Strong communication, presentation skills
• Stakeholder Management

Requirements

• 10+ years of Quality Engineering experience covering functional, API, integration, and automation testing with a dedicated focus on AI testing and validation
• 3+ years in AI/ML systems testing; expert proficiency in AI/ML testing frameworks, MLOps, CI/CD integration, and programming (Python, Java)
• Hands-on GitHub Copilot and Claude experience to enable AI-assisted automation and enforce CI/CD quality gates
• Hands-on experience with AI platforms and prompt engineering
• Ability to work independently, have the capability to lead a team and engage with senior business and technology stakeholders

Nice to Have

• Exposure to Life Insurance, Retirement domain

We Offer

• Competitive salary ranging between CAD 90,000 – 117,000 per year
• Cognizant’s discretionary annual performance-based bonus
• Benefits that support your physical, mental, and financial wellbeing

About the Company

Cognizant(NASDAQ: CTSH) is a leading AI and technology services company that bridges the gap between AI investment and enterprise value by creating end-to-end AI solutions for our clients. Our deep industry, process, and engineering expertise helps us fuse the context of the enterprise with technology to augment human potential, drive tangible results, and help global enterprises stay ahead in a changing world. Learn more at cognizant.ai or @cognizant.

Additional Information

• Candidates may be required to attend in-person or video interviews
• Candidates may be asked to present government-issued identification during each interview
• Cognizant is an equal opportunity employer. Employment decisions are based solely on merit and business needs. Learn more about our benefits and career growth opportunities at Cognizant Careers.

---

Apply now and be part of our innovative team!