About the Position

AI Test Automation Lead

We are seeking an experienced AI Test Automation Lead to join our team in Toronto, ON. In this role, you will lead AI-powered Quality Engineering and test automation solutions, including developing testing strategies and frameworks, integrating testing into CI/CD pipelines, validating AI behavior and integrations, and promoting responsible AI practices across complex insurance and retirement systems.

Responsibilities

Create and maintain test cases for prompt-driven applications, AI agents, RAG systems, and workflow orchestration platforms
Design, build, and maintain automated test frameworks for AI applications and services
Develop automated evaluation pipelines to assess AI responses, workflows, and model behavior
Drive automation-first quality strategy and lead automation solutions across programs
Design scalable automation architectures spanning UI, API, Mobile, and Database layers
Develop and implement GenAI-powered solutions for automated test design, code generation, execution, and defect analysis
Test AI agents, copilots, APIs, workflow engines, MCP integrations, and tool-calling capabilities
Leverage AI and ML tools to enhance test coverage, improve efficiency, and reduce regression cycles
Leverage GitHub Copilot and Claude to enable AI-assisted automation and enforce CI/CD quality gates
Integrate automated AI and regression test suites into CI/CD pipelines to support continuous integration and rapid model updates
Collaborate with cross-functional teams and mentor engineers on GenAI, Agentic AI, automation, model deployment, and AI safety best practices

Requirements

10+ years of Quality Engineering experience covering functional, API, integration, and automation testing with a dedicated focus on AI testing and validation
3+ years in AI/ML systems testing; expert proficiency in AI/ML testing frameworks, MLOps, CI/CD integration, and programming (Python, Java)
Hands-on GitHub Copilot and Claude experience to enable AI-assisted automation and enforce CI/CD quality gates
Hands-on experience with AI platforms and prompt engineering
Ability to work independently, have the capability to lead a team and engage with senior business and technology stakeholders

Nice to Have

Exposure to Life Insurance, Retirement domain

We Offer

Competitive salary ranging between CAD 90,000 – 117,000 per year
Cognizant’s discretionary annual performance-based bonus
Comprehensive benefits supporting physical, mental, and financial wellbeing

About the Company

Cognizant

Cognizant (Nasdaq: CTSH) is an AI solutions creator and technology services provider that connects AI investment with business value by developing full-stack AI solutions for clients. Their deep industry knowledge, coupled with process and engineering expertise, enables them to incorporate the unique context of each organization into technology systems that amplify human potential, drive tangible results, and keep businesses at the forefront in an ever-changing environment. Learn more at cognizant.ai or @cognizant.

Employment Information

The compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time in accordance with applicable laws.

Applicants may be required to attend interviews in person or via video conferencing. During each interview, candidates may be required to present a valid government-issued identification document.

Cognizant is an equal opportunity employer. Your application and candidacy will not be evaluated based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, veteran status, or any other characteristic protected by federal, state, or local laws.

Benefits to Help You Thrive

Our benefits program is designed with you in mind, so you can enjoy a full, balanced, and healthy life.

Financial Well-being

We regularly assess market data to ensure compensation reflects the value you bring. Your benefits go beyond salary and can include retirement plans, financial education, and more.

Physical and Mental Health

We provide tools to prioritize your well-being through paid time off, flexible work options when possible, healthcare plans, counseling services, our Mental Health Allyship program, and much more.

Your Career, Your Way

With over 350,000 positions at Cognizant, you'll have opportunities to explore new technologies, industries, and locations, and develop the skills you need to grow your career.

Real-World Impact

Think of the biggest brands you trust. Chances are, they trust us to help power their business. Here, you'll turn bold ideas into solutions that improve lives everywhere.

Your Path to Cognizant

Here's what you can expect from our hiring process. Note that it may vary by role and location. Explore our FAQs for more information.

Step 1: Apply to the Right Opportunity

Find an open position that matches your skills and career goals and show us why you're the right fit for the job. Don't see the right opportunity? Consider joining our Talent Community.

Step 2: Connect with Your Recruiter

If one of our recruiters sees a match, they'll arrange a brief introductory call to learn more about you and how your experiences and skills align with the role.

Step 3: Showcase Your Skills

If you and our team want to move forward, you'll interview with our hiring team. Some roles may also require technical assessments and/or client interviews.

Step 4: Time to Decide

Our team will then review each candidate's potential to succeed in the role. This step may take some time because we want to find the right opportunity for both you and us, but you can count on us to keep you informed.

Still Haven't Found the Right Opportunity?

Get the latest updates on job opportunities, recruitment events, and company news, tailored just for you!

Stay Informed

AI Test Automation Lead

Job description