AI Test Automation Lead

About the Position

AI Test Automation Lead

As an Automation Test Lead, you will lead AI-powered Quality Engineering and test automation solutions, including developing testing strategies and frameworks, integrating testing into CI/CD pipelines, validating AI behavior and integrations, and promoting responsible AI practices across complex insurance and retirement systems.

Responsibilities

• Create and maintain test cases for prompt-driven applications, AI agents, RAG systems, and workflow orchestration platforms
• Design, build, and maintain automated test frameworks for AI applications and services
• Develop automated evaluation pipelines to assess AI responses, workflows, and model behavior
• Drive automation-first quality strategy and lead automation solutions across programs
• Design scalable automation architectures spanning UI, API, Mobile, and Database layers
• Develop and implement GenAI-powered solutions for automated test design, code generation, execution, and defect analysis
• Test AI agents, copilots, APIs, workflow engines, MCP integrations, and tool-calling capabilities
• Leverage AI and ML tools to enhance test coverage, improve efficiency, and reduce regression cycles
• Leverage GitHub Copilot and Claude to enable AI-assisted automation and enforce CI/CD quality gates
• Integrate automated AI and regression test suites into CI/CD pipelines to support continuous integration and rapid model updates
• Collaborate with cross-functional teams and mentor engineers on GenAI, Agentic AI, automation, model deployment, and AI safety best practices

Work Model

We believe hybrid work is the way forward as we strive to provide flexibility wherever possible. Based on this role’s business requirements, this is a hybrid position requiring 3 days a week in a client or Cognizant office in Toronto or Kitchener location. Regardless of your working arrangement, we are here to support a healthy work-life balance though our various wellbeing programs.

Key Skills

• Test Automation Architecture
• GenAI & LLMs
• GitHub Copilot
• CI/CD & DevOps
• Quality Analytics
• Strong communication, presentation skills
• Stakeholder Management

Requirements

• 10+ years of Quality Engineering experience covering functional, API, integration, and automation testing with a dedicated focus on AI testing and validation
• 3+ years in AI/ML systems testing; expert proficiency in AI/ML testing frameworks, MLOps, CI/CD integration, and programming (Python, Java)
• Hands-on GitHub Copilot and Claude experience to enable AI-assisted automation and enforce CI/CD quality gates
• Hands-on experience with AI platforms and prompt engineering
• Ability to work independently, have the capability to lead a team and engage with senior business and technology stakeholders

Nice to Have

• Exposure to Life Insurance, Retirement domain

Total Compensation

The base salary for this position ranges between CAD 90,000 – 117,000 per year. This position is also eligible for Cognizant’s discretionary annual performance-based bonus, as well as benefits that support your physical, mental and financial wellbeing.

About the Company

Cognizant (Nasdaq: CTSH) es un creador de soluciones de IA y proveedor de servicios tecnológicos que conecta la inversión en IA con el valor empresarial mediante el desarrollo de soluciones de IA full‑stack para sus clientes. Su profundo conocimiento de la industria, junto con su experiencia en procesos e ingeniería, permite incorporar el contexto único de cada organización en sistemas tecnológicos que amplifican el potencial humano, generan resultados tangibles y mantienen a las empresas a la vanguardia en un entorno en constante cambio. Más información en cognizant.ai o @cognizant.

Additional Employment Information

La información de compensación es precisa a la fecha de esta publicación. Cognizant se reserva el derecho de modificar esta información en cualquier momento, sujeto a la legislación aplicable.

Es posible que se requiera que los solicitantes asistan a entrevistas en persona o por videoconferencia. Además, es posible que se requiera que los candidatos presenten su identificación actual emitida por el estado o gobierno durante cada entrevista.

Cognizant es un empleador que ofrece igualdad de oportunidades. Tu solicitud y candidatura no serán consideradas en base a raza, color, sexo, religión, credo, orientación sexual, identidad de género, origen nacional, discapacidad, información genética, embarazo, condición de veterano o cualquier otra característica protegida por las leyes federales, estatales o locales.

Si tienes una discapacidad que requiere adaptaciones razonables para buscar una vacante de trabajo o enviar una solicitud, puedes enviar un correo electrónico a [email protected] con tu solicitud e información de contacto.