Senior Systems Testing/QA Specialist – AI Testing

Toronto, ON
On-site
Posted Oct 14, 2026
1 position

Opens LinkedIn

Employment type: Contract
Experience level: Lead · 10+ years
Posting language: English
Working hours: 40 hours per week
Seniority: Mid-Senior level
Application method: Direct apply is available

Job summary

Develop and use AI-powered QA agents and AI testing tools to create and execute test cases, evaluating AI responses for accuracy, hallucinations, prompt vulnerabilities, security, privacy, and safety. Lead and perform broad software testing and automation across web, cloud, and mobile applications, including test planning, defect management, and QA delivery within CI/CD and project methodologies.

Job details

Position: Senior Systems Testing/QA Specialist – AI Testing Minimum 3 years of hands-on experience in AI-assisted testing, developing AI-powered QA agents using Agentic AI, LLM technologies, and chatbot applications to create and execute test cases. Hands-on experience with AI testing tools such as DeepEval, Promptfoo, Applitools, SaolaAI, Reflect AI, and Copilot Studio Kit. Minimum 10+ years of experience in software testing/QA across large-scale web applications, cloud integrations, and mobile platforms. Strong expertise in AI testing, including response accuracy, hallucination detection, prompt testing, prompt injection, AI security, privacy, and safety testing. Extensive experience in functional, UI, integration, regression, performance, accessibility, and UAT testing, along with AI-assisted test automation and CI/CD pipelines. Proficiency in automation tools such as Selenium, Micro Focus/OpenText UFT, and TOSCA, and performance testing tools such as JMeter and OpenText LoadRunner. Experience with test planning, test case development, defect lifecycle management, and QA leadership using Jira, OpenText ALM/Octane, and Agile, Waterfall, Hybrid, or DevOps methodologies.

What you’ll do

Requirements

Requires at least 10 years of software testing or QA experience across large-scale web applications, cloud integrations, and mobile platforms, including at least 3 years of hands-on AI-assisted testing experience. Candidates should have expertise in AI testing and test automation tools, performance testing, QA leadership, test management platforms, and Agile, Waterfall, Hybrid, or DevOps methodologies.