Sr. Systems Testing/QA Specialist (AI/LLM testing experience)
- Toronto, ON
- On-site
- Posted Oct 14, 2026
- 1 position
$70–$75 / hour
Opens LinkedIn
- Employment type
- Contract
- Experience level
- Lead · 10+ years
- Posting language
- English
- Working hours
- 40 hours per week
- Seniority
- Mid-Senior level
- Application method
- Apply on LinkedIn (LinkedIn sign-in required)
Job summary
Develop and use AI-powered QA agents and LLM-based tools to create and execute test cases for AI-enabled systems and chatbot applications. Perform testing across UI, integration, regression, performance, and user acceptance layers for large-scale web, mobile, on-premise, and cloud-based applications.
Job details
Job Role: Sr. Systems Testing/QA Specialist (AI/LLM testing experience) Location : Toronto, ON/Onsite Position Type : Contract Role Start Date 2026-12-15 End Date 2027-06-14 Location: 3 days onsite Public Sector Experience: Preferred Ideal Candidate Rate: CAD 70-75/Hr (Depending on the experience) Must Have: Minimum of 3 years of solid experience in AI-assisted testing with hands-on experience in developing AI-powered QA agents using agentic AI, LLM technologies and chatbot applications to create and execute test cases. Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms. Extensive hands-on experience with all layers of testing: UI, Integration, Regression, Performance, AI-enabled systems, and User Acceptance Testing—across web-based, mobile, and cloud platforms. Proven ability to execute AI testing activities utilizing specialized tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, Agentic AI, Copilot Studio Kit, etc. Note: AI-enabled tools may be used to sort applications based on job-related criteria. All AI generated results are vetted by our team and the decision of which candidates move forward is always made by a human.
What you’ll do
Develop and use AI-powered QA agents and LLM-based tools to create and execute test cases for AI-enabled systems and chatbot applications. Perform testing across UI, integration, regression, performance, and user acceptance layers for large-scale web, mobile, on-premise, and cloud-based applications.
Requirements
Requires at least three years of hands-on AI-assisted testing experience, including agentic AI, LLM technologies, and chatbot applications. Also requires 10 or more years testing large-scale applications across web, mobile, on-premise, and cloud platforms, with experience using specialized AI testing tools.
Listed skills
- Integration · Preferred
- Integrations · Preferred
- Organization · Preferred
- Attention to detail · Preferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- AI-Assisted Testing
- Agentic AI
- Large Language Models
- AI-Powered QA Agents
- Chatbot Testing
- Test Case Development
- UI Testing
- Integration Testing
- Regression Testing
- Performance Testing
- User Acceptance Testing
- Mobile Testing
- Cloud Testing
- DeepEval
- Applitools
- Promptfoo
Job areas
- Technology
- Software
- Government & Public Sector
More jobs from Bevertec
Project Manager/Leader - Senior (Audio-Visual and Videoconferencing technology experience)
- On-site
- Toronto, ON
- Posted Oct 17, 2026
Automation Developer - Senior (Selenium, Cypress, Playwright, or WebDriverIO experience)
- On-site
- Toronto, ON
- Posted Oct 17, 2026
DataOps/Cloud Data Engineer - Senior (ETL/Databricks experience)
- On-site
- Toronto, ON
- Posted Oct 17, 2026
Senior Software Developer
- On-site
- Toronto, ON
- Posted Oct 17, 2026
