Back to job search
Bevertec logo

Sr. Systems Testing/QA Specialist (AI/LLM testing experience)

  • Toronto, ON
  • On-site
  • Posted Oct 14, 2026
  • 1 position

$70–$75 / hour

Opens LinkedIn

Sign in to save this job
Employment type
Contract
Experience level
Lead · 10+ years
Posting language
English
Working hours
40 hours per week
Seniority
Mid-Senior level
Application method
Apply on LinkedIn (LinkedIn sign-in required)

Job summary

Develop and use AI-powered QA agents and LLM-based tools to create and execute test cases for AI-enabled systems and chatbot applications. Perform testing across UI, integration, regression, performance, and user acceptance layers for large-scale web, mobile, on-premise, and cloud-based applications.

Job details

Job Role: Sr. Systems Testing/QA Specialist (AI/LLM testing experience) Location : Toronto, ON/Onsite Position Type : Contract Role Start Date 2026-12-15 End Date 2027-06-14 Location: 3 days onsite Public Sector Experience: Preferred Ideal Candidate Rate: CAD 70-75/Hr (Depending on the experience) Must Have: Minimum of 3 years of solid experience in AI-assisted testing with hands-on experience in developing AI-powered QA agents using agentic AI, LLM technologies and chatbot applications to create and execute test cases. Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms. Extensive hands-on experience with all layers of testing: UI, Integration, Regression, Performance, AI-enabled systems, and User Acceptance Testing—across web-based, mobile, and cloud platforms. Proven ability to execute AI testing activities utilizing specialized tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, Agentic AI, Copilot Studio Kit, etc. Note: AI-enabled tools may be used to sort applications based on job-related criteria. All AI generated results are vetted by our team and the decision of which candidates move forward is always made by a human.

What you’ll do

Develop and use AI-powered QA agents and LLM-based tools to create and execute test cases for AI-enabled systems and chatbot applications. Perform testing across UI, integration, regression, performance, and user acceptance layers for large-scale web, mobile, on-premise, and cloud-based applications.

Requirements

Requires at least three years of hands-on AI-assisted testing experience, including agentic AI, LLM technologies, and chatbot applications. Also requires 10 or more years testing large-scale applications across web, mobile, on-premise, and cloud platforms, with experience using specialized AI testing tools.

Listed skills

  • Integration · Preferred
  • Integrations · Preferred
  • Organization · Preferred
  • Attention to detail · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

  • AI-Assisted Testing
  • Agentic AI
  • Large Language Models
  • AI-Powered QA Agents
  • Chatbot Testing
  • Test Case Development
  • UI Testing
  • Integration Testing
  • Regression Testing
  • Performance Testing
  • User Acceptance Testing
  • Mobile Testing
  • Cloud Testing
  • DeepEval
  • Applitools
  • Promptfoo

Job areas

  • Technology
  • Software
  • Government & Public Sector

More jobs from Bevertec

See all jobs from Bevertec