Quality Engineer – AI Chatbot Validation

Toronto, ON
Hybrid
Posted Oct 22, 2026
1 position

$40–$45 / hour

Opens LinkedIn

Employment type: Contract
Experience level: Senior · 5+ years
Posting language: English
Working hours: 40 hours per week
Office presence: 1 days per week
Seniority: Mid-Senior level
Application method: Direct apply is available

Job summary

Validate AI-powered chatbots, LLMs, GenAI solutions, APIs, and related integrations through functional, non-functional, and regression testing. Develop evaluation datasets, test scenarios, test data, and automated strategies to assess AI outputs for accuracy, relevance, grounding, hallucinations, bias, toxicity, consistency, and prompt effectiveness.

Job details

Job Title: Quality Engineer – AI Chatbot Validation Location: Toronto, ON Work Arrangement: 1 Day onsite Employment Type: Contract Domain: BFSI Pay Rate: CAD 40-45/hr on Incorporated Application Deadline: Oct 30th, 2026 SKILLS REQUIRED 5+ years of experience in Quality Engineering, QA, Software Testing, Test Automation, or Software Development. Strong programming skills in Java, Python, Groovy, or equivalent languages, with 5+ years of hands-on experience. Experience validating AI/ML applications, GenAI solutions, LLMs, chatbots, conversational AI, and AI-powered APIs. Strong hands-on experience with Selenium, Playwright, Cucumber/Gherkin, RestAssured, or comparable automation tools. Experience testing APIs, microservices, databases, system integrations, functional/non-functional requirements, and regression testing. Proficiency with JUnit, TestNG, qTest, ReadyAPI, and JMeter. Strong understanding of TDD, BDD, ATDD, Continuous Testing, and Risk-Based Testing practices. Experience evaluating AI outputs for accuracy, relevance, grounding, hallucinations, bias, toxicity, consistency, and prompt effectiveness. Ability to develop AI evaluation datasets, test scenarios, test data, and automated validation strategies for GenAI applications. EEOC Compliance: We are an equal opportunity employer, and all qualified applicants will receive consideration for employment. DISCLAIMER AI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are made by human recruiters based on qualifications and experience.

What you’ll do

Requirements

Requires 5+ years of experience in quality engineering, QA, software testing, test automation, or software development, along with 5+ years of hands-on programming experience in Java, Python, Groovy, or an equivalent language. Candidates should have experience with AI/ML applications and automation tools, API and integration testing, testing frameworks, and practices such as TDD, BDD, ATDD, continuous testing, and risk-based testing.