About the role
Title: AI Quality Analyst
Work Location: 2100 Meadowvale Blvd, Mississauga, Ontario, CAN, L5N 7J9 (Hybrid) Summary: We are seeking an AI Quality Analyst to join our team and help ensure the quality, accuracy, reliability, and safety of AI/ML solutions. In this role, you will evaluate AI models, identify performance issues, edge cases, and potential biases, and provide actionable insights that drive continuous model improvement. You will work closely with AI engineers and cross-functional teams to ensure our AI products perform effectively in real-world scenarios.
Key Responsibilities
Design, develop, and execute test cases and evaluation benchmarks for AI/ML models. Identify model weaknesses, edge cases, unexpected behaviors, and potential biases through structured, exploratory, and adversarial testing. Perform detailed error analysis, categorize model failures, and prioritize issues based on severity and impact. Source, validate, annotate, and manage datasets used for AI model evaluation and testing. Set up, maintain, and troubleshoot testing environments to support a reliable evaluation process. Automate testing and data validation using Python and industry-standard QA automation tools. Test web and mobile (Android/iOS) applications and APIs to ensure seamless AI integration. Document defects, track issues using Jira, and prepare clear reports with recommendations for model improvements. Collaborate with AI engineers, developers, product managers, and other stakeholders to resolve issues and continuously improve testing methodologies and quality processes.
Qualifications
Experience in Quality Assurance, Software Testing, Test Automation, or AI/ML testing. Strong understanding of the machine learning lifecycle and AI model evaluation. Hands-on experience with Python for test automation and data manipulation. Experience with test automation tools such as Selenium, Playwright, Cypress, or REST Assured. Experience testing web and/or mobile applications (Android/iOS). Experience with data annotation, data validation, and managing large datasets. Familiarity with Jira and test case management tools. Knowledge of AI model evaluation, Generative AI, Large Language Models (LLMs), AI agents, or Computer Vision.
Strong analytical, problem-solving, documentation, and communication skills
Not the right fit? Search for AI QA Analyst jobs in Mississauga, Ontario, Canada
About ExcelGens, Inc.
Your go-to ally for cutting-edge technology and workforce solutions, ExcelGens is headquartered in New Jersey, with a presence in Canada, Europe, India and the United Kingdom.
We specialize in the full spectrum of workforce and tech platforms, paving the way for a hyper efficient, productive future for businesses.
At Excelgens, we understand the crucial role that both technology and talent play in helping businesses stay ahead of the curve, and we are here to empower yours with the best of both.
We are a trusted partner to many Fortune 500 clients and serve a few of them globally.
Similar Jobs
About the role
Title: AI Quality Analyst
Work Location: 2100 Meadowvale Blvd, Mississauga, Ontario, CAN, L5N 7J9 (Hybrid) Summary: We are seeking an AI Quality Analyst to join our team and help ensure the quality, accuracy, reliability, and safety of AI/ML solutions. In this role, you will evaluate AI models, identify performance issues, edge cases, and potential biases, and provide actionable insights that drive continuous model improvement. You will work closely with AI engineers and cross-functional teams to ensure our AI products perform effectively in real-world scenarios.
Key Responsibilities
Design, develop, and execute test cases and evaluation benchmarks for AI/ML models. Identify model weaknesses, edge cases, unexpected behaviors, and potential biases through structured, exploratory, and adversarial testing. Perform detailed error analysis, categorize model failures, and prioritize issues based on severity and impact. Source, validate, annotate, and manage datasets used for AI model evaluation and testing. Set up, maintain, and troubleshoot testing environments to support a reliable evaluation process. Automate testing and data validation using Python and industry-standard QA automation tools. Test web and mobile (Android/iOS) applications and APIs to ensure seamless AI integration. Document defects, track issues using Jira, and prepare clear reports with recommendations for model improvements. Collaborate with AI engineers, developers, product managers, and other stakeholders to resolve issues and continuously improve testing methodologies and quality processes.
Qualifications
Experience in Quality Assurance, Software Testing, Test Automation, or AI/ML testing. Strong understanding of the machine learning lifecycle and AI model evaluation. Hands-on experience with Python for test automation and data manipulation. Experience with test automation tools such as Selenium, Playwright, Cypress, or REST Assured. Experience testing web and/or mobile applications (Android/iOS). Experience with data annotation, data validation, and managing large datasets. Familiarity with Jira and test case management tools. Knowledge of AI model evaluation, Generative AI, Large Language Models (LLMs), AI agents, or Computer Vision.
Strong analytical, problem-solving, documentation, and communication skills
Not the right fit? Search for AI QA Analyst jobs in Mississauga, Ontario, Canada
About ExcelGens, Inc.
Your go-to ally for cutting-edge technology and workforce solutions, ExcelGens is headquartered in New Jersey, with a presence in Canada, Europe, India and the United Kingdom.
We specialize in the full spectrum of workforce and tech platforms, paving the way for a hyper efficient, productive future for businesses.
At Excelgens, we understand the crucial role that both technology and talent play in helping businesses stay ahead of the curve, and we are here to empower yours with the best of both.
We are a trusted partner to many Fortune 500 clients and serve a few of them globally.