AI QA Lead

Job summary

Develop and use AI-powered QA agents, agentic AI, LLM technologies, and chatbot applications to create and execute test cases. Perform testing across UI, integration, regression, performance, AI-enabled systems, and user acceptance testing for large-scale web, mobile, on-premise, and cloud-based applications.

Job details

MSP Notes Shortlist Date: 2026-10-19, 12:00 p.m. Must Haves: Minimum of 3 years of solid experience in AI-assisted testing with hands-on experience in developing AI-powered QA agents using agentic AI, LLM technologies and chatbot applications to create and execute test cases. Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms. Extensive hands-on experience with all layers of testing: UI, Integration, Regression, Performance, AI-enabled systems, and User Acceptance Testing—across web-based, mobile, and cloud platforms. Proven ability to execute AI testing activities utilizing specialized tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, Agentic AI, Copilot Studio Kit, etc. NOTE: HM is looking for strong AI testing experience.

What you’ll do

Develop and use AI-powered QA agents, agentic AI, LLM technologies, and chatbot applications to create and execute test cases. Perform testing across UI, integration, regression, performance, AI-enabled systems, and user acceptance testing for large-scale web, mobile, on-premise, and cloud-based applications.

Requirements

Requires at least 3 years of hands-on AI-assisted testing experience, including developing AI-powered QA agents with agentic AI, LLM technologies, and chatbot applications. Requires 10 or more years of testing experience with large-scale applications and extensive hands-on experience across testing layers and specialized AI testing tools.

Listed skills

• Integration · Preferred
• Integrations · Preferred
• Organization · Preferred
• Attention to detail · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• AI-Assisted Testing
• AI-Powered QA Agents
• Agentic AI
• Large Language Models
• Chatbot Applications
• Test Case Development and Execution
• UI Testing
• Integration Testing
• Regression Testing
• Performance Testing
• AI-Enabled Systems Testing
• User Acceptance Testing
• Web Testing
• Mobile Testing
• Cloud Testing
• DeepEval

Job areas

• Technology
• Software
• Management & Leadership

More jobs from Flexstaf I.T. Inc.