Quality Operations Lead Contract

Job summary

Lead QA teams across shifts and manage quality operations for multimodal AI annotation projects, including review priorities, sampling, audits, calibration, and performance tracking. Investigate quality issues, drive corrective actions, document guideline decisions, share delivery insights, and report results to the Quality Manager.

Job details

Careerflow Human Data Labs partners with AI companies to bring real-world professional expertise into their products. About the role Manage day-to-day quality operations for multimodal AI annotation projects. Reporting to the Quality Manager, you will lead QA teams, monitor quality performance, resolve issues quickly, and ensure deliverables meet client standards within tight turnaround times. Key Responsibilities * Lead Senior QA Leads and QA Leads across shifts. * Set review priorities, sampling plans, and quality coverage. * Implement audits, scoring rubrics, and calibration processes. * Track accuracy, agreement, error rates, review throughput, and turnaround time. * Identify root causes and drive corrective actions with Team Leads. * Resolve guideline-related questions and document decisions. * Share quality insights after each delivery. * Report quality performance to the Quality Manager. * Support client reviews and quality-based incentive programs. Required Qualifications * 5–7 years of overall experience, including 2–3 years leading QA or quality operations teams. * Strong knowledge of sampling, auditing, calibration, and root-cause analysis. * Excellent attention to detail and ability to identify systemic issues. * Strong communication and stakeholder-management skills. * Experience in annotation, data labeling, or AI training data projects is preferred. Offer Details: 1. This is a project-based role involving a defined number of evaluation tasks. 2. Each task will involve comparing multiple chatbots and providing a final assessment. 3. Work Schedule: Five working days per week, including weekends as required, with two weekdays off. 4. Work Hours - 7am-4pm PST 5. Duration: 16 weeks.

What you’ll do

Lead QA teams across shifts and manage quality operations for multimodal AI annotation projects, including review priorities, sampling, audits, calibration, and performance tracking. Investigate quality issues, drive corrective actions, document guideline decisions, share delivery insights, and report results to the Quality Manager.

Requirements

Requires 5–7 years of overall experience, including 2–3 years leading QA or quality operations teams, with strong knowledge of sampling, auditing, calibration, and root-cause analysis. Candidates should have excellent attention to detail and strong communication and stakeholder-management skills; annotation, data labeling, or AI training data experience is preferred.

Listed skills

• Quality assurance · Preferred
• Communication · Preferred
• Root Cause Analysis · Preferred
• Team Leadership · Preferred
• Stakeholder Management · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Quality Operations
• Quality Assurance
• Team Leadership
• Sampling
• Auditing
• Calibration
• Root-Cause Analysis
• Quality Performance Monitoring
• Accuracy Measurement
• Error Analysis
• Corrective Actions
• Guideline Interpretation
• Stakeholder Management
• Communication
• Data Annotation
• AI Training Data
• Data Labeling
• Operations
• Quality Management
• Safety Assurance
• Turnaround Time
• Root Cause Analysis
• Chatbot
• Detail Oriented

Job areas

• Management & Leadership
• Technology
• Data & Analytics
• Quality Operations Manager
• Quality Assurance Manager
• Management and Organization Analysts
• Quality Control Systems Managers
• Industrial Production Managers

More jobs from Careerflow.ai