Senior QA Automation Engineer

Job summary

Lead quality assurance strategies for streaming workflows and AI-driven features across web, mobile, and OTT platforms. Collaborate with cross-functional teams to ensure playback stability, functional excellence, and data-level quality for AI/ML models.

Job details

About the Role: Tubi is seeking a highly skilled and experienced Senior QA Automation Engineer to lead quality assurance initiatives for our cutting-edge streaming and AI-driven product features. This pivotal role involves ensuring exceptional end-to-end user experiences, robust streaming playback, and the accuracy and integrity of our AI/ML features across web, mobile, and OTT platforms. We're looking for a candidate with a strong background in streaming QA and deep technical knowledge of media workflows. You'll be instrumental in collaborating with engineering, product, and data science teams to define comprehensive QA strategies that guarantee both functional excellence and data-level quality. This is a hybrid role based out of our Toronto office. You must be willing to travel to our Toronto office three days/week. What You'll Do: Design and lead test strategies for streaming workflows, playback systems, and AI-powered features. Test across platforms (web, mobile, and connected TV) to ensure functional parity and playback stability. Validate streaming performance—including ABR logic, encoding pipelines, and DRM integrations—under diverse real-world conditions. Debug with precision using tools like Charles Proxy, Chrome DevTools, ADB, and Xcode. Collaborate with data and ML teams to validate AI model updates, recommendations, and personalization accuracy. Leverage AI-assisted QA tools to enhance regression coverage, UI validation, and anomaly detection. Contribute to automation and CI/CD frameworks, driving faster, more reliable releases. Help drive a shift-left testing approach by engaging early in the software development lifecycle, partnering with product managers, engineers, and data scientists to identify quality risks, define test strategies, and ensure testability during requirements and design phases. Oversee QA deliverables for multiple concurrent releases and ensure seamless sign-off for production launches. Monitor live environments for playback or recommendation anomalies post-release and escalate issues promptly. Continuously improve QA processes, metrics, and reporting for streaming and AI validation. Your Background: Bachelor’s degree in Computer Science, Software Engineering, or related field, or equivalent hands-on experience. 4+ years of QA Automation experience, preferably in streaming media or VOD/OTT platforms. Strong technical knowledge of video streaming protocols (HLS, DASH, MPEG-TS), DRM systems, and CDN architectures. Experience validating AI/ML systems in production — e.g., testing model output accuracy, user personalization logic, and algorithm stability. Hands-on experience with test automation tools (Selenium, Appium, Playwright, Puppeteer) and AI-based visual testing. Proficiency in debugging tools and network analysis utilities (Charles Proxy, Chrome DevTools). Experience managing regression suites and release validation cycles across web, mobile, and connected TV platforms. Familiarity with Python, TypeScript, or JavaScript for scripting and test automation. Understanding of data validation, logging pipelines, and A/B testing frameworks. Strong analytical and documentation skills, with a proactive approach to cross-team collaboration. Nice to Have: Experience testing machine learning-driven streaming features such as recommendation systems, ad targeting, or automated metadata tagging. Exposure to model evaluation techniques (precision/recall, bias testing, data drift analysis). Familiarity with continuous testing and CI/CD environments (Jenkins, GitHub Actions, CircleCI). Understanding of observability tools (Grafana, Kibana, Datadog) for post-deployment validation. Strong ability to triage issues in large distributed systems and collaborate with engineering to resolve root causes. #LI-CL1 #LI-Hybrid Pursuant to local pay disclosure requirements, the pay range for this role, with final offer amount dependent on education, skills, experience, and location is as listed annually below. This role is also eligible for an annual discretionary bonus, long-term incentive plan, and various benefits including medical/dental/vision, insurance, vacation/paid time off and other benefits in accordance with applicable plan documents. Toronto, Canada $99,800—$142,600 CAD Tubi Media Group is a division of Fox Corporation, and the FOX Employee Benefits summarized here, covers the majority of employee benefits. The following distinctions below outline the differences between the Tubi and FOX benefits: For all salaried employees, in lieu of the FOX Vacation policy, Tubi offers a Flexible Time Off Policy to manage all personal matters. For all full-time, regular employees, in lieu of FOX Paid Parental Leave, Tubi offers a generous Parental Leave Program, which allows parents twelve (12) weeks of paid bonding leave (top up in Canada) within the first year of birth, adoption, surrogacy, or foster placement of a child in addition to applicable government leave program(s) and FOX’s short-term disability policy (if applicable). This time is 100% paid through a combination of any applicable government leaves and wage-replacement programs in addition to contributions made by Tubi. For all full-time, regular employees, Tubi offers a monthly wellness reimbursement. About Tubi: Boldly built for every fandom, Tubi is a free streaming service that entertains over 100 million monthly active users. Tubi offers the world's largest collection of Hollywood movies and TV shows, thousands of creator-led stories and hundreds of Tubi Originals made for the most passionate fans. Headquartered in San Francisco and founded in 2014, Tubi is part of Tubi Media Group, a division of Fox Corporation. We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, gender identity, disability, protected veteran status, or any other characteristic protected by law. We will consider for employment qualified applicants with criminal histories consistent with applicable law.

What you’ll do

Lead quality assurance strategies for streaming workflows and AI-driven features across web, mobile, and OTT platforms. Collaborate with cross-functional teams to ensure playback stability, functional excellence, and data-level quality for AI/ML models.

Requirements

Requires a Bachelor's degree in Computer Science or related field and 4+ years of QA automation experience, specifically within streaming or VOD/OTT platforms. Must possess deep technical knowledge of video streaming protocols, DRM, and experience validating AI/ML systems.

Benefits

• Annual Discretionary Bonus • Long-term Incentive Plan • Medical Insurance • Dental Insurance • Vision Insurance • Flexible Time Off Policy • Parental Leave Program • Monthly Wellness Reimbursement

Listed skills

• JavaScript · Preferred
• TypeScript · Preferred
• Python · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• QA Automation
• Streaming Media Testing
• AI/ML Validation
• HLS
• DASH
• MPEG-TS
• DRM Systems
• CDN Architectures
• Selenium
• Appium
• Playwright
• Puppeteer
• Python
• TypeScript
• JavaScript
• Charles Proxy

Job areas

• Software
• Technology
• Engineering
• Data & Analytics
• Creative & Media