Scale’s mission is to develop reliable AI systems for the world’s most important decisions. We provide the high-quality data and full-stack technologies that power the world’s leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. The Scale Generative AI Platform allows customers to build, evaluate, and control advanced AI agents and applications that continuously improve. The Scale Data Engine provides the technology to collect, curate, and annotate high-quality datasets. Through our Scale Labs, we test models with rigorous benchmarks and novel research to ensure breakthroughs translate into systems people can trust. Scale powers the most advanced LLMs and generative models in the world through RLHF, data generation and model evaluation. We work with industry leaders like Meta, Cisco, DLA Piper, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force.
Remote · Canada, United States
The Subject Matter Expert focuses on quality evaluation, conducting structured audits of task outputs to ensure accuracy and adherence to guidelines. They define quality benchmarks and provide actionable insights to improve overall output standards.
Remote · Canada
Collaborate with AI labs to design domain-specific problems and datasets for evaluating advanced generative AI models. Contribute to technical reports and research papers while engaging with an interdisciplinary network of experts.
Remote · Canada
Fellows will engage in high-impact projects by designing, evaluating, and interpreting advanced generative AI systems, which includes reviewing deep learning problems and critiquing complex ML code and PyTorch implementations. They will also apply expert judgment on GPU performance, profiling, and hardware scaling trade-offs.
