Organizing human intelligence to power the AI economy.
San Francisco, California
We find the best experts in every professional domain and put their knowledge to work training frontier models. Through APEX, we measure whether those models can actually perform economically valuable work. We're also bringing that expertise to enterprises: deploying custom AI agents, staffing teams with vetted domain experts, and helping organizations encode their own knowledge into AI systems.
Remote · Montreal, Quebec, Canada
Construct enterprise data science scenarios for predictive modeling and analytics governance at Fortune 500 accounts. Develop data and MLOps tasks using various enterprise platforms and author rubrics to evaluate data science judgment.
Remote · Montreal, Quebec, Canada
The role involves constructing complex enterprise consulting scenarios and tasks focused on Fortune 500 digital transformation and systems integration. The expert will develop delivery plans, account strategies, and rubrics to evaluate authentic consulting judgment.
Remote · Montreal, Quebec, Canada
The role involves constructing scenarios for rapid prototyping, design system development, and AI-assisted application workflows. The expert will also author rubrics to evaluate senior-level product judgment and design quality.
Remote · Montreal, Quebec, Canada
The role involves constructing enterprise product scenarios for multi-quarter roadmaps and aligning cross-functional stakeholders at a Fortune 500 scale. Responsibilities include developing product operations scenarios and authoring rubrics to evaluate enterprise product judgment.
Remote · Montreal, Quebec, Canada
The role involves verifying drug interactions, dosing, and contraindications against patient charts and medication lists. The pharmacist will ensure clinical accuracy and flag inappropriate drug choices to improve patient safety.
Remote · Montreal, Quebec, Canada
The role involves verifying medication safety against patient histories and identifying reconciliation gaps or adverse-reaction patterns. The nurse will evaluate clinical completeness and ensure correct nursing findings are properly escalated and documented.
Remote · Montreal, Quebec, Canada
Construct enterprise fraud scenarios for large-scale transaction monitoring and complex regulatory reporting at Fortune 500 institutions. Develop fraud operations scenarios and author rubrics to distinguish professional investigation judgment from basic knowledge.
Remote · Montreal, Quebec, Canada
The role involves constructing complex public-sector scenarios for budget appropriations, regulatory reviews, and policy analysis. The expert will develop civic tasks and author rubrics to evaluate authentic public-sector judgment.
Remote · Montreal, Quebec, Canada
The role involves constructing complex social work scenarios and tasks to improve AI model performance. Responsibilities include authoring rubrics and applying clinical frameworks to assess ethical and clinical judgment.
Remote · Montreal, Quebec, Canada
The role involves constructing K-12 educational scenarios and tasks covering curriculum design, special education, and district policy review. The specialist will develop operational scenarios using education tools and author rubrics to evaluate educator judgment.
Remote · Montreal, Quebec, Canada
The role involves constructing higher education scenarios for curriculum design, accreditation review, and enrollment planning. The expert will develop academic tasks and author rubrics to evaluate authentic higher education judgment.
Remote · Montreal, Quebec, Canada
Construct complex enterprise insurance scenarios and tasks covering underwriting, claims, and regulatory compliance for Fortune 500 carriers. Develop reference guidelines and rubrics using actuarial modeling platforms and enterprise insurance methodologies.
Remote · Montreal, Quebec, Canada
Edit and process French voice recordings for TTS and speech AI systems, ensuring high technical quality and loudness consistency. Evaluate recordings for pronunciation accuracy and naturalness while collaborating on speech dataset workflows.
Remote · Montreal, Quebec, Canada
Contribute subject matter expertise to improve state-of-the-art large language models by creating high-quality data and difficult domain problems. Evaluate and enhance AI model performance through rigorous testing and collaboration with research teams.
Remote · Canada
The role involves evaluating and optimizing agentic search systems to improve the accuracy and reliability of AI-generated content. You will scale data infrastructure and collaborate with research teams to quantify the impact of search system improvements.
Remote · Montreal, Quebec, Canada
The role involves reviewing simulated vendor SOC 2 reports and security questionnaires against buyer standards to identify scope mismatches. Additionally, the specialist will author step-level rubrics and assess data-handling risks to improve AI model performance.
Remote · Montreal, Quebec, Canada
The role involves conducting rigorous legal research to verify the accuracy of case law, statutes, and regulations using Lexis+. Responsibilities include checking for negative treatment, confirming holdings, and ensuring all citations are current and binding.
Remote · Montreal, Quebec, Canada
Author original, expert-level engineering problems and solutions based on real industry scenarios in aerodynamics. Evaluate and validate AI-generated content to improve the reasoning and rigor of frontier language models.
Remote · Montreal, Quebec, Canada
The role involves reviewing simulated vendor SOC 2 reports and security questionnaires against buyer standards to identify scope mismatches. The expert will also author step-level rubrics and assess data-handling risks to improve AI model performance.
Remote · Montreal, Quebec, Canada
The role involves verifying medication safety against patient history and identifying reconciliation gaps or IV compatibility issues. The specialist will evaluate clinical completeness and determine when nursing findings require escalation to pharmacy or prescribers.
