Organizing human intelligence to power the AI economy.
San Francisco, California
We find the best experts in every professional domain and put their knowledge to work training frontier models. Through APEX, we measure whether those models can actually perform economically valuable work. We're also bringing that expertise to enterprises: deploying custom AI agents, staffing teams with vetted domain experts, and helping organizations encode their own knowledge into AI systems.
Remote · Toronto, Ontario, Canada
Contribute subject matter expertise to develop high-quality data and difficult problems to improve the reasoning and performance of state-of-the-art large language models. Collaborate with AI research teams to provide structured feedback and enhance model outputs.
Remote · Canada
Red team conversational AI models to identify vulnerabilities such as jailbreaks and prompt injections. Generate high-quality human data and document reproducible attack cases to improve model performance.
Remote · Montreal, Quebec, Canada
Create research problems and scientific prompts using published papers and open-source datasets to improve AI model performance. Develop grading criteria and utilize programming languages for scientific computing and quality checks via Git and Docker.
Remote · Copenhagen, Capital Region of Denmark, Denmark
The role involves red teaming conversational AI models to identify jailbreaks, prompt injections, and systemic risks. Experts will generate high-quality human data, annotate failures, and produce actionable reports and datasets for customers.
Remote · Montreal, Quebec, Canada
Evaluate product design decisions to ensure they align with professional standards and taste. Develop high-quality graphics and documents using tools like Figma and Adobe Creative Suite.
Remote · Montreal, Quebec, Canada
The role involves evaluating AI-generated artifacts against domain-specific rubrics to identify factual and aesthetic errors. The evaluator provides structured written feedback to improve AI model performance and collaborates with subject matter experts.
Remote · Montreal, Quebec, Canada
The Project Manager will track annotator performance and quality using Google Sheets while managing contributor communications. They are responsible for applying an analytical mindset to enhance LLM training projects and owning complex problems from start to finish.
Remote · Montreal, Quebec, Canada
Validate clinical data rooms against FDA standards and author information requests and model responses. Design prompts and rubrics to quantify and improve the performance of AI agents in regulatory judgment.
Remote · Canada
Red team conversational AI models to identify jailbreaks, prompt injections, and systemic risks. Generate high-quality human data and produce detailed reports and datasets for customer action.
Remote · Montreal, Quebec, Canada
Manage and update Google Business Profiles to maintain an active and accurate online presence. Engage with the platform and collaborate with industry representatives to enhance profile visibility.
Remote · Montreal, Quebec, Canada
Evaluate AI-generated artifacts against quality rubrics to identify factual and presentation errors. Provide structured written feedback to improve the accuracy and rigor of AI model outputs.
Remote · Montreal, Quebec, Canada
The role involves evaluating AI-generated artifacts against domain-specific quality rubrics for corporate finance. The expert will identify factual and presentation errors and provide structured written feedback.
Remote · Montreal, Quebec, Canada
Evaluate AI-generated financial compliance artifacts against quality rubrics to identify factual and presentation errors. Provide structured written feedback to improve the accuracy and rigor of AI model outputs.
Remote · Montreal, Quebec, Canada
Evaluate AI-generated artifacts against domain-specific quality rubrics to identify factual and presentation errors. Provide structured written feedback to improve the performance of AI models in the Cybersecurity and IT GRC domains.
Remote · Montreal, Quebec, Canada
The role involves evaluating AI-generated artifacts against quality rubrics to identify factual and aesthetic errors. The expert will provide structured written feedback to improve the accuracy and rigor of documents, spreadsheets, and slide decks.
Remote · Montreal, Quebec, Canada
Evaluate AI-generated artifacts against domain-specific rubrics to identify factual and presentation errors. Provide structured written feedback and collaborate with subject matter experts to improve AI model performance.
Remote · Montreal, Quebec, Canada
The role involves evaluating AI-generated finance and accounting artifacts against quality rubrics to identify factual and presentation errors. The evaluator provides structured written feedback to improve the performance of AI model outputs.
Remote · Montreal, Quebec, Canada
Evaluate AI-generated artifacts using domain-specific rubrics to identify factual and presentation errors. Provide structured written feedback to improve the performance of AI models.
Remote · Montreal, Quebec, Canada
Evaluate AI-generated educational artifacts against quality rubrics to identify factual and presentation errors. Provide structured written feedback to improve the accuracy and rigor of AI model outputs.
Remote · Montreal, Quebec, Canada
Evaluate AI-generated artifacts against domain-specific rubrics to identify factual and presentation errors. Provide structured written feedback to improve AI model performance in the nonprofit and philanthropy domain.
