AI Evaluation Specialist Generalist
About the role
About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Mercor Generalist
Type: Independent Contractor Compensation: $20–$30/hour Location: Remote Duration: 1–3 months typical Commitment: 10–20 hours/week, with potential to increase Role Responsibilities
- Evaluate AI-generated outputs for accuracy, clarity, and alignment with real-world reasoning.
- Contribute written assessments and structured feedback on model performance.
- Identify conceptual, logical, and stylistic strengths and weaknesses in AI responses.
- Collaborate asynchronously with Mercor’s research and operations teams to maintain quality and consistency across evaluations.
- Ensure strong analytical judgment, precise communication, and consistent application of evaluation criteria.
Qualifications Must-Have
- Strong English fluency and written communication skills.
- Sharp attention to detail and ability to identify subtle errors or inconsistencies.
- Analytical and critical thinking skills across a wide range of topics.
- No formal educational background or specific degree required—curiosity, clarity, and reasoning skill are key.
- Based in USA.
Start Date
- Immediate opportunities available; applications reviewed on a rolling basis.
Compensation & Legal
- Independent contractor arrangement.
- Daily payments via Stripe Connect.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. ,
AI Evaluation Specialist Generalist
About the role
About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Mercor Generalist
Type: Independent Contractor Compensation: $20–$30/hour Location: Remote Duration: 1–3 months typical Commitment: 10–20 hours/week, with potential to increase Role Responsibilities
- Evaluate AI-generated outputs for accuracy, clarity, and alignment with real-world reasoning.
- Contribute written assessments and structured feedback on model performance.
- Identify conceptual, logical, and stylistic strengths and weaknesses in AI responses.
- Collaborate asynchronously with Mercor’s research and operations teams to maintain quality and consistency across evaluations.
- Ensure strong analytical judgment, precise communication, and consistent application of evaluation criteria.
Qualifications Must-Have
- Strong English fluency and written communication skills.
- Sharp attention to detail and ability to identify subtle errors or inconsistencies.
- Analytical and critical thinking skills across a wide range of topics.
- No formal educational background or specific degree required—curiosity, clarity, and reasoning skill are key.
- Based in USA.
Start Date
- Immediate opportunities available; applications reviewed on a rolling basis.
Compensation & Legal
- Independent contractor arrangement.
- Daily payments via Stripe Connect.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. ,