AI Research Evaluation Specialist – Critical Analysis
Evaluate AI-generated responses and provide structured written feedback to improve AI research projects. Identify gaps in reasoning and write precise, well-evidenced rationales based on evaluation guidelines.
- Remote
- Canada
- Posted Aug 26, 2026
- 1 position
Job summary
Position: Generalist Expert Type: Independent Contractor Compensation: $70/hr Location: Remote Commitment: 10-40 hrs/week Role Responsibilities Evaluate AI-generated responses and provide structured written feedback. Contribute to high-impact AI research projects. Identify nuances, implicit meanings, and gaps in reasoning in AI outputs. Write clear, precise, and well-evidenced rationales. Apply structured evaluation guidelines accurately. Requirements Have strong relevant experience in the domain. Strong analytical and written communication skills. Ability to work independently and follow detailed task guidelines. Strong critical reading skills. Consistent and honest judgment with the ability to give critical assessments. Application Process Apply using the Easy Apply button and submit your application. Applications will be reviewed based on the role requirements. Eligible candidates will receive a message in their LinkedIn or email inbox with instructions to continue the application process. Follow the instructions in the message to complete the remaining application steps.
What you’ll do
Evaluate AI-generated responses and provide structured written feedback to improve AI research projects. Identify gaps in reasoning and write precise, well-evidenced rationales based on evaluation guidelines.
Requirements
Candidates must have strong relevant domain experience and exceptional analytical and written communication skills. The role requires the ability to work independently and provide honest, critical assessments of AI outputs.
Other relevant skills
Identified from the job description. Confirm important requirements above.
- AI Evaluation
- Critical Analysis
- Written Communication
- Analytical Skills
- Critical Reading
- Structured Feedback
- Reasoning Analysis
Job areas
- Science & Research
- Technology
- Data & Analytics
- Education
Additional details
- Minimum experience
- 2+ years
- Posting language
- English
- Working hours
- 40 hours per week
- Seniority
- Associate
- Application method
- Direct apply is available
