LLM Evaluation Specialist – Analytical Reviewer | $70/hr Remote

Position: Generalist Expert Type: Independent Contractor Compensation: $70/hr Location: Remote Commitment: 10-40 hrs/week Role Responsibilities Evaluate AI-generated responses and provide structured written feedback. Contribute to high-impact AI research projects. Identify nuances, implicit meanings, and gaps in reasoning in AI outputs. Write clear, precise, and well-evidenced rationales. Apply structured evaluation guidelines accurately. Requirements Have strong relevant experience in the domain. Strong analytical and written communication skills. Ability to work independently and follow detailed task guidelines. Strong critical reading skills. Consistent and honest judgment with the ability to give critical assessments. Application Process Apply using the Easy Apply button and submit your application. Applications will be reviewed based on the role requirements. Eligible candidates will receive a message in their LinkedIn or email inbox with instructions to continue the application process. Follow the instructions in the message to complete the remaining application steps.

Evaluate AI-generated responses and provide structured written feedback to improve AI research projects. Identify reasoning gaps and nuances in AI outputs while applying specific evaluation guidelines.

Candidates must have strong domain experience and exceptional analytical and written communication skills. Ability to work independently and provide honest, critical assessments is required.

Identified from the job description. Confirm important requirements above.

• LLM Evaluation
• Analytical Writing
• Critical Reading
• AI Research
• Structured Feedback
• Reasoning Analysis

• Science & Research
• Data & Analytics
• Technology
• Administrative

Minimum experience

2+ years

Posting language

English

Working hours

40 hours per week

Seniority

Associate

Application method

Direct apply is available