PhD Engineer Remote
About the role
About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Engineering AI Evaluator
Type: Contract Compensation: $73/hour Location: Remote Role Responsibilities
- Write and refine prompts to guide model behavior in engineering scenarios.
- Evaluate LLM-generated responses for technical accuracy and applied reasoning.
- Conduct fact-checking and verify technical claims using authoritative sources.
- Annotate model responses, identifying strengths and areas for improvement.
- Assess clarity and appropriateness of explanations for different audiences.
- Ensure model responses align with expected conversational behavior and guidelines.
Qualifications Must-Have
- PhD in Engineering or a closely related field
- Expertise in Mechanical & Physical Systems Engineering, Electrical, Electronic & Computer Engineering, Chemical, Materials & Process Engineering, or Civil, Environmental & Infrastructure Engineering
- Significant experience using large language models (LLMs)
- Excellent writing skills
- Strong attention to detail
- Experience reviewing or editing technical or academic writing
Preferred
- Experience with applied research, industry engineering workflows, or systems design
- Prior experience with RLHF, model evaluation, or data annotation work
- Experience teaching or explaining engineering concepts to non-expert audiences
- Familiarity with evaluation rubrics or structured review frameworks
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. ,
PhD Engineer Remote
About the role
About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Engineering AI Evaluator
Type: Contract Compensation: $73/hour Location: Remote Role Responsibilities
- Write and refine prompts to guide model behavior in engineering scenarios.
- Evaluate LLM-generated responses for technical accuracy and applied reasoning.
- Conduct fact-checking and verify technical claims using authoritative sources.
- Annotate model responses, identifying strengths and areas for improvement.
- Assess clarity and appropriateness of explanations for different audiences.
- Ensure model responses align with expected conversational behavior and guidelines.
Qualifications Must-Have
- PhD in Engineering or a closely related field
- Expertise in Mechanical & Physical Systems Engineering, Electrical, Electronic & Computer Engineering, Chemical, Materials & Process Engineering, or Civil, Environmental & Infrastructure Engineering
- Significant experience using large language models (LLMs)
- Excellent writing skills
- Strong attention to detail
- Experience reviewing or editing technical or academic writing
Preferred
- Experience with applied research, industry engineering workflows, or systems design
- Prior experience with RLHF, model evaluation, or data annotation work
- Experience teaching or explaining engineering concepts to non-expert audiences
- Familiarity with evaluation rubrics or structured review frameworks
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. ,