Machine Learning Engineer - Evaluator
Top Benefits
About the role
About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Machine Learning Engineer
Type: Project-based Compensation: $100–$120/hour Location: Remote Role Responsibilities
- Design and develop detailed evaluation suites for machine learning engineering tasks.
- Assess AI-generated solutions in areas like model training, debugging, optimization, and experimentation.
- Translate practical ML research and engineering workflows into structured benchmarks for frontier models.
- Work independently and asynchronously to meet deadlines while improving AI model performance.
- Collaborate with AI research teams to ensure evaluation suites reflect real-world engineering tasks.
Qualifications Must-Have
- 3+ years of experience in machine learning engineering or applied ML research.
- Hands-on experience with model development, experimentation, and evaluation.
- Background in ML research (industry lab or academic setting strongly preferred).
- Strong ability to reason about ML system design choices and tradeoffs.
- Clear written communication and high attention to technical detail.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. ,
Machine Learning Engineer - Evaluator
Top Benefits
About the role
About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Machine Learning Engineer
Type: Project-based Compensation: $100–$120/hour Location: Remote Role Responsibilities
- Design and develop detailed evaluation suites for machine learning engineering tasks.
- Assess AI-generated solutions in areas like model training, debugging, optimization, and experimentation.
- Translate practical ML research and engineering workflows into structured benchmarks for frontier models.
- Work independently and asynchronously to meet deadlines while improving AI model performance.
- Collaborate with AI research teams to ensure evaluation suites reflect real-world engineering tasks.
Qualifications Must-Have
- 3+ years of experience in machine learning engineering or applied ML research.
- Hands-on experience with model development, experimentation, and evaluation.
- Background in ML research (industry lab or academic setting strongly preferred).
- Strong ability to reason about ML system design choices and tradeoffs.
- Clear written communication and high attention to technical detail.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. ,