Medical and Health professionals
Create and verify rigorous multiple-choice questions and detailed solutions across various medical and health science domains. Establish gold-standard benchmarks to help advance AI capabilities through expert-level content creation.
- Remote
- Canada
- Posted Aug 19, 2026
- 1 position
Job summary
Applied Health & Medicine Benchmark Specialist [$94-$119/hr] Medical and health science professionals to write and verify rigorous multiple-choice questions across core health and medicine domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities You Will Be Assigned One Of Two Task Types Question Authoring Create original, challenging multiple-choice questions in your area of medical expertise, rate their difficulty, and submit them for review. Question Verification Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made. Health & Medicine Domains Covered Clinical Medicine & Surgery, Medical Imaging & Diagnostics, Pharmacovigilance, Healthcare Management & Economics, Rehabilitation and Allied Health Role Responsibilities Author original health and medicine questions that test deep conceptual understanding, not surface-level recall Ensure questions are unambiguous, self-contained, and precisely defined all necessary information must be in the problem statement Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above) Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format Supply 1 5 academic references per question from reputable sources (peer-reviewed journals, clinical guidelines) For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made Good Candidature MD, DO, PhD, or doctoral candidate in Medicine, Biomedical Sciences, Public Health, or a closely related field Master's degree considered for candidates with exceptional depth in a specific subdomain Strong command of graduate-level medical knowledge, clinical reasoning, and biomedical research methodology Board certification, clinical experience, or research publications in health fields is a strong plus Excellent written English and ability to express complex ideas clearly and concisely More About The Opportunity Expected commitment: 10+ hours/week Asynchronous, fully remote work
What you’ll do
Create and verify rigorous multiple-choice questions and detailed solutions across various medical and health science domains. Establish gold-standard benchmarks to help advance AI capabilities through expert-level content creation.
Requirements
Requires an MD, DO, PhD, or doctoral candidacy in Medicine or Biomedical Sciences, with a Master's degree considered for specific subdomains. Candidates must possess strong graduate-level medical knowledge and the ability to write complex ideas clearly in English.
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Medical Question Authoring
- Clinical Reasoning
- Biomedical Research Methodology
- Medical Imaging & Diagnostics
- Pharmacovigilance
- Healthcare Management
- Clinical Medicine
- Academic Referencing
- Chain-of-Thought Reasoning
- Medical Verification
- Technical Writing
- English Proficiency
Job areas
- Healthcare
- Science & Research
- Education
- Technology
- Consulting
Additional details
- Minimum education
- Master’s degree
- Minimum experience
- 5+ years
- Posting language
- English
- Working hours
- 10 hours per week
- Seniority
- Mid-Senior level
- Application method
- Direct apply is available
