Llm Evaluator | $65/hr Remote Jobs in Canada
Create alert for “LLM Evaluator | $65/hr Remote”
Get notified of new opportunities
You've reached the end
Try refining your search for more options
LLM Evaluator (Prompt Engineer) | $65/hr Remote
About the role
Position: LLM Red-Teamer
Type: Contract
Compensation: $40 - $65/hour
Location: Remote
Commitment: 10-40 hrs/week
Role Responsibilities
Develop complex, adversarial multi-turn conversations and task-based scenarios aligned with project specifications. Author clear, precise evaluation rubrics to assess model responses against defined behavioral targets. Iteratively test conversations and tasks against frontier LLMs, escalating difficulty and nuance. Deliver comprehensive task packages, including transcripts, target behaviors, and supporting rationale. Validate LLM outputs, documenting model strengths and failure modes relative to specifications. Maintain calibration with team leads and quality control contacts as project requirements evolve.
Requirements
Exceptional written English skills with clarity, precision, and strong structural organization. Prior experience in AI human data environments such as RLHF, SFT, evaluations, or prompt engineering. Deep familiarity with large language models and ability to identify common failure patterns. Demonstrated ability to work autonomously, interpreting and executing complex specifications. Proven critical thinking and meticulous attention to detail. Experience designing evaluation items or rubrics is advantageous.
Application Process
Easy Apply on LinkedIn
Check email for next steps Participate in resume evaluation & interview stage
Not the right fit? Search for LLM Evaluator | $65/hr Remote jobs in Canada
About Crossing Hurdles
At Crossing Hurdles, we specialise in customised recruitment and staffing solutions designed to drive success for businesses and professionals. Our focus is on connecting organisations with top-tier talent by sourcing, screening, and presenting only the top 1% of candidates across a wide range of industries. We work closely with clients to understand their unique needs, ensuring that we find candidates who not only fit the role but also align with their organizational culture.
Over the past few quarters, we've successfully partnered with leading companies such as Angel One, Ixigo, Turing, Cars24, Veera, ABP Network, Battery Smart, Zavya, and Twin Engineers. Our expertise spans various sectors, including Tech, Product, Sales, Customer Support, Growth, Finance, and Marketing. At Crossing Hurdles, our mission is to help organizations thrive by matching them with exceptional talent while simultaneously enabling candidates to find opportunities that foster long-term career growth and development.