Freelance Generalist (Canada)

Job summary

Support AI/ML training workflows through data labeling, RLHF evaluation, and QA reviews to improve model performance. Responsibilities include following annotation guidelines, documenting edge cases, and validating labeling accuracy.

Job details

Freelance Generalist Jobs in Canada (Remote) Rex.zone is hiring remote full-time generalists in Canada to support AI/ML training workflows across data labeling, RLHF evaluation, prompt evaluation, and QA evaluation. You will follow detailed annotation guidelines, improve training data quality, and contribute to consistent model performance improvements across multiple domains. Key Workstreams RLHF: preference comparisons, rationale writing, rubric-based scoring, consistency checks Data labeling: text classification, intent tagging, named entity recognition (NER), sentiment, taxonomy mapping Prompt evaluation: instruction-following checks, hallucination detection, groundedness review QA evaluation: second-pass review, dispute resolution, inter-annotator agreement support Computer vision annotation: bounding boxes, segmentation review, attribute tagging (as assigned) Content safety labeling: policy-based labeling for harmful content, privacy, and sensitive categories Responsibilities Follow annotation guidelines and document ambiguities and edge cases Perform RLHF evaluations using scoring rubrics and preference ranking protocols Execute NLP and multimodal labeling tasks (as assigned) Conduct QA evaluation to validate labeling accuracy and reduce defects Evaluate prompts for safety, groundedness, and instruction-following Collaborate asynchronously with project leads to improve workflows Required Qualifications Experience with data labeling, QA evaluation, or LLM evaluation workflows Strong written communication for rationales and edge-case documentation Comfort applying content safety and privacy policies Ability to meet quality targets and throughput expectations in remote production How To Apply Explore current freelance generalist openings on Rex.zone and submit your application with relevant evaluation or labeling experience and samples. Compensation: $30–$50/hr (HOURLY)

What you’ll do

Support AI/ML training workflows through data labeling, RLHF evaluation, and QA reviews to improve model performance. Responsibilities include following annotation guidelines, documenting edge cases, and validating labeling accuracy.

Requirements

Candidates must have experience with data labeling, QA, or LLM evaluation workflows. Strong written communication skills and the ability to apply content safety and privacy policies are required.

Listed skills

• Évaluation · Preferred
• written communication · Preferred
• Training · Preferred
• Attribute · Preferred
• safety · Preferred
• Documentation · Preferred
• Communication · Preferred
• Accuracy · Preferred
• Communication Skills · Preferred
• Consistent · Preferred
• Mapping · Preferred
• Labeling · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Data Labeling
• RLHF Evaluation
• Prompt Evaluation
• QA Evaluation
• Text Classification
• Named Entity Recognition
• Sentiment Analysis
• Computer Vision Annotation
• Content Safety Labeling
• Written Communication
• Instruction Following
• Hallucination Detection

Job areas

• Data & Analytics
• Technology
• Software
• Science & Research
• Engineering

More jobs from Rex.zone