AI Data Labeling Jobs in Canada
You will label and evaluate text and multimodal content, following strict annotation guidelines. You will also support RLHF and QA workflows to improve model performance and content safety.
- Remote
- Canada
- Posted Apr 9, 2026
- 1 position
Job summary
About The Role Join Rex.zone to produce high-quality training data for machine learning and LLM systems. You will label and evaluate text and multimodal content, follow strict annotation guidelines, and support RLHF and QA workflows that improve model performance and content safety in real-world AI/ML pipelines. Key Responsibilities Execute text and prompt evaluation tasks, including LLM response grading Perform RLHF preference ranking and write clear rationales Conduct QA evaluation checks and dataset audits to improve training data quality Apply named entity recognition (NER) and taxonomy-driven labeling Support computer vision annotation (e.g., bounding boxes, polygons, segmentation) when required Perform content safety labeling and policy-based classification Participate in calibration sessions to reduce inter-annotator disagreement Requirements Hands-on experience with data annotation or evaluation for ML/LLM systems Strong attention to detail and consistent decision-making Comfort working with ambiguity and documenting edge cases Familiarity with RLHF, LLM evaluation, content safety labeling, and QA concepts Ability to work remotely with reliable connectivity and maintain confidentiality Preferred Qualifications Experience with annotation tools, audits, and disagreement resolution workflows Exposure to computer vision annotation and spreadsheet-based QA Bilingual English/French helpful for Canada-focused datasets Compensation Competitive hourly rate: $30–$50/hr.
What you’ll do
You will label and evaluate text and multimodal content, following strict annotation guidelines. You will also support RLHF and QA workflows to improve model performance and content safety.
Requirements
Hands-on experience with data annotation or evaluation for ML/LLM systems is required. Familiarity with RLHF, LLM evaluation, and content safety labeling is also necessary.
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Data Annotation
- Evaluation
- Attention To Detail
- Decision Making
- RLHF
- LLM Evaluation
- Content Safety Labeling
- QA Concepts
- Named Entity Recognition
- Computer Vision Annotation
- Spreadsheet-Based QA
- Bilingual English/French
Job areas
- Technology
- Data & Analytics
- Software
Additional details
- Minimum experience
- 2+ years
- Posting language
- English
- Working hours
- 40 hours per week
- Seniority
- Mid-Senior level
