Online Generalist Jobs in Canada

Job summary

You will perform data labeling for various NLP tasks and create preference data for RLHF. Additionally, you will conduct evaluations and quality checks to improve training data quality.

Job details

Online Generalist Jobs in Canada (Remote) Rex.zone is hiring full-time remote Online Generalists in Canada to support AI/ML data operations that power large language model training pipelines. You will complete online tasks such as data labeling, RLHF preference ranking, prompt evaluation, QA evaluation, and content safety labeling across NLP and computer vision datasets. What You Will Do Perform data labeling for NLP tasks (classification, summarization, named entity recognition) and LLM evaluation workflows Create preference data for RLHF by ranking/scoring model outputs and writing clear rationales Conduct prompt evaluation and response scoring using web-based evaluation interfaces Execute QA evaluation, adjudication, and consistency checks to improve training data quality Handle content safety labeling using policy-based decisions and detailed guidelines Complete computer vision annotation including image tagging, bounding boxes, and segmentation as needed Document edge cases, follow versioned guidelines, and escalate ambiguity appropriately Requirements Based in Canada and able to work full-time remotely Strong reading comprehension, attention to detail, and consistent decision-making Comfortable following detailed annotation guidelines and meeting quality standards Experience in data labeling, QA evaluation, RLHF, or LLM evaluation is preferred but not required Quality Standards Maintain high guideline adherence, low error rates, and responsiveness to feedback Support inter-annotator agreement and training data quality audits through careful self-checks Compensation Competitive hourly rate: $30–$50 per hour How To Apply Apply via Rex.zone and complete the skills screening. Qualified applicants may be invited to paid calibration work, followed by full-time allocation based on project needs and QA performance.

What you’ll do

You will perform data labeling for various NLP tasks and create preference data for RLHF. Additionally, you will conduct evaluations and quality checks to improve training data quality.

Requirements

Candidates must be based in Canada and able to work full-time remotely. Strong reading comprehension and attention to detail are essential, along with a preference for experience in data labeling or related fields.

Listed skills

• Évaluation · Preferred
• responsiveness · Preferred
• Reading comprehension · Preferred
• Organization · Preferred
• Training · Preferred
• Attention to detail · Preferred
• safety · Preferred
• Decision Making · Preferred
• Quality Checks · Preferred
• Time · Preferred
• Consistent · Preferred
• Labeling · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Data Labeling
• Reading Comprehension
• Attention to Detail
• Decision Making
• Annotation Guidelines
• Quality Standards
• NLP
• Computer Vision
• QA Evaluation
• RLHF
• LLM Evaluation
• Content Safety Labeling
• Image Tagging
• Bounding Boxes
• Segmentation

Job areas

• Technology
• Data & Analytics
• Human Resources

More jobs from Rex.zone