About The Role

AI Training Jobs in Canada focus on building and evaluating AI/ML training data for LLM training pipelines. In this full-time remote role, you will label and evaluate text, image, and multimodal data to improve training data quality and model performance.

What You Will Do

Perform data labeling for NLP, LLM, and computer vision annotation tasks

Execute RLHF ranking and pairwise preference judgments Run QA evaluation checks and maintain annotation guidelines compliance Conduct prompt evaluation and response grading for helpfulness, correctness, and safety Apply content safety labeling (e.g., harassment, self-harm, adult content) Document edge cases, write clear rationales, and escalate ambiguous examples Collaborate asynchronously with cross-functional teams while following secure data handling practices

Required Qualifications

Mid-Senior experience in AI/ML data operations, evaluation, or large-scale annotation programs Strong analytical writing and rubric-driven decision-making Familiarity with LLM training pipelines, dataset QA, and common annotation error sources Experience with NLP (classification, NER) and/or computer vision annotation workflows Ability to meet throughput targets and maintain high agreement rates in remote settings

Workflow and Tools

Queue-based task routing with SLAs, audit trails, and spot audits

Calibration sessions, gold-standard checks, and feedback loops Issue tracking for edge cases and guideline updates Privacy-first, secure remote work practices

Compensation

Hourly rate: $30–$50/hr (USD)