Opens LinkedIn
- Employment type
- Contract
- Experience level
- Mid-level · 2+ years
- Posting language
- English
- Working hours
- 40 hours per week
- Location requirements
- Country, Montreal, Quebec, Canada
- Seniority
- Entry level
- Application method
- Direct apply is available
Job summary
Design and refine rubrics and evaluation criteria, review and label preference data, and build infrastructure and pipelines for data workflows. Summarize findings and collaborate with researchers and engineers to turn qualitative judgments into scalable processes.
Job details
About Turing: Turing is one of the world's leading AGI infrastructure companies, working with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent. About the Role: We're looking for a high-taste engineer with a strong eye for quality — someone who's worked hands-on with preference data and rubric creation, and knows what separates a good example from a great one. You communicate clearly and can synthesize complex technical work the way a strong MAI dev would: concise, structured, and easy for others to act on. You're comfortable in ambiguous, fast-moving environments and default to shipping over deliberating. What does day-to-day look like: Design, refine, and iterate on rubrics and evaluation criteria for preference data Review and label data with a high bar for quality, catching subtle issues others might miss Build and maintain pipelines/infra that support data generation, collection, and evaluation workflows Synthesize findings from data work into clear write-ups, updates, or recommendations for the team Collaborate closely with researchers/engineers to translate qualitative judgment into scalable processes Required Skills: Proficiency in Python (especially building/maintaining pipelines and infra) or Typescript (experience contributing to or navigating large codebases like VSCode a plus) Hands-on experience with preference data collection and/or rubric creation Strong written and verbal communication — able to distill technical work into clear, actionable summaries Demonstrated high-taste judgment — able to articulate why something is good, not just that it is. Perks of Freelancing With Turing: Work in a fully remote environment. Opportunity to work on cutting-edge AI projects with leading LLM companies. Engagement Details: Compensation: Market rate. Please share a specific rate expectation (rather than a range) so we can quickly assess mutual fit Availability: 40 hours/week preferred, with a minimum 6-hour overlap with Pacific Time. If you're unable to commit to 40 hours, please share your available hours and overlap window Employment Type: Independent contractor (does not include medical or paid leave benefits Duration: 3 months, with an expected start date as soon as possible Evaluation Process (approximately 30 mins): One round of interview (30 mins of technical & cultural discussion)
What you’ll do
Design and refine rubrics and evaluation criteria, review and label preference data, and build infrastructure and pipelines for data workflows. Summarize findings and collaborate with researchers and engineers to turn qualitative judgments into scalable processes.
Requirements
Proficiency in Python or TypeScript is required, along with hands-on experience collecting preference data and/or creating rubrics. Candidates should communicate technical work clearly and demonstrate strong judgment in assessing and explaining quality.
Benefits
- Remote Work
- Opportunity to Work on Cutting-Edge AI Projects
Listed skills
- written communication · Preferred
- Pipeline Development · Preferred
- TypeScript · Preferred
- Python · Preferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Python
- TypeScript
- Pipeline Development
- Infrastructure Maintenance
- Preference Data Collection
- Rubric Creation
- Data Review and Labeling
- Evaluation Criteria Design
- Written Communication
- Verbal Communication
- Technical Writing
- Quality Judgment
- Data Generation
- Data Evaluation
- Scalable Processes
Job areas
- Software
- Technology
- Data & Analytics
- Engineering
- Science & Research
Do this kind of work? Join the Jobs.ca expert list.
One short form. We email you when a paid AI-training project fits your field. Joining does not guarantee work.
Join the listMore jobs from Turing
Remote Physics Expert (PhD)
- Remote
- Toronto, Ontario, Canada
- Posted Oct 12, 2026
Remote Chemistry Expert (PhD)
- Remote
- Toronto, Ontario, Canada
- Posted Oct 12, 2026
Remote Software Engineer - Python/Typescript
- Remote
- Montreal, Quebec, Canada
- Posted Oct 9, 2026
Remote Typescript Engineer
- Remote
- Toronto, Ontario, Canada
- Posted Oct 9, 2026
