Remote Python/Typescript Engineer

Job summary

Design and refine rubrics and evaluation criteria, review and label preference data, and build or maintain infrastructure for data generation, collection, and evaluation. Summarize findings and collaborate with researchers and engineers to turn qualitative judgments into scalable processes.

Job details

About Turing: Turing is one of the world's leading AGI infrastructure companies, working with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent. About the Role: We're looking for a high-taste engineer with a strong eye for quality — someone who's worked hands-on with preference data and rubric creation, and knows what separates a good example from a great one. You communicate clearly and can synthesize complex technical work the way a strong MAI dev would: concise, structured, and easy for others to act on. You're comfortable in ambiguous, fast-moving environments and default to shipping over deliberating. What does day-to-day look like: Design, refine, and iterate on rubrics and evaluation criteria for preference data Review and label data with a high bar for quality, catching subtle issues others might miss Build and maintain pipelines/infra that support data generation, collection, and evaluation workflows Synthesize findings from data work into clear write-ups, updates, or recommendations for the team Collaborate closely with researchers/engineers to translate qualitative judgment into scalable processes Required Skills: Proficiency in Python (especially building/maintaining pipelines and infra) or Typescript (experience contributing to or navigating large codebases like VSCode a plus) Hands-on experience with preference data collection and/or rubric creation Strong written and verbal communication — able to distill technical work into clear, actionable summaries Demonstrated high-taste judgment — able to articulate why something is good, not just that it is. Perks of Freelancing With Turing: Work in a fully remote environment. Opportunity to work on cutting-edge AI projects with leading LLM companies. Engagement Details: Compensation: Market rate. Please share a specific rate expectation (rather than a range) so we can quickly assess mutual fit Availability: 40 hours/week preferred, with a minimum 6-hour overlap with Pacific Time. If you're unable to commit to 40 hours, please share your available hours and overlap window Employment Type: Independent contractor (does not include medical or paid leave benefits Duration: 3 months, with an expected start date as soon as possible Evaluation Process (approximately 30 mins): One round of interview (30 mins of technical & cultural discussion)

What you’ll do

Design and refine rubrics and evaluation criteria, review and label preference data, and build or maintain infrastructure for data generation, collection, and evaluation. Summarize findings and collaborate with researchers and engineers to turn qualitative judgments into scalable processes.

Requirements

Candidates need proficiency in Python or TypeScript, hands-on experience with preference data collection or rubric creation, and strong written and verbal communication. They should demonstrate high-quality judgment, explain what makes an example good, and be comfortable working in an ambiguous, fast-moving environment.

Listed skills

• TypeScript · Preferred
• Python · Preferred
• Workflow Automation · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Python
• TypeScript
• Data Pipelines
• Infrastructure
• Preference Data Collection
• Rubric Creation
• Data Labeling
• Evaluation Criteria
• Data Quality Review
• Technical Writing
• Verbal Communication
• Quality Judgment
• Workflow Automation
• Research Collaboration

Job areas

• Software
• Technology
• Engineering
• Data & Analytics
• Science & Research

More jobs from Turing