Senior Software Engineer - Python / TypeScript

Job summary

Design and refine evaluation rubrics and preference-data criteria, and review examples for quality while explaining nuanced issues and tradeoffs. Build or maintain Python or TypeScript tools and pipelines for data collection and evaluation, and write concise, actionable findings for researchers and engineers.

Job details

Help an AI research team turn expert engineering judgment into reliable evaluation workflows. In this contract role, you will combine software engineering with hands-on preference-data and rubric work. What you will do Design and refine evaluation rubrics and preference-data criteria. Review examples with a high bar for quality, explaining subtle issues and tradeoffs. Build or maintain Python or TypeScript tooling and pipelines that support data collection and evaluation. Turn findings into concise, actionable write-ups for researchers and engineers. What we are looking for At least five years of professional experience in Python, especially pipelines or infrastructure, or TypeScript in a large codebase. Hands-on experience collecting preference data or creating evaluation rubrics. Strong technical judgment and clear written and verbal communication. A current LinkedIn profile included on your resume Engagement Remote contract for approximately three months, open to candidates in the United States or Canada. At least 20 hours per week, including four hours of daily overlap with Pacific Time. $100 per hour The selection process includes one approximately 30-minute technical and team conversation.

What you’ll do

Design and refine evaluation rubrics and preference-data criteria, and review examples for quality while explaining nuanced issues and tradeoffs. Build or maintain Python or TypeScript tools and pipelines for data collection and evaluation, and write concise, actionable findings for researchers and engineers.

Requirements

Requires at least five years of professional experience with Python, particularly pipelines or infrastructure, or TypeScript in a large codebase. Candidates must have hands-on experience collecting preference data or creating evaluation rubrics, strong technical judgment, clear communication, and a current LinkedIn profile included on their resume.

Listed skills

• written communication · Preferred
• TypeScript · Preferred
• Python · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Python
• TypeScript
• Software Engineering
• Data Pipelines
• Infrastructure
• Preference Data Collection
• Evaluation Rubrics
• Quality Review
• Technical Judgment
• Written Communication
• Verbal Communication
• Data Collection
• Evaluation Workflows

Job areas

• Software
• Technology
• Engineering
• Data & Analytics
• Science & Research