Senior Software Engineer – Python / TypeScript

Job summary

Create and refine rubrics and evaluation criteria, review and label preference data, and identify quality issues and inconsistencies. Build and maintain data and evaluation pipelines, document findings, and collaborate with researchers and engineers to develop scalable solutions.

Job details

Senior Software Engineer – Python / TypeScript Fully Remote Freelance Contract, 3 Months About the Opportunity We are looking for a Senior Software Engineer with strong expertise in Python or TypeScript to contribute to cutting-edge AI and evaluation projects with a leading AI infrastructure organization. The ideal candidate will have strong software engineering fundamentals, hands-on experience with preference data collection and/or rubric creation, and a strong focus on quality. You should be comfortable working in fast-paced, ambiguous environments and translating complex technical work into clear, actionable outcomes. Role Details Position: Senior Software Engineer – Python / TypeScript Engagement: Freelancer / Contract Duration: 3 Months Work Mode: Fully Remote Start Date: Immediate / Expected to start next week Time Commitment: Minimum 20 hours/week Daily Availability: Minimum 4 hours/day Time Zone: Minimum 4 hours of overlap with PST Key Responsibilities Design, refine, and iterate on rubrics and evaluation criteria for preference data. Review and label data while maintaining a high standard of quality. Identify subtle issues and inconsistencies in data and evaluation outputs. Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation workflows. Analyze findings and translate them into clear, actionable technical documentation and recommendations. Collaborate with researchers and engineers to turn qualitative judgment into scalable processes. Solve complex and ambiguous technical problems with practical, high-quality solutions. Communicate technical concepts clearly and effectively to stakeholders. Required Qualifications 5+ years of professional software engineering experience. Strong proficiency in either Python or TypeScript: Python: Experience building and maintaining pipelines and infrastructure. TypeScript: Experience working with or navigating large codebases; VS Code experience is an advantage. Hands-on experience with preference data collection and/or rubric creation. Strong written and verbal communication skills. Ability to turn complex technical work into clear, structured, and actionable summaries. Strong quality-oriented judgment with the ability to explain why an output or approach meets a high-quality standard. Comfortable working independently in fast-moving and ambiguous environments. Ability to collaborate effectively with engineering and research teams. Preferred Background Experience working with large-scale or complex codebases. Experience building or maintaining data-generation, data-collection, or evaluation pipelines. Exposure to AI/ML, LLMs, model evaluation, or preference-data workflows. What You Can Expect Fully remote working environment. Opportunity to contribute to cutting-edge AI projects. Exposure to AI evaluation, preference data, and large-scale engineering workflows. Collaboration with experienced researchers and engineers working on advanced AI initiatives.

What you’ll do

Create and refine rubrics and evaluation criteria, review and label preference data, and identify quality issues and inconsistencies. Build and maintain data and evaluation pipelines, document findings, and collaborate with researchers and engineers to develop scalable solutions.

Requirements

Requires at least five years of professional software engineering experience, strong proficiency in Python or TypeScript, and hands-on experience with preference data collection or rubric creation. Candidates should communicate clearly, exercise strong quality judgment, and work independently and collaboratively in fast-moving, ambiguous environments.

Listed skills

• Technical Documentation · Preferred
• written communication · Preferred
• Problem solving · Preferred
• Pipeline Development · Preferred
• TypeScript · Preferred
• Python · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Python
• TypeScript
• Software Engineering
• Preference Data Collection
• Rubric Creation
• Data Labeling
• Data Quality Assurance
• Pipeline Development
• Evaluation Workflows
• Technical Documentation
• Problem-Solving
• Written Communication
• Verbal Communication
• Research Collaboration
• Large Codebase Navigation

Job areas

• Software
• Technology
• Engineering
• Data & Analytics
• Science & Research