Senior AI Software Engineer (Remote)

Role: Senior Software Engineer – LLM Evaluation Location: Remote (Work from Anywhere) Job Type: Full-Time Payout: Competitive, based on experience Role Overview: We are hiring for one of our clients, seeking a Senior Software Engineer – LLM Evaluation to work on a full-time basis. You will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in multiple programming languages. Key Responsibilities: • Curate code examples, build solutions, and correct code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go. • Evaluate and refine AI-generated code to ensure efficiency, scalability, and reliability. • Collaborate with cross-functional teams to enhance enterprise-level AI-driven coding solutions against industry performance benchmarks. • Build agents that verify code quality and identify error patterns. • Hypothesize on software engineering cycle steps and evaluate model capabilities on them. Required Skills & Qualifications: • Several years of software engineering experience, including 2+ years at a top-tier product company. • Strong expertise in building full-stack applications. • Experience with Python and JavaScript, including ReactJS. • Proficiency in C/C++, Java, Rust, and Go. • Ability to design verification mechanisms for software engineering tasks. More About the Opportunity: This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the advancement of AI systems that drive measurable business impact. Equal Opportunity Employer: We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications. Apply Now!

The role involves curating code examples, building solutions, and correcting code across multiple programming languages. Additionally, the engineer will evaluate AI-generated code for efficiency and collaborate with teams to enhance AI-driven coding solutions.

Candidates should have several years of software engineering experience, including at least two years at a top-tier product company. Strong expertise in full-stack applications and proficiency in multiple programming languages is required.

Identified from the job description. Confirm important requirements above.

• Python
• JavaScript
• ReactJS
• C/C++
• Java
• Rust
• Go
• Software Engineering
• Full-Stack Development
• AI
• Code Evaluation
• Benchmarking
• Collaboration
• Dataset Creation
• Error Identification
• Code Quality

Minimum experience

5+ years