Senior AI Software Engineer (Remote)
The role involves creating and curating high-quality datasets for training and benchmarking large language models. The engineer will evaluate AI-generated code and build agents to verify code quality and identify error patterns.
- Remote
- Canada
- Posted Aug 23, 2026
- 1 position
More jobs you can apply to directly
Similar opportunities posted by employers hiring on Jobs.ca, with no external application form.
Job summary
Role: Senior AI Software Engineer (Remote) Location: Remote (Work from Anywhere) Job Type: Full-Time Payout: Competitive, based on experience Role Overview: We are hiring for one of our clients, seeking a Senior Software Engineer – LLM Evaluation to work on a full-time basis. You will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in multiple programming languages. Key Responsibilities: • Curate code examples, build solutions, and correct code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go. • Evaluate and refine AI-generated code to ensure efficiency, scalability, and reliability. • Collaborate with cross-functional teams to enhance enterprise-level AI-driven coding solutions against industry performance benchmarks. • Build agents that verify code quality and identify error patterns. • Hypothesize on software engineering cycle steps and evaluate model capabilities on them. Required Skills & Qualifications: • Several years of software engineering experience, including 2+ years at a top-tier product company. • Strong expertise in building full-stack applications. • Experience with Python and JavaScript, including ReactJS. • Proficiency in C/C++, Java, Rust, and Go. • Ability to design verification mechanisms for software engineering tasks. More About the Opportunity: This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the advancement of AI systems that drive measurable business impact. Equal Opportunity Employer: We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications. Apply Now!
What you’ll do
The role involves creating and curating high-quality datasets for training and benchmarking large language models. The engineer will evaluate AI-generated code and build agents to verify code quality and identify error patterns.
Requirements
Candidates need several years of software engineering experience, including at least two years at a top-tier product company. Proficiency in multiple languages including Python, JavaScript, C++, Java, Rust, and Go is required.
Listed skills
- GoPreferred
- ReactPreferred
- JavaScriptPreferred
- RustPreferred
- JavaPreferred
- PythonPreferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Python
- JavaScript
- ReactJS
- C/C++
- Java
- Rust
- Go
- LLM Evaluation
- Full-stack Development
- Dataset Curation
- Code Verification
- AI Agent Development
Job areas
- Software
- Technology
- Engineering
- Science & Research
- Data & Analytics
Additional details
- Minimum experience
- 5+ years
- Posting language
- English
- Working hours
- 40 hours per week
- Seniority
- Associate