About the role
Role: Software Quality Engineer (Remote)
Location: Remote (Work from Anywhere) Job Type: Full-Time Payout: Competitive, based on experience
Role Overview
We are hiring for one of our clients, seeking a Agentic Coding Annotator - Online / Offline Tasks to work on a full-time basis. This role involves working with realistic coding tasks in an agentic coding harness, reviewing model trajectories, verifying solutions, and producing high-quality annotations. Candidates are expected to read and debug code, validate behavior, follow detailed process rules, and make consistent judgment calls across model runs.
Key Responsibilities
- Execute realistic coding tasks within the assigned agentic coding harness while maintaining model blindness and session independence
- Follow task instructions, milestones, planned interactions, and evaluation guardrails consistently across runs
- Verify model outputs by reading code, running commands, checking logs, and inspecting generated artifacts
- Design multi-step, realistic coding tasks including user intent and milestone structure for offline evaluations
- Write clear, specific, evidence-based rationales for trajectory rankings and assessments
Required Skills & Qualifications
- Proficiency in Python, JavaScript, Java, C++, or SQL for code analysis and debugging
- Experience working with realistic software tasks beyond toy problems or shallow code-review exercises
- Ability to design task-specific rubrics and binary evaluation criteria for model outputs
- Strong attention to detail to ensure high-quality annotations and consistent grading
- Comfort with debugging, test validation, and manual verification of software behavior
More About the Opportunity
This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the advancement and deployment of powerful AI systems. The work directly supports the development of agentic coding models used for mission-critical applications.
Equal Opportunity Employer
We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.
Apply Now!
Not the right fit? Search for Software Quality Engineer jobs in Canada
About Hire Feed
HireFeed: A QuikHire product.
Earn in dollars. On your hours. From wherever.
HireFeed is the AI-curated feed of contract, gig, and AI training jobs that pay in USD, built for the people who actually want to work, not the ones writing job descriptions.
Why it exists: the highest-paying contract work in the world - RLHF, AI evaluation, domain-expert training, senior contract engineering, sits scattered across hundreds of ATS feeds and platform job boards. Most of it never makes it to Indeed or LinkedIn, and the roles that do are usually stale by the time you find them. The best opportunities are also the most ephemeral.
HireFeed pulls from 500+ verified sources, including Outlier, Mercor, Surge AI, Micro1, Turing, Toloka, Appen, and Remotasks, and refreshes every 60 seconds. The moment a role closes at the source, it falls off the feed.
What you'll find here:
- AI training, RLHF, and evaluation: $20–$80/hr
- Domain experts: medical, legal, finance, math (PhD)
- Senior contract engineering, paid weekly
- Multilingual annotation, creative writing training, AI research
What you won't find: pay-undisclosed listings, expired roles, "still accepting applications" lies, recruiter middlemen, or data resale. Pay is a hard requirement. Apply links 302-redirect to the source ATS. We never see your résumé.
Free for candidates, forever. Funded by the partner side.
→ hirefeed.co.in
Similar Jobs
About the role
Role: Software Quality Engineer (Remote)
Location: Remote (Work from Anywhere) Job Type: Full-Time Payout: Competitive, based on experience
Role Overview
We are hiring for one of our clients, seeking a Agentic Coding Annotator - Online / Offline Tasks to work on a full-time basis. This role involves working with realistic coding tasks in an agentic coding harness, reviewing model trajectories, verifying solutions, and producing high-quality annotations. Candidates are expected to read and debug code, validate behavior, follow detailed process rules, and make consistent judgment calls across model runs.
Key Responsibilities
- Execute realistic coding tasks within the assigned agentic coding harness while maintaining model blindness and session independence
- Follow task instructions, milestones, planned interactions, and evaluation guardrails consistently across runs
- Verify model outputs by reading code, running commands, checking logs, and inspecting generated artifacts
- Design multi-step, realistic coding tasks including user intent and milestone structure for offline evaluations
- Write clear, specific, evidence-based rationales for trajectory rankings and assessments
Required Skills & Qualifications
- Proficiency in Python, JavaScript, Java, C++, or SQL for code analysis and debugging
- Experience working with realistic software tasks beyond toy problems or shallow code-review exercises
- Ability to design task-specific rubrics and binary evaluation criteria for model outputs
- Strong attention to detail to ensure high-quality annotations and consistent grading
- Comfort with debugging, test validation, and manual verification of software behavior
More About the Opportunity
This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the advancement and deployment of powerful AI systems. The work directly supports the development of agentic coding models used for mission-critical applications.
Equal Opportunity Employer
We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.
Apply Now!
Not the right fit? Search for Software Quality Engineer jobs in Canada
About Hire Feed
HireFeed: A QuikHire product.
Earn in dollars. On your hours. From wherever.
HireFeed is the AI-curated feed of contract, gig, and AI training jobs that pay in USD, built for the people who actually want to work, not the ones writing job descriptions.
Why it exists: the highest-paying contract work in the world - RLHF, AI evaluation, domain-expert training, senior contract engineering, sits scattered across hundreds of ATS feeds and platform job boards. Most of it never makes it to Indeed or LinkedIn, and the roles that do are usually stale by the time you find them. The best opportunities are also the most ephemeral.
HireFeed pulls from 500+ verified sources, including Outlier, Mercor, Surge AI, Micro1, Turing, Toloka, Appen, and Remotasks, and refreshes every 60 seconds. The moment a role closes at the source, it falls off the feed.
What you'll find here:
- AI training, RLHF, and evaluation: $20–$80/hr
- Domain experts: medical, legal, finance, math (PhD)
- Senior contract engineering, paid weekly
- Multilingual annotation, creative writing training, AI research
What you won't find: pay-undisclosed listings, expired roles, "still accepting applications" lies, recruiter middlemen, or data resale. Pay is a hard requirement. Apply links 302-redirect to the source ATS. We never see your résumé.
Free for candidates, forever. Funded by the partner side.
→ hirefeed.co.in