About the role
Role: Quality Analyst (Remote)
Location: Remote (Work from Anywhere) Job Type: Full-Time Payout: Competitive, based on experience
Role Overview
We are hiring for one of our clients, seeking an AI Quality Analyst - English to work on a full-time basis. You will evaluate a new personalization feature for an AI model by assessing how well it integrates information from past conversations, email, search, and activity to deliver relevant responses. This role requires a combination of creative prompt design and analytical evaluation of AI-generated content.
Key Responsibilities
- Evaluate the quality of personalized responses from an AI model using your own personal experiences as context.
- Design creative, multi-turn prompts that test the model’s ability to integrate personal data sources accurately.
- Assess model responses for grounding, integration, and helpfulness, identifying incorrect personalization or forced connections.
- Review side-by-side comparisons of AI responses to detect subtle differences in relevance and accuracy.
- Provide detailed feedback on model behavior to improve personalization performance.
Required Skills & Qualifications
- English proficiency with a high degree of competence in reading and writing.
- Experience in prompt engineering or designing test cases for AI models.
- Ability to analyze nuanced and ambiguous AI responses with analytical rigor.
- Familiarity with personalization concepts and evaluation metrics in AI systems.
- Attention to detail to identify subtle discrepancies in model outputs.
- Willingness to use your primary personal Google account and enable personal data sources for assessment.
- Full-time availability in your local time zone to support a global, 24-hour operations team.
More About the Opportunity
This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the development of advanced AI systems that deliver measurable business impact.
Equal Opportunity Employer
We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.
Apply Now!
Not the right fit? Search for Quality Analyst jobs in Canada
About Hire Feed
HireFeed: A QuikHire product.
Earn in dollars. On your hours. From wherever.
HireFeed is the AI-curated feed of contract, gig, and AI training jobs that pay in USD, built for the people who actually want to work, not the ones writing job descriptions.
Why it exists: the highest-paying contract work in the world - RLHF, AI evaluation, domain-expert training, senior contract engineering, sits scattered across hundreds of ATS feeds and platform job boards. Most of it never makes it to Indeed or LinkedIn, and the roles that do are usually stale by the time you find them. The best opportunities are also the most ephemeral.
HireFeed pulls from 500+ verified sources, including Outlier, Mercor, Surge AI, Micro1, Turing, Toloka, Appen, and Remotasks, and refreshes every 60 seconds. The moment a role closes at the source, it falls off the feed.
What you'll find here:
- AI training, RLHF, and evaluation: $20–$80/hr
- Domain experts: medical, legal, finance, math (PhD)
- Senior contract engineering, paid weekly
- Multilingual annotation, creative writing training, AI research
What you won't find: pay-undisclosed listings, expired roles, "still accepting applications" lies, recruiter middlemen, or data resale. Pay is a hard requirement. Apply links 302-redirect to the source ATS. We never see your résumé.
Free for candidates, forever. Funded by the partner side.
→ hirefeed.co.in
Similar Jobs
About the role
Role: Quality Analyst (Remote)
Location: Remote (Work from Anywhere) Job Type: Full-Time Payout: Competitive, based on experience
Role Overview
We are hiring for one of our clients, seeking an AI Quality Analyst - English to work on a full-time basis. You will evaluate a new personalization feature for an AI model by assessing how well it integrates information from past conversations, email, search, and activity to deliver relevant responses. This role requires a combination of creative prompt design and analytical evaluation of AI-generated content.
Key Responsibilities
- Evaluate the quality of personalized responses from an AI model using your own personal experiences as context.
- Design creative, multi-turn prompts that test the model’s ability to integrate personal data sources accurately.
- Assess model responses for grounding, integration, and helpfulness, identifying incorrect personalization or forced connections.
- Review side-by-side comparisons of AI responses to detect subtle differences in relevance and accuracy.
- Provide detailed feedback on model behavior to improve personalization performance.
Required Skills & Qualifications
- English proficiency with a high degree of competence in reading and writing.
- Experience in prompt engineering or designing test cases for AI models.
- Ability to analyze nuanced and ambiguous AI responses with analytical rigor.
- Familiarity with personalization concepts and evaluation metrics in AI systems.
- Attention to detail to identify subtle discrepancies in model outputs.
- Willingness to use your primary personal Google account and enable personal data sources for assessment.
- Full-time availability in your local time zone to support a global, 24-hour operations team.
More About the Opportunity
This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the development of advanced AI systems that deliver measurable business impact.
Equal Opportunity Employer
We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.
Apply Now!
Not the right fit? Search for Quality Analyst jobs in Canada
About Hire Feed
HireFeed: A QuikHire product.
Earn in dollars. On your hours. From wherever.
HireFeed is the AI-curated feed of contract, gig, and AI training jobs that pay in USD, built for the people who actually want to work, not the ones writing job descriptions.
Why it exists: the highest-paying contract work in the world - RLHF, AI evaluation, domain-expert training, senior contract engineering, sits scattered across hundreds of ATS feeds and platform job boards. Most of it never makes it to Indeed or LinkedIn, and the roles that do are usually stale by the time you find them. The best opportunities are also the most ephemeral.
HireFeed pulls from 500+ verified sources, including Outlier, Mercor, Surge AI, Micro1, Turing, Toloka, Appen, and Remotasks, and refreshes every 60 seconds. The moment a role closes at the source, it falls off the feed.
What you'll find here:
- AI training, RLHF, and evaluation: $20–$80/hr
- Domain experts: medical, legal, finance, math (PhD)
- Senior contract engineering, paid weekly
- Multilingual annotation, creative writing training, AI research
What you won't find: pay-undisclosed listings, expired roles, "still accepting applications" lies, recruiter middlemen, or data resale. Pay is a hard requirement. Apply links 302-redirect to the source ATS. We never see your résumé.
Free for candidates, forever. Funded by the partner side.
→ hirefeed.co.in