AI Personalization Evaluator - Canada

Job summary

Evaluate AI-generated answers for relevance, accuracy, and appropriate use of information from connected Google apps. Compare responses, identify unsupported assumptions or missing information, and provide clear written feedback while following project guidelines.

Job details

Help evaluate how an AI assistant uses information from connected Google apps to respond to personalized prompts. This remote project is for people based in Canada, outside Quebec, who can review AI responses carefully and explain what works and what does not. What you’ll do Evaluate AI-generated answers for relevance, accuracy and appropriate use of context. Compare responses, identify unsupported assumptions or missed information, and provide clear written feedback. Follow project guidelines for consistent, confidential evaluation work. Important account-access requirement This project requires you to connect eligible Google apps to Gemini and grant the permissions needed for personalized evaluations. These may include Gmail, Google Drive, Google Calendar and Google Photos. The evaluation may use information from your connected account history. Please consider the access and consent requirements before applying. Shortlisted candidates will receive the project’s consent and onboarding details before participation. What we’re looking for Currently resident in Canada. Bachelor’s degree or equivalent practical experience in any field. Active use of Google apps with enough account history to support personalized evaluation tasks. Strong analytical judgment, attention to detail and written communication. Desktop or laptop computer and reliable internet access. AI evaluation, annotation, content review or quality assurance experience is helpful but not required. Engagement and pay Remote contractor assignment for up to 16 weeks. Plan for 20 hours per week, with potential for up to 40 hours depending on project needs, and four hours of daily overlap with Pacific Time. $13.00 per hour. Shortlisted applicants may be invited to complete an interest form.

What you’ll do

Evaluate AI-generated answers for relevance, accuracy, and appropriate use of information from connected Google apps. Compare responses, identify unsupported assumptions or missing information, and provide clear written feedback while following project guidelines.

Requirements

Applicants must reside in Canada outside Quebec, have a bachelor’s degree or equivalent practical experience, and actively use Google apps with sufficient account history for personalized evaluations. They also need strong analytical judgment, attention to detail, written communication skills, a computer, and reliable internet; prior AI evaluation or quality assurance experience is helpful but not required.

Listed skills

• written communication · Preferred
• Quality assurance · Preferred
• Attention to detail · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Analytical Judgment
• Attention To Detail
• Written Communication
• Response Evaluation
• Relevance Assessment
• Accuracy Assessment
• Contextual Reasoning
• Comparative Analysis
• Identifying Unsupported Assumptions
• Written Feedback
• Following Guidelines
• Confidentiality
• Google Apps
• AI Evaluation
• Content Review
• Quality Assurance

Job areas

• Technology
• Data & Analytics
• Education