Back to job search
Alignerr logo

Korean Voice AI Evaluator – Native Korean Speakers

  • Vancouver, British Columbia, Canada
  • Remote
  • Posted Nov 18, 2026
  • 1 position

US$12–US$40 / hour

We’re checking whether this posting is accepting applications.

Browse current jobs
Sign in to save this job
Employment type
Contract
Posting language
English
Location requirements
Country, Vancouver, British Columbia, Canada

Job summary

Conduct short Korean role-play conversations with an AI healthcare receptionist, using fictional patient personas and natural phrases to test its understanding and actions. Review recordings and transcripts, assess response accuracy, and document issues such as mispronunciations, interruptions, delays, and incorrect function calls.

Job details

Korean Voice AI Evaluator (Healthcare Front Desk Conversations) About The Role What if your voice could help teach AI how to handle a real phone call to a hospital or clinic? We're looking for native Korean speakers in Vancouver to hold natural spoken conversations with an AI healthcare receptionist, then evaluate how well it listens, responds, and takes action. Vancouver is home to one of Canada's largest and most vibrant Korean-speaking communities — making it an ideal location for this role. You'll role-play as a patient using fictional personas we provide, record short conversations, and grade the AI's performance, all from the comfort of home. Organization: Alignerr Type: Contract (task-based) Location: Remote Commitment: Flexible, work at your own pace What You'll Do Hold 4 to 5 minute spoken conversations in Korean with an AI front desk assistant, playing a fictional patient Say natural trigger phrases to test whether the AI makes the correct function calls — for example, checking a patient record, booking an appointment, or checking insurance Review transcripts and classify how accurately the AI understood you and responded Flag issues such as mispronunciations, cutoffs, interruptions, delays, and incorrect function calls, including timestamps Test how the AI handles background noise, short replies ("네," "아니요," "괜찮아요"), long numbers, emotional moments, and sensitive or unsafe requests Follow detailed labeling guidelines consistently and submit high-quality work Who You Are Native or near-native Korean speaker with a clear, natural speaking voice Detail-oriented, with the patience to review recordings and transcripts closely Comfortable role-playing a patient and sounding authentic Able to follow multi-step instructions and apply them consistently Reliable and self-directed when working independently Access to a quiet space, a good microphone, a stable internet connection, and a second device for playing background noise Comfortable using web-based tools Nice to Have Experience in voice AI evaluation, data annotation, or QA testing Background in healthcare administration, customer service, or call center work Strong sense of Korean speech levels and politeness (존댓말) in service conversations, and of how Korean numbers are read aloud (native vs. Sino-Korean) Linguistics or language-focused studies Familiarity with medical terminology in Korean Why Join Us Work on cutting-edge AI projects alongside leading research labs Fully remote and flexible — work when and where it suits you Task-based work with real autonomy Directly help make voice AI more accurate, natural, and safe in healthcare settings Potential for ongoing work as new projects launch Note: New contributors complete a short unpaid qualification assessment. Contributors who pass are added to paid production work.

What you’ll do

Conduct short Korean role-play conversations with an AI healthcare receptionist, using fictional patient personas and natural phrases to test its understanding and actions. Review recordings and transcripts, assess response accuracy, and document issues such as mispronunciations, interruptions, delays, and incorrect function calls.

Requirements

Applicants must be native or near-native Korean speakers with a clear speaking voice, strong attention to detail, and the ability to follow detailed instructions while working independently. They need a quiet workspace, a good microphone, stable internet, a second device for playing background noise, and comfort using web-based tools.

Benefits

  • Fully Remote Work
  • Flexible Schedule
  • Autonomous Work
  • Potential for Ongoing Work

Listed skills

  • Attention to detail · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

  • Native or Near-Native Korean
  • Spoken Conversation Evaluation
  • Voice AI Evaluation
  • Data Annotation
  • Quality Assurance Testing
  • Transcript Review
  • Attention to Detail
  • Following Multi-Step Instructions
  • Role-Playing
  • Korean Speech Levels and Politeness
  • Korean Number Pronunciation
  • Healthcare Conversation Evaluation
  • Issue Identification
  • Independent Work
  • Web-Based Tools

Job areas

  • Technology
  • Healthcare
  • Data & Analytics
  • Customer Service & Support

Do this kind of work? Join the Jobs.ca expert list.

One short form. We email you when a paid AI-training project fits your field. Joining does not guarantee work.

Join the list

More jobs from Alignerr

See all jobs from Alignerr