Opens LinkedIn
- Employment type
- Contract
- Experience level
- Mid-level · 2+ years
- Minimum education
- Bachelor’s degree
- Posting language
- English
- Working hours
- 40 hours per week
- Seniority
- Mid-Senior level
Job summary
Create realistic, natural customer service conversations for AI training and evaluate and rank AI responses for accuracy, fluency, and contextual relevance. Test AI models for inaccuracies and potential biases while following project scenarios and quality guidelines.
Job details
In this hourly, remote contractor role, you will work as a Customer Service Subject Matter Expert (SME) to support the creation of a custom dataset of natural, human-enacted customer service conversations used to train and improve speech-to-speech AI agents. You will participate in realistic customer service scenarios, applying your professional experience in client communication, issue resolution, support workflows, and customer relationship management to ensure conversations accurately reflect real-world interactions. You will demonstrate natural and professional communication, active listening, problem-solving, empathy, and appropriate issue-resolution techniques while following project-specific scenarios, instructions, and quality guidelines. Your contributions will help AI systems learn to handle customer interactions more naturally, accurately, and effectively. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Important There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network. Key Responsibilities Develop AI Training Content: Create natural, human-enacted customer service conversations across realistic support scenarios. Optimize AI Performance: Evaluate and rank AI responses to enhance the model's accuracy, fluency, and contextual relevance. Ensure Model Integrity: Test AI models for potential inaccuracies or biases, validating their reliability across use cases. Your Profile Bachelor’s degree (or higher) in Business Administration, Communications, Marketing, Management, or a related field (or equivalent professional experience). 2+ years of professional Customer Service experience, with demonstrated expertise in client communication, issue resolution, support workflows, and customer relationship management. 1+ year of experience in AI training, such as data annotation, AI evaluation, model training, response evaluation, or similar AI-related work. Strong knowledge of end-to-end customer support workflows, including issue identification, troubleshooting, escalation, follow-up, and resolution. Excellent spoken English C1+ (US only), with clear and fluent verbal communication. Hands-on experience managing customer inquiries, complaints, service requests, and escalations across a range of customer scenarios. Ability to adapt communication style, tone, and approach based on the customer’s needs, situation, and level of concern. Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor environment.
What you’ll do
Create realistic, natural customer service conversations for AI training and evaluate and rank AI responses for accuracy, fluency, and contextual relevance. Test AI models for inaccuracies and potential biases while following project scenarios and quality guidelines.
Requirements
Candidates need a bachelor's degree or higher in a related field, or equivalent professional experience, plus at least two years of customer service experience and one year of AI training or evaluation experience. They must have strong end-to-end support workflow knowledge, excellent spoken English at C1+ level, and the ability to communicate empathetically and adapt to customer needs in a remote contractor role.
Listed skills
- Customer service · Preferred
- issue resolution · Preferred
- Problem solving · Preferred
- Troubleshooting · Preferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Customer Service
- Client Communication
- Issue Resolution
- Customer Support Workflows
- Customer Relationship Management
- Active Listening
- Problem-Solving
- Empathy
- Troubleshooting
- Escalation Management
- Follow-Up
- Spoken English
- AI Training
- Data Annotation
- AI Response Evaluation
- Bias Testing
Job areas
- Customer Service & Support
- Technology
- Data & Analytics
More jobs from SME Careers
Chemical Safety Expert for AI Model Safety Audit
- On-site
- Posted Oct 7, 2026
Persian Team Lead
- Remote
- Canada
- Posted Oct 7, 2026
Physicist
- On-site
- Posted Oct 7, 2026
Materials Scientist
- Remote
- Canada
- Posted Oct 7, 2026
