Product Manager - Remote

Job summary

Evaluate AI-generated specifications, release notes, user-facing content, and stakeholder communications for clarity, accuracy, usefulness, tone, and compliance with instructions. Provide detailed rationales and actionable feedback, identify inaccuracies or unmet user needs, and collaborate asynchronously to maintain evaluation quality and consistency.

Job details

Product Manager / Product Owner Role Type: Contractor Location: Remote We are seeking experienced Product Managers and Product Owners to contribute to a customer project focused on evaluating and improving advanced AI systems. You'll apply your product expertise to assess AI-generated content, specifications, and product documentation. No prior AI experience is required. This is strictly an evaluation and analysis role. It does not involve roadmap ownership, delivery management, sprint facilitation, stakeholder leadership, or program management. Candidates should have strong product management or product ownership experience. Scope of Work Evaluate and compare AI-generated specifications, release notes, user-facing content, and stakeholder communications. Assess responses for clarity, accuracy, tone, usefulness, and adherence to instructions. Provide detailed rationales and actionable feedback for each evaluation. Identify content that is fluent but fails to address the intended question or user need. Detect factual inaccuracies, inconsistencies, and violations of prompt requirements. Collaborate virtually and asynchronously with project managers and reviewers to maintain evaluation quality and consistency. Preferred Qualifications Professional experience as a Product Manager or Product Owner. Native-level English fluency and excellent written communication skills. Experience creating and reviewing PRDs, specifications, acceptance criteria, release notes, or decision documents. Ability to evaluate content for technical stakeholders, executives, and end users. Strong critical analysis, attention to detail, and written feedback skills. Ability to work independently and meet deadlines in a remote environment. Familiarity with AI model evaluation, RLHF, or annotation is a plus, but not required.

What you’ll do

Evaluate AI-generated specifications, release notes, user-facing content, and stakeholder communications for clarity, accuracy, usefulness, tone, and compliance with instructions. Provide detailed rationales and actionable feedback, identify inaccuracies or unmet user needs, and collaborate asynchronously to maintain evaluation quality and consistency.

Requirements

Candidates should have professional experience as a Product Manager or Product Owner, excellent written English, and experience creating or reviewing product documents such as specifications, acceptance criteria, or release notes. Strong critical analysis, attention to detail, independent remote work, and the ability to meet deadlines are required; AI evaluation experience is a plus but not required.

Listed skills

• Product management · Preferred
• written communication · Preferred
• Attention to detail · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Product Management
• Product Ownership
• AI Content Evaluation
• Specification Review
• Product Documentation
• Critical Analysis
• Written Communication
• Attention To Detail
• Actionable Feedback
• Requirements Analysis
• Technical Communication
• Asynchronous Collaboration
• Quality Evaluation
• Deadline Management

Job areas

• Management & Leadership
• Technology
• Data & Analytics

More jobs from YO AI Labs