Design Expert

Design Expert [$80-$150/hr] Experienced designers to evaluate how well AI systems perform real-world design work and define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications Role Responsibilities Design precise, task-specific grading criteria for real-world design deliverables (brand identity systems and guidelines, campaign and marketing visuals, presentation and layout design, packaging concepts, digital and social assets) Score AI-generated and human work samples against those criteria, with detailed written justifications for every score Apply consistent, evidence-based judgment so that scores are reproducible and defensible Incorporate structured feedback from senior reviewers and iterate quickly on your work Good Candidature 5+ years of professional experience in graphic, brand, or visual design Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands Deep fluency in the day-to-day craft: typography, layout and visual hierarchy, color, composition, brand systems, and articulating critique the way a design lead would in a review Exceptionally strong written communication, with the ability to explain exactly why a piece of work does or does not meet the bar Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers Prior experience with AI training, evaluation, or human-data projects is a strong plus

The Design Expert will design precise, task-specific grading criteria for real-world design deliverables and score AI-generated and human work samples against those criteria. They will provide detailed written justifications for every score and incorporate structured feedback from senior reviewers.

Candidates should have 5+ years of professional experience in graphic, brand, or visual design, preferably from world-class design studios or senior roles at leading brands. Strong written communication skills and a deep fluency in design craft are essential, along with a background in AI training or evaluation being a plus.

Identified from the job description. Confirm important requirements above.

• Graphic Design
• Brand Design
• Visual Design
• Typography
• Layout Design
• Visual Hierarchy
• Color Theory
• Composition
• Brand Systems
• Written Communication
• AI Evaluation
• Task-Specific Grading
• Detail Orientation
• Feedback Incorporation
• Design Critique
• Evidence-Based Judgment

• Creative & Media
• Art & Design
• Technology
• Engineering
• Data & Analytics

Minimum experience

5+ years

Posting language

English

Working hours

40 hours per week

Seniority

Mid-Senior level

Application method

Direct apply is available