Board Game Expert (Remote)

Job summary

Create and review board-game reasoning tasks, analyze game scenarios and rule systems, and evaluate AI responses for correctness and reasoning quality. Develop prompts, rubrics, benchmarks, and quality assurance processes while collaborating with project teams to improve datasets and evaluation methods.

Job details

Role Title: Board Game Expert (Remote) Role Type: Full-time Location: Remote Role Overview We are seeking Board Game Reasoning Experts to help train and evaluate next-generation AI models. In this role, you will leverage your expertise in board games, game mechanics, strategic reasoning, probability, and complex rule systems to create, review, and evaluate high-quality datasets that improve AI performance. You will work on challenging tasks involving game logic, decision-making, strategic planning, rule interpretation, and scenario analysis, helping frontier AI systems develop stronger reasoning capabilities. What Does Day-to-Day Look Like? 1. Create and review game-based reasoning tasks designed to evaluate AI systems. 2. Analyze board game scenarios, strategic decision trees, and rule-based systems. 3. Evaluate AI-generated responses for correctness, consistency, and reasoning quality. 4. Develop prompts, rubrics, and evaluation guidelines for board game and strategy-focused tasks. 5. Identify logical errors, rule violations, and flawed reasoning in AI outputs. 6. Contribute to benchmark creation and quality assurance processes for AI evaluation projects. 7. Collaborate with project teams to improve dataset quality and evaluation methodologies. Required Qualifications 1. Bachelor's degree in Computer Science, Mathematics, Cognitive Science, Game Design, Philosophy, Economics, or a related analytical field. 2. 2+ years of professional or semi-professional experience in board game design, playtesting, tabletop game communities, or related strategy-focused environments. 3. Strong understanding of logic, probabilistic reasoning, game mechanics, and complex rule systems. 4. Background in game theory, behavioral economics, decision science, or formal logic. 5. Familiarity with modern board games, trading card games (TCGs), tabletop RPGs, strategy games, or competitive game systems. 6. Strong analytical and problem-solving skills. 7. Excellent written communication skills. Preferred Qualifications 1. Prior experience in data annotation, AI training, prompt engineering, QA, game design, puzzle design, or rules-based system analysis. 2. Experience creating evaluation rubrics, benchmark datasets, or quality assurance frameworks. 3. Experience with Python, SQL, or data analysis tools. 4. Experience working on RLHF, model evaluation, synthetic data generation, or LLM benchmarking projects. 5. Familiarity with recently released strategy or tabletop games and the ability to quickly learn new rule systems. Offer Details 1. Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST. 2. Engagement type : Contractor assignment (no medical/paid leave) 3. Duration of contract : 2 months; [expected start date is next week] Evaluation Process 1. Take home Assessment What You’ll Do 1. Create and review game-based reasoning tasks designed to evaluate AI systems. 2. Analyze board game scenarios, strategic decision trees, and rule-based systems. 3. Evaluate AI-generated responses for correctness, consistency, and reasoning quality. 4. Develop prompts, rubrics, and evaluation guidelines for board game and strategy-focused tasks. 5. Identify logical errors, rule violations, and flawed reasoning in AI outputs. 6. Contribute to benchmark creation and quality assurance processes for AI evaluation projects. Apply Now!

What you’ll do

Create and review board-game reasoning tasks, analyze game scenarios and rule systems, and evaluate AI responses for correctness and reasoning quality. Develop prompts, rubrics, benchmarks, and quality assurance processes while collaborating with project teams to improve datasets and evaluation methods.

Requirements

Requires a bachelor's degree in a relevant analytical field, at least two years of professional or semi-professional experience in board games or a related strategy-focused environment, and strong analytical, logical, and written communication skills. Candidates should understand game mechanics and probabilistic reasoning; experience with AI evaluation, data annotation, rubrics, Python, or SQL is preferred.

Listed skills

• Decision Making · Preferred
• prompt engineering · Preferred
• Quality assurance · Preferred
• Python · Preferred
• SQL · Preferred
• written communication · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Board Game Mechanics
• Strategic Reasoning
• Probabilistic Reasoning
• Game Theory
• Formal Logic
• Decision-Making
• Rule Interpretation
• Data Annotation
• Prompt Engineering
• Quality Assurance
• Evaluation Rubric Development
• Benchmark Creation
• Python
• SQL
• Written Communication

Job areas

• Technology
• Data & Analytics
• Science & Research
• Sports & Recreation

More jobs from Joblet-AI