Data Science & Quantitative AI Evaluation Specialist

Job summary

Evaluate AI-generated outputs across data science, statistics, and machine learning to identify methodological flaws and inaccuracies. Create expert-level prompts, datasets, and reference solutions to improve AI model capabilities.

Job details

About Gramian Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs. About the Role We are looking for Data Scientists and Quantitative Professionals to help evaluate and improve next-generation AI models. You will assess AI-generated solutions to problems involving statistics, machine learning, experimentation, and quantitative reasoning. You will also create challenging prompts, datasets, and verified reference solutions while identifying methodological flaws, statistical errors, and weaknesses in analytical reasoning. This role is ideal for candidates with relevant professional experience in technology, finance, or research who can communicate technical concepts clearly. SENIORITY: Junior / Early-Career Professional LANGUAGE: Strong written English LOCATION: Remote — English-speaking countries Key Responsibilities Evaluate AI-generated outputs across data science, statistics, machine learning, experimentation, and quantitative problem-solving. Create expert-level prompts, datasets, and reference solutions for AI training and evaluation. Identify flawed methodologies, statistical inaccuracies, unsupported assumptions, and weaknesses in quantitative reasoning. Assess the correctness, reliability, and clarity of analytical approaches and conclusions. Provide structured, evidence-based feedback to help improve AI model capabilities. Apply consistent evaluation criteria and communicate technical findings clearly. At least one year of experience working at a top company (tech, finance, or research), and 3 years of experience (overall) working in DS/SWE To hold a Bachelor’s degree on DS/SWE (or related) from any university in US/CA/AU/NZ/UK Foundational knowledge of data science, statistics, machine learning, or quantitative analysis. Strong analytical and critical-thinking skills, with the ability to identify errors in data-driven reasoning. Excellent written English and the ability to explain technical and statistical concepts clearly. Ability to evaluate complex problems systematically and provide accurate, well-supported feedback. Current residence in an English-speaking country.

What you’ll do

Evaluate AI-generated outputs across data science, statistics, and machine learning to identify methodological flaws and inaccuracies. Create expert-level prompts, datasets, and reference solutions to improve AI model capabilities.

Requirements

Requires a bachelor's degree in Data Science, Software Engineering, or a related field. Candidates must have at least three years of overall experience, including one year at a top-tier company.

Listed skills

• Problem solving · Preferred
• Machine learning · Preferred
• Critical Thinking · Preferred
• prompt engineering · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Data Science
• Quantitative Analysis
• Machine Learning
• Statistics
• Prompt Engineering
• Critical Thinking
• Analytical Reasoning
• Technical Writing
• Problem Solving
• Data Evaluation
• Methodology Assessment
• Software Engineering
• Analytical Thinking
• Research
• Artificial Intelligence
• English Language
• Finance
• Leadership
• Written English

Job areas

• Data & Analytics
• Technology
• Software
• Consulting
• Science & Research
• Data Scientist/Quantitative Analyst
• Data Scientist
• Systems Analysts
• Data Scientists

More jobs from Gramian Consulting