Statistician & Experimentation Expert

Job summary

Author realistic statistics scenarios and reference answers covering study design, analysis, and interpretation. Evaluate model outputs for methodological soundness and correct interpretation, and flag analyses that draw invalid conclusions.

Job details

Statisticians and experimentation experts in causal inference and A/B testing to build the scenarios frontier AI labs use to test model reasoning. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring statisticians and experimentation experts as contractors to author and grade the causal inference and A/B testing scenarios those evaluations run on. What you'll actually do Author realistic statistics scenarios, from study design through analysis and interpretationWrite reference answers with the statistical reasoning behind each modeling choiceGrade model output for methodological soundness and correct interpretationFlag analyses that read rigorous but draw invalid conclusions Who this is for Statisticians and biostatisticians with an advanced degree in a quantitative fieldPractitioners with at least 2 years of applied statistics or experimentation workExperts with depth in experimental design, causal inference, or A/B testingAnalysts fluent in R or Python who can document the reasoning behind a modeling choice Contract and pay $80 to $150/hr, paid weekly via Stripe. Your rate is set from your experience, not negotiated down after you start.Remote, fully async. No fixed hours.Minimum 10 hours per week, no maximum. Scale up or down week to week.No screen recording, no keystroke monitoring, no idle timers.Independent contractor. Ongoing project work rather than single task batches. How our hiring process works Apply at /apply/statistician-experimentation-expert. About five minutes. Resume plus a few structured questions.Resume review. Every application gets read against a published rubric and gets a decision.Written assessment. You may be asked to take a written assessment for further placement.Onboarding. Sign the contractor agreement, connect Stripe, and get platform access.Project match. You're matched to live work in your specialty, usually within a week of onboarding. About AfterQuery AfterQuery is an expert data lab. We build the evaluation and training data that frontier AI labs use to measure what their models can and can't do in real professional work. Our contributors are practicing professionals, not annotators, and the work is credited, reviewed, and paid at professional rates. Responsibilities Author realistic statistics scenarios from study design through analysis and interpretation Write reference answers with the statistical reasoning behind each modeling choice Grade model output for methodological soundness and correct interpretation Flag analyses that read rigorous but draw invalid conclusions Required Qualifications Advanced degree in statistics, biostatistics, or a closely related quantitative field 2+ years of applied statistics or experimentation experience Depth in experimental design, causal inference, or A/B testing Fluency in R or Python for statistical analysis Able to commit at least 10 hours per week Preferred Qualifications PhD in statistics, biostatistics, or econometrics Experience running large scale experimentation platforms Bayesian methods or advanced causal inference such as instrumental variables or synthetic control Why apply $80 to $150/hr, paid weekly via Stripe 100% remote and fully async Shape how frontier models reason about statistics and causality Ongoing project work with hours you set each week

What you’ll do

Author realistic statistics scenarios and reference answers covering study design, analysis, and interpretation. Evaluate model outputs for methodological soundness and correct interpretation, and flag analyses that draw invalid conclusions.

Requirements

Requires an advanced degree in statistics, biostatistics, or a closely related quantitative field, plus at least two years of applied statistics or experimentation experience. Candidates need expertise in experimental design, causal inference, or A/B testing, fluency in R or Python, and availability for at least 10 hours per week.

Listed skills

• Python · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Statistical Analysis
• Experimental Design
• Causal Inference
• A/B Testing
• Study Design
• R
• Python
• Bayesian Methods
• Instrumental Variables
• Synthetic Control
• Statistical Modeling
• Data Evaluation

Job areas

• Data & Analytics
• Science & Research
• Technology

More jobs from AfterQuery