Opens LinkedIn
- Employment type
- Full-time
- Minimum education
- Master’s degree
- Posting language
- English
Job summary
Create realistic statistics scenarios covering study design, analysis, and interpretation, and write reference answers explaining the statistical reasoning behind modeling choices. Evaluate AI model outputs for methodological soundness and correct interpretation, and flag analyses that appear rigorous but reach invalid conclusions.
Job details
Statisticians and experimentation experts in causal inference and A/B testing to build the scenarios frontier AI labs use to test model reasoning. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring statisticians and experimentation experts as contractors to author and grade the causal inference and A/B testing scenarios those evaluations run on. What you'll actually do Author realistic statistics scenarios, from study design through analysis and interpretationWrite reference answers with the statistical reasoning behind each modeling choiceGrade model output for methodological soundness and correct interpretationFlag analyses that read rigorous but draw invalid conclusions Who this is for Statisticians and biostatisticians with an advanced degree in a quantitative fieldPractitioners with at least 2 years of applied statistics or experimentation workExperts with depth in experimental design, causal inference, or A/B testingAnalysts fluent in R or Python who can document the reasoning behind a modeling choice Contract and pay $80 to $150/hr, paid weekly via Stripe. Your rate is set from your experience, not negotiated down after you start.Remote, fully async. No fixed hours.Minimum 10 hours per week, no maximum. Scale up or down week to week.No screen recording, no keystroke monitoring, no idle timers.Independent contractor. Ongoing project work rather than single task batches. How our hiring process works Apply at /apply/statistician-experimentation-expert. About five minutes. Resume plus a few structured questions.Resume review. Every application gets read against a published rubric and gets a decision.Written assessment. You may be asked to take a written assessment for further placement.Onboarding. Sign the contractor agreement, connect Stripe, and get platform access.Project match. You're matched to live work in your specialty, usually within a week of onboarding. About AfterQuery AfterQuery is an expert data lab. We build the evaluation and training data that frontier AI labs use to measure what their models can and can't do in real professional work. Our contributors are practicing professionals, not annotators, and the work is credited, reviewed, and paid at professional rates. Responsibilities Author realistic statistics scenarios from study design through analysis and interpretation Write reference answers with the statistical reasoning behind each modeling choice Grade model output for methodological soundness and correct interpretation Flag analyses that read rigorous but draw invalid conclusions Required Qualifications Advanced degree in statistics, biostatistics, or a closely related quantitative field 2+ years of applied statistics or experimentation experience Depth in experimental design, causal inference, or A/B testing Fluency in R or Python for statistical analysis Able to commit at least 10 hours per week Preferred Qualifications PhD in statistics, biostatistics, or econometrics Experience running large scale experimentation platforms Bayesian methods or advanced causal inference such as instrumental variables or synthetic control Why apply $80 to $150/hr, paid weekly via Stripe 100% remote and fully async Shape how frontier models reason about statistics and causality Ongoing project work with hours you set each week
What you’ll do
Create realistic statistics scenarios covering study design, analysis, and interpretation, and write reference answers explaining the statistical reasoning behind modeling choices. Evaluate AI model outputs for methodological soundness and correct interpretation, and flag analyses that appear rigorous but reach invalid conclusions.
Requirements
Applicants must have an advanced degree in statistics, biostatistics, or a closely related quantitative field, at least two years of applied statistics or experimentation experience, and expertise in experimental design, causal inference, or A/B testing. Fluency in R or Python and a commitment of at least 10 hours per week are required.
Listed skills
- Python · Preferred
Other relevant skills
Identified from the job description. Confirm important requirements above.
- Statistical Analysis
- Experimental Design
- Causal Inference
- A/B Testing
- Study Design
- Statistical Modeling
- Model Evaluation
- Methodological Review
- R
- Python
- Bayesian Methods
- Instrumental Variables
- Synthetic Control
- Technical Writing
Job areas
- Data & Analytics
- Science & Research
- Technology
More jobs from AfterQuery
Structural Engineer Expert
- Remote
- Canada
- Posted Nov 19, 2026
Biostatistics Expert
- Remote
- Canada
- Posted Nov 19, 2026
Bilingual Audio Contributor (Danish/English)
- On-site
- Posted Nov 19, 2026
Bilingual Audio Contributor (Bulgarian/English)
- On-site
- Posted Nov 19, 2026
