Experimentation toolbox

Practical checklists, runbooks, and templates to standardize setup, sampling, controls, and execution and reduce avoidable experimental variability.


Checklist

Experiment design and setup checklist

An interactive checklist to confirm an experiment is designed to produce interpretable, reproducible results. Walk through hypothesis, endpoints, controls, sampling and power, protocols, pre-registration, data capture and QC, stopping rules, analysis plans, and compliance. Save answers and notes to record readiness and next steps.

Members:
Runbook

Experiment Setup Runbook — reproducible execution steps

A practical, ready-to-use runbook template to standardize experiment setup, pre-run checks, stepwise execution with expected durations, structured data logging fields, shutdown and data export steps, and a troubleshooting quick guide to reduce variability and preventable errors.

Members:
Checklist

Experiment design & pre-registration checklist

Interactive checklist to design, document, and pre-register robust experiments. Captures the research question, hypothesis, design choices, randomization and blinding, sample-size and power details, analysis plan, success criteria, reproducibility and data-sharing plans, ethics and preregistration status, and sign-off — stored for repeatable organizational memory.

Members:
Template

Experiment Protocol & Pre-registration Template

A practical, section-by-section experiment protocol and preregistration template that teams can complete prior to data collection. Includes clear prompts for objectives, outcomes, methods, randomization, sample-size justification, data capture formats, QA checks, analysis plans, versioning, and sign-offs—plus a short pre-registration checklist and tips to improve reproducibility.

Members: