Pre-experiment readiness checklist
Walk this checklist with your team right before data collection. Each item prevents a common failure mode.
- Clear primary question: Primary hypothesis and outcome are written and understood by everyone collecting data.
- Outcome defined exactly: Units, measurement timing, instruments, calibration steps, and handling rules are documented.
- Sample plan documented: Planned sample size and how samples will be allocated (per group / total) are recorded.
- Randomization & labeling: Randomization method and sample labeling prevent operator unblinding and are prepared in advance.
- Controls prepared: Negative and positive controls are available and validated.
- Success criteria set: Decision thresholds and next steps are explicit (what counts as success or failure).
- Analysis plan ready: Primary test method, transformations, and handling of missing/outlier data are documented.
- Data recording format: Files, column names, and metadata templates are created and shared with the team.
- Blinding and QA checks: Blinding procedures are tested; a simple QA check is defined to catch obvious errors.
- Preregistration & provenance: The experiment plan is saved or preregistered and a persistent project ID or folder is set up.
Use this checklist as a rapid gate: if more than two items are incomplete, pause and fix the gaps before proceeding.
Discussion
Comments and conversation will live here.