Pre-experiment readiness checklist

Walk this checklist with your team right before data collection. Each item prevents a common failure mode.

  • Clear primary question: Primary hypothesis and outcome are written and understood by everyone collecting data.
  • Outcome defined exactly: Units, measurement timing, instruments, calibration steps, and handling rules are documented.
  • Sample plan documented: Planned sample size and how samples will be allocated (per group / total) are recorded.
  • Randomization & labeling: Randomization method and sample labeling prevent operator unblinding and are prepared in advance.
  • Controls prepared: Negative and positive controls are available and validated.
  • Success criteria set: Decision thresholds and next steps are explicit (what counts as success or failure).
  • Analysis plan ready: Primary test method, transformations, and handling of missing/outlier data are documented.
  • Data recording format: Files, column names, and metadata templates are created and shared with the team.
  • Blinding and QA checks: Blinding procedures are tested; a simple QA check is defined to catch obvious errors.
  • Preregistration & provenance: The experiment plan is saved or preregistered and a persistent project ID or folder is set up.

Use this checklist as a rapid gate: if more than two items are incomplete, pause and fix the gaps before proceeding.


Discussion

Comments and conversation will live here.