Behavior Research Methods

, Volume 38, Issue 1, pp 24–27

SNOOP: A program for demonstrating the consequences of premature and repeated null hypothesis testing


DOI: 10.3758/BF03192746

Cite this article as:
Strube, M.J. Behavior Research Methods (2006) 38: 24. doi:10.3758/BF03192746


The ease with which data can be collected and analyzed via personal computer makes it potentially attractive to “peek” at the data before a target sample size is achieved. This tactic might seem appealing because data collection could be stopped early, which would save valuable resources, if a peek revealed a significant effect. Unfortunately, such data snooping comes with a cost. When the null hypothesis is true, the Type I error rate is inflated, sometimes quite substantially. If the null hypothesis is false, premature significance testing leads to inflated estimates of power and effect size. This program provides simulation results for a wide variety of premature and repeated null hypothesis testing scenarios. It gives researchers the ability to know in advance the consequences of data peeking so that appropriate corrective action can be taken.

Download to read the full article text

Copyright information

© Psychonomic Society, Inc. 2006

Authors and Affiliations

  1. 1.Department of PsychologyWashington UniversitySt. Louis

Personalised recommendations