, Volume 75, Issue 5, pp 781-783

Registered Reports and Replications in Attention, Perception, & Psychophysics

  • show all 0 hide
This is an excerpt from the content

Attention, Perception, & Psychophysics is launching a new type of research report: Registered Reports and Replications (RRR). Here is why we are trying this experiment. APP is always interested in strengthening the reliability and validity of the results in our science. However, there has been a recent rise in concern about several pitfalls on that road. These include the following:

  1. Publication bias: Studies that yield statistically “significant” results get published, while those that don’t stay in the file drawer. The file drawer problem makes it difficult to evaluate how replicable a finding might be. If 20 people independently run the same study, 1 will get published; in the most dire case, 1 person might run 20 experiments and publish the one that beats p < .05. This can lead to a proliferation of nonreplicable effects in the literature.

  2. P-hacking (Simmons, Nelson, & Simonsohn, 2011): This covers a range of dangerous practices designed to get the p-value under the magic p < .05