Psychonomic Bulletin & Review

, Volume 21, Issue 5, pp 1180–1187

The frequency of excess success for articles in Psychological Science

Theoretical Review

DOI: 10.3758/s13423-014-0601-x

Cite this article as:
Francis, G. Psychon Bull Rev (2014) 21: 1180. doi:10.3758/s13423-014-0601-x

Abstract

Recent controversies have questioned the quality of scientific practice in the field of psychology, but these concerns are often based on anecdotes and seemingly isolated cases. To gain a broader perspective, this article applies an objective test for excess success to a large set of articles published in the journal Psychological Science between 2009 and 2012. When empirical studies succeed at a rate much higher than is appropriate for the estimated effects and sample sizes, readers should suspect that unsuccessful findings have been suppressed, the experiments or analyses were improper, or the theory does not properly account for the data. In total, problems appeared for 82 % (36 out of 44) of the articles in Psychological Science that had four or more experiments and could be analyzed.

Keywords

Statistical inference Statistics Probabilistic reasoning 

Supplementary material

13423_2014_601_MOESM1_ESM.zip (2.1 mb)
ESM 1(ZIP 2.06 mb)

Copyright information

© Psychonomic Society, Inc. 2014

Authors and Affiliations

  1. 1.Department of Psychological SciencesPurdue UniversityWest LafayetteUSA

Personalised recommendations