Psychonomic Bulletin & Review

, Volume 14, Issue 5, pp 779–804

A practical solution to the pervasive problems ofp values

Theoretical and Review Articles

DOI: 10.3758/BF03194105

Cite this article as:
Wagenmakers, E. Psychonomic Bulletin & Review (2007) 14: 779. doi:10.3758/BF03194105

Abstract

In the field of psychology, the practice ofp value null-hypothesis testing is as widespread as ever. Despite this popularity, or perhaps because of it, most psychologists are not aware of the statistical peculiarities of thep value procedure. In particular,p values are based on data that were never observed, and these hypothetical data are themselves influenced by subjective intentions. Moreover,p values do not quantify statistical evidence. This article reviews thesep value problems and illustrates each problem with concrete examples. The three problems are familiar to statisticians but may be new to psychologists. A practical solution to thesep value problems is to adopt a model selection perspective and use the Bayesian information criterion (BIC) for statistical inference (Raftery, 1995). The BIC provides an approximation to a Bayesian hypothesis test, does not require the specification of priors, and can be easily calculated from SPSS output.

Download to read the full article text

Copyright information

© Psychonomic Society, Inc. 2007

Authors and Affiliations

  1. 1.Department of Psychology, Methodology UnitUniversity of AmsterdamAmsterdamThe Netherlands