Statistics and Computing

, Volume 24, Issue 6, pp 997–1016

Understanding predictive information criteria for Bayesian models

Article

DOI: 10.1007/s11222-013-9416-2

Cite this article as:
Gelman, A., Hwang, J. & Vehtari, A. Stat Comput (2014) 24: 997. doi:10.1007/s11222-013-9416-2

Abstract

We review the Akaike, deviance, and Watanabe-Akaike information criteria from a Bayesian perspective, where the goal is to estimate expected out-of-sample-prediction error using a bias-corrected adjustment of within-sample error. We focus on the choices involved in setting up these measures, and we compare them in three simple examples, one theoretical and two applied. The contribution of this paper is to put all these information criteria into a Bayesian predictive context and to better understand, through small examples, how these methods can apply in practice.

Keywords

AIC DIC WAIC Cross-validation Prediction Bayes 

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  1. 1.Department of StatisticsColumbia UniversityNew YorkUSA
  2. 2.Department of StatisticsHarvard UniversityCambridgeUSA
  3. 3.Department of Biomedical Engineering and Computational ScienceAalto UniversityEspooFinland

Personalised recommendations