Abstract
The Akaike information criterion (AIC; Akaike, 1973) is a popular method for comparing the adequacy of multiple, possibly nonnested models. Current practice in cognitive psychology is to accept a single model on the basis of only the “raw” AIC values, making it difficult to unambiguously interpret the observed AIC differences in terms of a continuous measure such as probability. Here we demonstrate that AIC values can be easily transformed to so-called Akaike weights (e.g., Akaike, 1978, 1979; Bozdogan, 1987; Burnham & Anderson, 2002), which can be directly interpreted as conditional probabilities for each model. We show by example how these Akaike weights can greatly facilitate the interpretation of the results of AIC model comparison procedures.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Aitchison, J., &Dunsmore, I. R. (1975).Statistical prediction analysis. Cambridge: Cambridge University Press.
Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B. N. Petrov & F. Caski (Eds.),Proceedings of the Second International Symposium on Information Theory (pp. 267–281). Budapest: Akademiai Kiado.
Akaike, H. (1974). A new look at the statistical model identification.IEEE Transactions on Automatic Control,19, 716–723.
Akaike, H. (1978). On the likelihood of a time series model.The Statistician,27, 217–235.
Akaike, H. (1979). A Bayesian extension of the minimum AIC procedure of autoregressive model fitting.Biometrika,66, 237–242.
Akaike, H. (1983). Information measures and model selection.Proceedings of the 44th Session of the International Statistical Institute,1, 277–291.
Akaike, H. (1987). Factor analysis and AIC.Psychometrika,52, 317–332.
Boltzmann, L. (1877). Über die Beziehung zwischen dem zweiten Hauptsatze der mechanischen Wärmetheorie und der Wahrscheinlichkeitsrechnung respektive den Sätzen über das Wärmegleichgewicht.Wiener Berichte,76, 373–435.
Bozdogan, H. (1987). Model selection and Akaike’s information criterion (AIC): The general theory and its analytical extensions.Psychometrika,52, 345–370.
Buckland, S. T., Burnham, K. P., &Augustin, N. H. (1997). Model selection: An integral part of inference.Biometrics,53, 603–618.
Burnham, K. P., &Anderson, D. R. (2001). Kullback-Leibler information as a basis for strong inference in ecological studies.Wildlife Research,28, 111–119.
Burnham, K. P., &Anderson, D. R. (2002).Model selection and multimodel inference: A practical information-theoretic approach. New York: Springer-Verlag.
Efron, B. (1986). How biased is the apparent error rate of a prediction rule?Journal of the American Statistical Association,81, 416–470.
Eid, M., &Langeheine, R. (1999). Latent class models.Psychological Method,4, 100–116.
Eliason, S. R. (1993).Maximum likelihood estimation: Logic and practice. Newbury Park, CA: Sage.
Golan, A. (Ed.) (2002). Information and entropy econometrics [Special issue].Journal of Econometrics,107 (1–2).
Hastie, T., Tibshirani, R., &Friedman, J. (2001).The elements of statistical learning: Data mining, inference, and prediction. New York: Springer-Verlag.
Hurvich, C. M., &Tsai, C.-L. (1995). Model selection for extended quasi-likelihood models in small samples.Biometrics,51, 1077–1084.
Jöreskog, K. G., &Sörbom, D. (1996).LISREL 8: User’s reference guide. Hillsdale, NJ: Erlbaum.
Kass, R. E., &Raftery, A. E. (1995). Bayes factors.Journal of the American Statistical Association,90, 773–795.
Kullback, S., &Leibler, R. A. (1951). On information and sufficiency.Annals of Mathematical Statistics,22, 79–86.
Maddox, W. T., &Ashby, F. G. (1993). Comparing decision bound and exemplar models of categorization.Perception & Psychophysics,53, 49–70.
Maddox, W. T., &Bohil, C. J. (2001). Feedback effects on cost-benefit learning in perceptual categorization.Memory & Cognition,29, 598–615.
McQuarrie, A. D. R., &Tsai, C.-L. (1998).Regression and time series model selection. Singapore: World Scientific.
Myung, I. J., Forster, M. R., & Browne, M. W. (Eds.) (2000). Model selection [Special issue].Journal of Mathematical Psychology,44(1).
Myung, I. J., &Pitt, M. A. (1997). Applying Occam’s razor in modeling cognition: A Bayesian approach.Psychonomic Bulletin & Review,4, 79–95.
Nosofsky, R. M. (1998). Selective attention and the formation of linear decision boundaries: Reply to Maddox and Ashby (1998).Journal of Experimental Psychology: Human Perception & Performance,24, 322–339.
Parzen, E., Tanabe, K., &Kitagawa, G. (Eds.) (1998).Selected papers of Hirotugu Akaike. New York: Springer-Verlag.
Ploeger, A., van der Maas, H. L. J., &Hartelman, P. A. I. (2002). Stochastic catastrophe analysis of switches in the perception of apparent motion.Psychonomic Bulletin & Review,9, 26–42.
Raijmakers, M. E. J., Dolan, C. V., &Molenaar, P. C. M. (2001). Finite mixture distribution models of simple discrimination learning.Memory & Cognition,29, 659–677.
Royall, R. M. (1997).Statistical evidence: A likelihood paradigm. London: Chapman & Hall.
Sakamoto, Y., Ishiguro, M., &Kitagawa, G. (1986).Akaike information criterion statistics. Dordrecht: Reidel.
Schwarz, G. (1978). Estimating the dimension of a model.Annals of Statistics,6, 461–464.
Smith, P. L. (1998). Attention and luminance detection: A quantitative analysis.Journal of Experimental Psychology: Human Perception & Performance,24, 105–133.
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., &van der Linde, A. (2002). Bayesian measures of model complexity and fit.Journal of the Royal Statistical Society: Series B,64, 1–34.
Sugiura, N. (1978). Further analysis of the data by Akaike’s information criterion and the finite corrections.Communications in Statistics, Theory & Methods,A7, 13–26.
Takane, Y., & Bozdogan, H. (Eds.) (1987). AIC model selection [Special issue].Psychometrika,52(3).
Thomas, R. D. (2001). Perceptual interactions of facial dimensions in speeded classification and identification.Perception & Psychophysics,63, 625–650.
Wasserman, L. (2000). Bayesian model selection and model averaging.Journal of Mathematical Psychology,44, 92–107.
Author information
Authors and Affiliations
Corresponding authors
Rights and permissions
About this article
Cite this article
Wagenmakers, EJ., Farrell, S. AIC model selection using Akaike weights. Psychonomic Bulletin & Review 11, 192–196 (2004). https://doi.org/10.3758/BF03206482
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03206482