Psychometrika

, Volume 52, Issue 3, pp 317–332 | Cite as

Factor analysis and AIC

  • Hirotugu Akaike
Special Section

Abstract

The information criterion AIC was introduced to extend the method of maximum likelihood to the multimodel situation. It was obtained by relating the successful experience of the order determination of an autoregressive model to the determination of the number of factors in the maximum likelihood factor analysis. The use of the AIC criterion in the factor analysis is particularly interesting when it is viewed as the choice of a Bayesian model. This observation shows that the area of application of AIC can be much wider than the conventional i.i.d. type models on which the original derivation of the criterion was based. The observation of the Bayesian structure of the factor analysis model leads us to the handling of the problem of improper solution by introducing a natural prior distribution of factor loadings.

Key words

factor analysis maximum likelihood information criterion AIC improper solution Bayesian modeling 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Akaike, H. (1969). Fitting autoregressive models for prediction.Annals of the Institute of Statistical Mathematics, 21, 243–247.Google Scholar
  2. Akaike, H. (1970). Statistical predictor identification.Annals of the Institute of Statistical Mathematics, 22, 203–217.Google Scholar
  3. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B. N. Petrov & F. Csaki (Eds.),2nd International Symposium on Information Theory (pp. 267–281). Budapest: Akademiai Kiado.Google Scholar
  4. Akaike, H. (1974). A new look at the statistical model identification.IEEE Transactions on Automatic Control, AC-19, 716–723.Google Scholar
  5. Akaike, H. (1980). Likelihood and the Bayes procedure. In J. M. Bernardo, M. H. De Groot, D. V. Lindley, & A. F. M. Smith (Eds.),Bayesian Statistics (pp. 143–166). Valencia: University Press.Google Scholar
  6. Akaike, H. (1985). Prediction and entropy. In A. C. Atkinson & S. E. Fienberg (Eds.),A Celebration of Statistics (pp. 1–24). New York: Springer-Verlag.Google Scholar
  7. Bartholomew, D. J. (1981). Posterior analysis of the factor model.British Journal of Mathematical and Statistical Psychology, 34, 93–99.Google Scholar
  8. Bozdogan, H., & Ramirez, D. E. (1987). An expert model selection approach to determine the “best” pattern structure in factor analysis models. Unpublished manuscript.Google Scholar
  9. Harman, H. H. (1960).Modern Factor Analysis. Chicago: University Press.Google Scholar
  10. Jennrich, R. I., & Robinson, S. M. (1969). A Newton-Raphson algorithm for maximum likelihood factor analysis.Psychometrika, 34, 111–123.Google Scholar
  11. Jöreskog, K. G. (1967). Some contributions to maximum likelihood factor analysis.Psychometrika, 32, 443–482.Google Scholar
  12. Jöreskog, K. G. (1978). Structural analysis of covariance and correlation matrices.Psychometrika, 43, 443–477.Google Scholar
  13. Lawley, D. N., & Maxwell, A. E. (1971).Factor Analysis as a Statistical Method, 2nd Edition. London: Butterworths.Google Scholar
  14. Martin, J. K., & McDonald, R. P. (1975). Bayesian estimation in unrestricted factor analysis: a treatment for Heywood cases.Psychometrika, 40, 505–517.Google Scholar
  15. Maxwell, A. E. (1961). Recent trends in factor analysis.Journal of the Royal Statistical Society, Series A, 124, 49–59.Google Scholar
  16. Rao, C. R. (1955). Estimation and tests of significance in factor analysis.Psychometrika, 20, 93–111.Google Scholar
  17. Tsumura, Y., Fukutomi, K., & Asoo, Y. (1968). On the unique convergence of iterative procedures in factor analysis.TRU Mathematics, 4, 52–59. (Science University of Tokyo).Google Scholar
  18. Tsumura, Y., & Sato, M. (1981). On the convergence of iterative procedures in factor analysis.TRU Mathematics, 17, 159–168. (Science University of Tokyo).Google Scholar

Copyright information

© The Psychometric Society 1987

Authors and Affiliations

  • Hirotugu Akaike
    • 1
  1. 1.The Institute of Statistical MathematicsTokyoJapan

Personalised recommendations