Psychometrika

, 74:145 | Cite as

Coefficients Alpha, Beta, Omega, and the glb: Comments on Sijtsma

Theory and Methods

Abstract

There are three fundamental problems in Sijtsma (Psychometrika, 2008): (1) contrary to the name, the glb is not the greatest lower bound of reliability but rather is systematically less than ωt (McDonald, Test theory: A unified treatment, Erlbaum, Hillsdale, 1999), (2) we agree with Sijtsma that when considering how well a test measures one concept, α is not appropriate, but recommend ωt rather than the glb, and (3) the end user needs procedures that are readily available in open source software.

Keywords

reliability internal consistency homogeneity test theory coefficient alpha coefficient omega coefficient beta 

References

  1. Bentler, P., & Woodward, J. (1980). Inequalities among lower bounds to reliability: With applications to test construction and factor analysis. Psychometrika, 45(2), 249–267. CrossRefGoogle Scholar
  2. Brown, W. (1910). Some experimental results in the correlation of mental abilities. British Journal of Psychology, 3(3), 296–322. Google Scholar
  3. Cronbach, L.J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334. CrossRefGoogle Scholar
  4. Cronbach, L.J. (1988). Internal consistency of tests: Analyses old and new. Psychometrika, 53(1), 63–70. CrossRefGoogle Scholar
  5. Cronbach, L.J., & Shavelson, R.J. (2004). My current thoughts on coefficient alpha and successor procedures. Educational and Psychological Measurement, 64(3), 391–418. CrossRefGoogle Scholar
  6. De Leeuw, J. (1983). Models and methods for the analysis of correlation coefficients. Journal of Econometrics, 22(1–2), 113–137. CrossRefGoogle Scholar
  7. Guttman, L. (1945). A basis for analyzing test-retest reliability. Psychometrika, 10(4), 255–282. CrossRefGoogle Scholar
  8. Jackson, P., & Agunwamba, C. (1977). Lower bounds for the reliability of the total score on a test composed of non-homogeneous items: I: Algebraic lower bounds. Psychometrika, 42(4), 567–578. CrossRefGoogle Scholar
  9. Lord, F.M. (1955). Sampling fluctuations resulting from the sampling of test items. Psychometrika, 20(1), 1–22. CrossRefGoogle Scholar
  10. Lord, F.M., & Novick, M.R. (1968). Statistical theories of mental test scores. Reading: Addison-Wesley. Google Scholar
  11. McDonald, R.P. (1978). Generalizability in factorable domains: “domain validity and generalizability” 1. Educational and Psychological Measurement, 38(1), 75–79. CrossRefGoogle Scholar
  12. McDonald, R.P. (1999). Test theory: A unified treatment. Hillsdale: Erlbaum. Google Scholar
  13. McNemar, Q. (1946). Opinion-attitude methodology. Psychological Bulletin, 43(4), 289–374. CrossRefGoogle Scholar
  14. R Development Core Team. (2008). R: A language and environment for statistical computing. Vienna, Austria (ISBN 3-900051-07-0). Google Scholar
  15. Rafaeli, E., & Revelle, W. (2006). A premature consensus: Are happiness and sadness truly opposite affects? Motivation and Emotion, 30(1), 1–12. CrossRefGoogle Scholar
  16. Raykov, T., & Shrout, P.E. (2002). Reliability of scales with general structure: Point and interval estimation using a structural equation modeling approach. Structural Equation Modeling, 9(2), 195–212. CrossRefGoogle Scholar
  17. Revelle, W. (1979). Hierarchical cluster-analysis and the internal structure of tests. Multivariate Behavioral Research, 14(1), 57–74. CrossRefGoogle Scholar
  18. Revelle, W. (2008). psych: Procedures for personality and psychological research (R package version 1.0-51). Google Scholar
  19. Schmid, J.J., & Leiman, J.M. (1957). The development of hierarchical factor solutions. Psychometrika, 22(1), 83–90. CrossRefGoogle Scholar
  20. Sijtsma, K. (2008). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika. Google Scholar
  21. Spearman, C. (1904). The proof and measurement of association between two things. The American Journal of Psychology, 15(1), 72–101. CrossRefGoogle Scholar
  22. Spearman, C. (1910). Correlation calculated from faulty data. British Journal of Psychology, 3(3), 271–295. Google Scholar
  23. Ten Berge, J.M.F., & Hofstee, W.K.B. (1999). Coefficients alpha and reliabilities of unrotated and rotated components. Psychometrika, 64(1), 83–90. CrossRefGoogle Scholar
  24. Ten Berge, J.M.F., & Socan, G. (2004). The greatest lower bound to the reliability of a test and the hypothesis of unidimensionality. Psychometrika, 69(4), 613–625. CrossRefGoogle Scholar
  25. Ten Berge, J.M.F., & Zegers, F.E. (1978). A series of lower bounds to the reliability of a test. Psychometrika, 43(4), 575–579. CrossRefGoogle Scholar
  26. Warner, W.L. (1960). Social class in America: a manual of procedure for the measurement of social status. New York: Harper. Google Scholar
  27. Woodhouse, B., & Jackson, P. (1977). Lower bounds for the reliability of the total score on a test composed of non-homogeneous items: II: A search procedure to locate the greatest lower bound. Psychometrika, 42(4), 579–591. CrossRefGoogle Scholar
  28. Zinbarg, R.E., Revelle, W., Yovel, I., & Li, W. (2005). Cronbach’s α, Revelle’s β, and McDonald’s ω H: Their relations with each other and two alternative conceptualizations of reliability. Psychometrika, 70(1), 123–133. CrossRefGoogle Scholar
  29. Zinbarg, R.E., Yovel, I., Revelle, W., & McDonald, R.P. (2006). Estimating generalizability to a latent variable common to all of a scale’s indicators: A comparison of estimators for ω h. Applied Psychological Measurement, 30(2), 121–144. CrossRefGoogle Scholar
  30. Zinbarg, R.E., Revelle, W., & Yovel, I. (2007). Estimating ω h for structures containing two group factors: Perils and prospects. Applied Psychological Measurement, 31(2), 135–157. CrossRefGoogle Scholar

Copyright information

© The Psychometric Society 2008

Authors and Affiliations

  1. 1.Department of PsychologyNorthwestern UniversityEvanstonUSA
  2. 2.Department of Psychology, The Family Institute at Northwestern UniversityNorthwestern UniversityEvanstonUSA

Personalised recommendations