Skip to main content
SpringerLink
Log in

Formulas of Multilevel Reliabilities for Tests with Ordered Categorical Responses

  • Conference paper
  • First Online:
Quantitative Psychology (IMPS 2020)

Part of the book series: Springer Proceedings in Mathematics & Statistics ((PROMS,volume 353))

Included in the following conference series:

  • 916 Accesses

Abstract

There has been no research on the multilevel composite reliability (or coefficient omega) and multilevel maximal reliability H for weighted sum of a test with ordered categorical responses. In order to fill the gap, this study reviewed various approaches to reliabilities, extended single level reliabilities to multilevel reliabilities, and provided closed-form formulas for multilevel nonlinear SEM reliabilities via a multilevel confirmatory factor analysis approach. Multilevel Cronbach’s alpha was also considered.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Bentler, P. M. (2007). Covariance structure models for maximal reliability of unit-weighted composites. In Handbook of latent variable and related models (pp. 1–19). North-Holland.

    Google Scholar 

  • Bentler, P. M. (2009). Alpha, dimension-free, and model-based internal consistency reliability. Psychometrika, 74(1), 137–143.

    Article  MathSciNet  MATH  Google Scholar 

  • Bollen, K. A. (1989). Structural equations with latent variables. Wiley.

    Book  MATH  Google Scholar 

  • Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. psychometrika, 16(3), 297–334.

    Google Scholar 

  • Finney, S. J., & DiStefano, C. (2006). Non-normal and categorical data in structural equation modeling. In G. R. Hancock & R. O. Mueller (Eds.), Structural equation modeling: A second course (pp. 269–314). Information Age.

    Google Scholar 

  • Geldhof, G. J., Preacher, K. J., & Zyphur, M. J. (2014). Reliability estimation in a multilevel confirmatory factor analysis framework. Psychological Methods, 19(1), 72–91.

    Article  Google Scholar 

  • Green, S. B., Lissitz, R. W., & Mulaik, S. A. (1977). Limitations of coefficient alpha as an index of test unidimensionality. Educational and Psychological Measurement, 37(4), 827–838.

    Article  Google Scholar 

  • Green, S. B., & Yang, Y. (2009). Reliability of summed item scores using structural equation modeling: An alternative to coefficient alpha. Psychometrika, 74(1), 155–167.

    Article  MathSciNet  MATH  Google Scholar 

  • Hancock, G. R., & Mueller, R. O. (2001). Rethinking construct reliability within latent variable systems. In R. Cudeck, S. du Toit, & D. Sörbom (Eds.), Structural equation modeling: Present and future – A festschrift in honor of Karl Jöreskog (pp. 195–216). Scientific Software International.

    Google Scholar 

  • Kim, S., Lu, Z., & Cohen, A. S. (2020). Reliability for tests with items having different numbers of ordered categories. Applied psychological measurement, 44(2), 137–149.

    Google Scholar 

  • Lord, F. M., & Novick, R. (1968). Statistical theories of mental test scores. Reading MA: Addison-Wesley.

    Google Scholar 

  • McDonald, R. P. (1985). Factor analysis and related methods. Erlbaum.

    Google Scholar 

  • Miller, M. B. (1995). Coefficient alpha: A basic introduction from the perspectives of classical test theory and structural equation modeling. Structural Equation Modeling, 2(3), 255–273.

    Article  Google Scholar 

  • Muthén, B. O. (2011). Mean and covariance structure analysis of hierarchical data. UCLA: Department of Statistics, UCLA. Retrieved from https://escholarship.org/uc/item/1vp6w4sr.

  • Novick, M., & Lewis, C. (1967). Coefficient alpha and the reliability of composite measurements. Psychometrika, 32(1), 1–13.

    Article  Google Scholar 

  • Raykov, T. (1997). Estimation of composite reliability for congeneric measures. Applied Psychological Measurement, 21(2), 173–184.

    Article  Google Scholar 

  • Raykov, T., & Shrout, P. E. (2002). Reliability of scales with general structure: Point and interval estimation using a structural equation modeling approach. Structural Equation Modeling, 9(2), 195–212.

    Article  MathSciNet  Google Scholar 

  • Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74(1), 107–120.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Georgia, Athens, GA, USA

    Zhenqiu (Laura) Lu & Minju Hong

  2. University of Virginia, Charlottesville, VA, USA

    Seohyun Kim

Authors
  1. Zhenqiu (Laura) Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Minju Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Seohyun Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhenqiu (Laura) Lu .

Editor information

Editors and Affiliations

  1. Department of Statistics, USBE, Umeå University, Umeå, Västerbottens Län, Sweden

    Marie Wiberg

  2. Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands

    Dylan Molenaar

  3. Facultad de Matemáticas, Pontificia Universidad Católica de Chile, Santiago, Chile

    Jorge González

  4. Kellogg School of Management, Northwestern University, Evanston, IL, USA

    Ulf Böckenholt

  5. Department of Educational Psychology, University of Wisconsin-Madison, Madison, WI, USA

    Jee-Seon Kim

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lu, Z.(., Hong, M., Kim, S. (2021). Formulas of Multilevel Reliabilities for Tests with Ordered Categorical Responses. In: Wiberg, M., Molenaar, D., González, J., Böckenholt, U., Kim, JS. (eds) Quantitative Psychology. IMPS 2020. Springer Proceedings in Mathematics & Statistics, vol 353. Springer, Cham. https://doi.org/10.1007/978-3-030-74772-5_10

Download citation

Publish with us

Policies and ethics

Search

Navigation