Skip to main content

Evaluating Scales for Ordinal Assessment in Clinical and Medical Psychology

  • Conference paper
  • First Online:
  • 1724 Accesses

Part of the book series: Springer Proceedings in Mathematics & Statistics ((PROMS,volume 66))

Abstract

The present chapter elaborates on the use of ordered latent class models (OR-LCMs) in analyzing ordinal measurement properties of psychological tests and questionnaires in the context of clinical and medical psychology. Using simulated data, we illustrate several approaches for evaluating absolute fit of the model and we show how the fitted OR-LCMs can be used to gain insight into the reliability and the measurement precision of total scores for ranking and classifying individuals into ordered classes.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York: Holt, Rinehart & Winston.

    Google Scholar 

  • Croon, M. A. (1991). Investigating Mokken scalability of dichotomous items by means of ordinal latent class models. British Journal of Mathematical and Statistical Psychology, 44, 315–331.

    Article  Google Scholar 

  • De Cock, E. S. A., Emons, W. H. M., Nefs, G., Pop, V. J. M., & Pouwer, F. (2011). Dimensionality and scale properties of the Edinburgh Depression Scale (EDS) in patients with Type 2 diabetes mellitus: the DiaDDzoB study. BMC Psychiatry, 11, 141.

    Article  Google Scholar 

  • Denollet, J. (2005). DS14: Standard assessment of negative affectivity, social inhibition, and Type D personality. Psychosomatic Medicine, 67, 89–97.

    Article  Google Scholar 

  • Drasgow, F., Levine, M. V., Tsien, S., Williams, B., & Mead, A. (1995). Fitting polychotomous item response theory models to multiple choice tests. Applied Psychological Measurement, 19, 143–165.

    Article  Google Scholar 

  • Emons, W. H. M., Mols, F., Pelle, A. J. M., Smolderen, K. G. E., & Denollet, J. (2012). Type D assessment in patients with chronic heart failure and peripheral arterial disease: Evaluation of the Experimental DS(3) Scale using Item Response Theory. Journal of Personality Assessment, 94, 210–219.

    Article  Google Scholar 

  • Emons, W. H. M., Sijtsma, K., & Meijer, R. R. (2007). On the consistency of individual classification using short scales. Psychological Methods, 12, 105–120.

    Article  Google Scholar 

  • Feldt, L. S., Steffen, M., & Gupta, N. C. (1985). A comparison of five methods for estimating the standard error of measurement at specific score levels. Applied Psychological Measurement, 4, 351–361.

    Article  Google Scholar 

  • Gustafsson, J.-E., & Åberg-Bengtsson, L. (2010). Unidimensionality and interpretability of psychological instruments. In S. S. Embretson (Ed.), Measuring psychological constructs: Advances in model-based approaches. Washington, DC: American Psychological Association.

    Google Scholar 

  • Hemker, B. T., Sijtsma, K., Molenaar, I. W., & Junker, B. W. (1997). Stochastic ordering using the latent trait and the sum score in polytomous IRT models. Psychometrika, 62, 331–347.

    Article  MathSciNet  MATH  Google Scholar 

  • Kruyen, P. M., Emons, W. H. M., & Sijtsma, K. (2013). Shortening the S-STAI: Consequences for research and clinical practice. Journal of Psychosomatic Research, 75, 167–172.

    Google Scholar 

  • Lambert, M. J., & Finch, A. E. (1999). The Outcome Questionnaire. Mahwah, NJ: Lawrence Erlbaum Associates Publishers.

    Google Scholar 

  • Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.

    MATH  Google Scholar 

  • Meijer, R. R., & Baneke, J. J. (2004). Analyzing psychopathology items: A case for nonparametric item response theory modeling. Psychological Methods, 9, 354–368.

    Article  Google Scholar 

  • Ramsay, J. O. (1991). Kernel smoothing approaches to nonparametric item characteristic curve estimation. Psychometrika, 56, 611–630.

    Article  MATH  Google Scholar 

  • Reise, S. P., Morizot, J., & Hays, R. D. (2007). The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Quality of Life Research, 16, 19–31.

    Article  Google Scholar 

  • Reise, S. P., & Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27–48.

    Article  Google Scholar 

  • Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. In Psychometric monograph (Vol. 17). Richmond, VA: Psychometric Society. Retrieved from: http://www.psychometrika.org/journal/online/MN17.pdf

  • Sijtsma, K. (2005). Nonparametric item response theory models. Encyclopedia of Social Measurement, 2, 875–882.

    Article  Google Scholar 

  • Sijtsma, K. (2009). Correcting fallacies in validity, reliability and classification. International Journal of Testing, 9, 167–194.

    Article  Google Scholar 

  • Sijtsma, K., Emons, W. H. M., Bouwmeester, S., Nyklicek, I., & Roorda, L. D. (2008). Nonparametric IRT analysis of quality of life scales and its application to the World Health Organization Quality of Life Scale (WHOQoL-Bref). Quality of Life Research, 17, 275–290.

    Article  Google Scholar 

  • Sijtsma, K., & Molenaar, I. W. (2002). Introduction to nonparametric item response theory. Thousand Oaks, CA: Sage.

    Book  MATH  Google Scholar 

  • Stone, C. A. (2003). Empirical power and Type I error rates for an IRT fit statistic that considers the precision of ability estimates. Educational and Psychological Measurement, 63, 566–583.

    Article  MathSciNet  Google Scholar 

  • Thissen, D., Pommerich, M., Billeau, K., & Williams, V. S. L. (1995). Item response theory for scores on test including polytomous items with ordered responses. Applied Psychological Measurement, 19, 39–49.

    Article  Google Scholar 

  • Van der Ark, L. A. (2005). Stochastic ordering of the latent trait by the sum score under various polytomous IRT models. Psychometrika, 70, 283–304.

    Article  MathSciNet  MATH  Google Scholar 

  • Van der Ark, L. A. (2012). New Developments in Mokken Scale analysis in R. Journal of Statistical Software, 48. Retrieved from http://www.jstatsoft.org/

  • Van Onna, M. J. H. (2004). Ordered latent class models in nonparametric item response theory (Doctoral dissertation). University of Groningen, The Netherlands. Retrieved from http://dissertations.ub.rug.nl/faculties/gmw/2004/m.j.h.van.onna/

  • Vermunt, J. K. (2001). The use of restricted latent class models for defining and testing nonparametric and parametric IRT models. Applied Psychological Measurement, 25, 283–294.

    Article  MathSciNet  Google Scholar 

  • Vermunt, J. K., & Magidson, J. (2005). Technical guide for LatentGOLD 4.5. Basic and advanced. Belmont, MA: Statistical Innovations.

    Google Scholar 

  • Waller, N. G., & Reise, S. P. (2010). Measuring psychopathology with nonstandard item-response theory models: Fitting the four-parameter model to the Minnesota Multiphasic Personality Inventory. In S. E. Embretson (Ed.), Measuring psychological constructs: Advances in model-based approaches (pp. 147--173). Washington, DC: American Psychological Association.

    Google Scholar 

  • Zigmond, A. S., & Snaith, R. P. (1983). The Hospital Anxiety and Depression Scale. Acta Psychiatrica Scandinavica, 67, 361–370.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wilco H. M. Emons .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this paper

Cite this paper

Emons, W.H.M., Flore, P.C. (2013). Evaluating Scales for Ordinal Assessment in Clinical and Medical Psychology. In: Millsap, R.E., van der Ark, L.A., Bolt, D.M., Woods, C.M. (eds) New Developments in Quantitative Psychology. Springer Proceedings in Mathematics & Statistics, vol 66. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-9348-8_29

Download citation

Publish with us

Policies and ethics