Abstract
In contrast to dichotomous item response theory (IRT) models, most well-known polytomous IRT models do not imply stochastic ordering of the latent trait by the total test score (SOL). This has been thought to make the ordering of respondents on the latent trait using the total test score questionable and throws doubt on the justifiability of using nonparametric polytomous IRT models for ordinal measurement. We show that a broad class of polytomous IRT models has a weaker form of SOL, denoted weak SOL, and argue that weak SOL justifies ordering respondents on the latent trait using the total test score and, therefore, the use of nonparametric polytomous IRT models for ordinal measurement.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561–573.
Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In Lord, F.M., & Novick, M.R. (Eds.) Statistical theories of mental test scores (pp. 395–480). Reading: Addison-Wesley.
DeMars, C.E. (2008). Polytomous differential item functioning and violations of ordering of the expected latent trait by the raw score. Educational and Psychological Measurement, 68, 379–396.
Douglas, R., Fienberg, S.E., Lee, M.L.T., Sampson, A.R., & Whitaker, L.R. (1990). Positive dependence concepts for ordinal contingency tables. In Block, H.W., Sampson, A.R., & Savits, T.H. (Eds.), Topics in statistical dependence (pp. 189–202). Hayward: Institute of Mathematical Statistics. Retrieved September 13, 2009, from http://projecteuclid.org/DPubS?verb=Display&version=1.0&service=UI&handle=euclid.lnms/1215457559&page=record.
Grayson, D.A. (1988). Two-group classification in latent trait theory: scores with monotone likelihood ratio. Psychometrika, 53, 383–392.
Ghurye, S.G., & Wallace, D.L. (1959). A convolutive class of monotone likelihood ratio families. Annals of Mathematical Statistics, 30, 1158–1164.
Hemker, B.T., Sijtsma, K., Molenaar, I.W., & Junker, B.W. (1996). Polytomous IRT models and monotone likelihood ratio of the total score. Psychometrika, 61, 679–693.
Hemker, B.T., Sijtsma, K., Molenaar, I.W., & Junker, B.W. (1997). Stochastic ordering using the latent trait and the sum score in polytomous IRT models. Psychometrika, 62, 331–347.
Hemker, B.T., Van der Ark, L.A., & Sijtsma, K. (2001). On measurement properties of continuation ratio models. Psychometrika, 66, 487–506.
Huynh, H. (1994). A new proof for monotone likelihood ratio for the sum of independent Bernoulli random variables. Psychometrika, 59, 77–79.
Junker, B.W., & Sijtsma, K. (2001). Nonparametric item response theory in action: an overview of the special issue. Applied Psychological Measurement, 25, 211–220.
Lehmann, E.L. (1959). Testing statistical hypotheses. New York: Wiley.
Masters, G. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149–174.
Mokken, R.J. (1971). A theory and procedure of scale analysis. The Hague: Mouton/De Gruyter.
Molenaar, I.W. (1997). Nonparametric models for polytomous responses. In van der Linden, W.J., & Hambleton, R.K. (Eds.), Handbook of modern item response theory (pp. 369–380). New York: Springer.
Muraki, E. (1992). A generalized partial credit model: application of an EM algorithm. Applied Psychological Measurement, 16, 159–177.
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Nielsen & Lydiche.
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph, 17.
Scheiblechner, H. (2002). Nonparametric IRT: scoring functions and ordinal parameter estimation of isotonic probabilistic models (ISOP). Unpublished manuscript. Retrieved September 13, 2009, from http://www.staff.uni-marburg.de/~scheible/Isoscore2.pdf
Scheiblechner, H. (2007). A unified nonparametric IRT model for d-dimensional psychological test data (d-ISOP). Psychometrika, 72, 43–67.
Shaked, M., & Shantikumar, J.G. (1994). Stochastic orders and their applications. San Diego: Academic Press.
Sijtsma, K., & Molenaar, I.W. (2002). Introduction to nonparametric item response theory. Thousand Oaks: Sage.
Ünlü, A. (2008). A note on monotone likelihood ratio of the total score variable in unidimensional item response theory. British Journal of Mathematical and Statistical Psychology, 61, 179–187.
Van der Ark, L.A. (2001). Relationships and properties of polytomous item response theory models. Applied Psychological Measurement, 25, 273–282.
Van der Ark, L.A. (2005). Stochastic ordering of the latent trait by the sum score under various polytomous IRT models. Psychometrika, 70, 283–304.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License ( https://creativecommons.org/licenses/by-nc/2.0 ), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
van der Ark, L.A., Bergsma, W.P. A Note on Stochastic Ordering of the Latent Trait Using the Sum of Polytomous Item Scores. Psychometrika 75, 272–279 (2010). https://doi.org/10.1007/s11336-010-9147-7
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11336-010-9147-7