Addressing score comparability in diagnostic classification models: an observed-score equating and linking approach
- 14 Downloads
The purpose of this study is to revamp and examine the observed-score approach for equating scores under diagnostic classification models (DCMs). The observed-score approach was adapted to accommodate the categorical latent traits and scores, a unique property of DCMs. Three simulation studies, each corresponding to a data collection design, were conducted to evaluate the amount of equating error and the improvement in score comparability with the observed-score approach. Findings indicate that (a) DCM scores are robust to form differences when high-quality items are used, and (b) the observed-score approach shows promise for yielding a small amount of equating error and increasing classification accuracy under small sample size conditions.
KeywordsDiagnostic classification model Equating Linking Score reporting Observed-score
Compliance with ethical standards
Conflict of interest
Ren Liu states that there is no conflict of interest.
- Bozard JL (2010) Invariance testing in diagnostic classification models. Unpublished masters’ thesis. The University of Georgia, Athens, GAGoogle Scholar
- Braun HI, Holland PW (1982) Observed-score test equating: a mathematical analysis of some ETS equating procedures. In: Holland PW, Rubin DB (eds) Test equating. Academic, New York, pp 9–49Google Scholar
- Kim SY (2018) Simple structure MIRT equating for multidimensional tests. Unpublished doctoral dissertationGoogle Scholar
- Levine R (1955) Equating the score scales of alternate forms administered to samples of different ability (Research Bulletin 55–23). Educational Testing Service, PrincetonGoogle Scholar
- Lord FM (1980) Applications of item response theory to practical testing problems. Erlbaum, HillsdaleGoogle Scholar
- R Core Team (2017) R (Version 3.4) [Computer Software]. R Foundation for Statistical Computing, ViennaGoogle Scholar
- Rupp AA, Templin J, Henson RA (2010) Diagnostic measurement: Theory, methods, and applications. Guilford Press, New YorkGoogle Scholar