On Separable Tests, Correlated Priors, and Paradoxical Results in Multidimensional Item Response Theory
- Giles Hooker
- … show all 1 hide
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
This paper presents a study of the impact of prior structure on paradoxical results in multidimensional item response theory. Paradoxical results refer to the possibility that an incorrect response could be beneficial to an examinee. We demonstrate that when three or more ability dimensions are being used, paradoxical results can be induced by using priors in which all abilities are positively correlated where they would not occur if the abilities were modeled as being independent. In the case of separable tests, we demonstrate the mathematical causes of paradoxical results, develop a computationally feasible means to check whether they can occur in any given test, and demonstrate a class of prior covariance matrices that can be guaranteed to avoid them.
- Finkelman, M., Hooker, G., & Wang, Z. (2010, in press). Prevalence and severity of paradoxical results in multidimensional item response theory. Journal of Educational and Behavioural Statistics. doi:10.3102/1076998610381402.
- Hooker, G., & Finkelman, M. (2010). Paradoxical results and item bundles. Psychometrika, 75, 249–271. CrossRef
- Hooker, G., Finkelman, M., & Schwartzman, A. (2009). Paradoxical results in multidimensional item response theory. Psychometrika, 74(3), 419–442. CrossRef
- Mardia, K.V., Kent, J.T., & Bibby, J.M. (1979). Multivariate analysis. London: Academic Press.
- R Development Core Team (2008). R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. ISBN 3-900051-07-0. http://www.R-project.org.
- Segall, D.O. (2000). Principles of multidimensional adaptive testing. In W.J. van der Linden, & C.A.W. Glas (Eds.), Computerized adaptive testing: theory and practice (pp. 53–73). Boston: Kluwer Academic.
- Wainer, H., Vevea, J., Camacho, F., Reeve, B., Rosa, K., Nelson, L., Swygert, K., & Thissen, D. (2001). Augmented scores—“borrowing strength” to compute scores based on small numbers of items. In D. Thissen, & H. Wainer (Eds.), Test scoring (pp. 343–387). Mahwah: Erlbaum.
- On Separable Tests, Correlated Priors, and Paradoxical Results in Multidimensional Item Response Theory
Volume 75, Issue 4 , pp 694-707
- Cover Date
- Print ISSN
- Online ISSN
- Additional Links
- item response theory
- paradoxical result
- Industry Sectors
- Giles Hooker (1)
- Author Affiliations
- 1. Cornell University, Ithaca, NY, USA