Explanatory Item Response Theory Models: Impact on Validity and Test Development?
Many explanatory item response theory (IRT) models have been developed since Fischer’s (Acta Psychologica 37:359–374, 1973) linear logistic test model was published. However, despite their applicability to typical test data, actual impact on test development and validation has been limited. The purpose of this chapter is to explicate the importance of explanatory IRT models in the context of a framework that interrelates the five aspects of validity (Embretson in Educ Meas Issues Pract 35, 6–22, 2016). In this framework, the response processes aspect of validity impacts other aspects. Studies on a fluid intelligence test are presented to illustrate the relevancy of explanatory IRT models to validity, as well as to test development.
KeywordsItem response theory Explanatory models Validity
- American Educational Research Association, American Psychological Association & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.Google Scholar
- Embretson, S. E. (2017). An integrative framework for construct validity. In A. Rupp & J. Leighton (Eds.), The handbook of cognition and assessment (pp. 102–123). New York: Wiley-Blackwell.Google Scholar
- Fischer, G. H., & Ponocny, I. (1995). Extended rating scale and partial credit models for assessing change. In G. H. Fischer & I. W. Molenaar (eds.), Rasch models: Foundations, recent developments, and applications (pp. 353– 70). New York: Springer.Google Scholar
- Glas, C. A. W., van der Linden, W. J., & Geerlings, H. (2010). Estimation of the parameters in an item cloning model for adaptive testing. In W. J. van der Linden & C. A. W. Glas (Eds.), Elements of adaptive testing (pp. 289–314). New York: Springer.Google Scholar
- Janssen, R. (2016). Linear logistic models. In W. van der Linden (Ed.), Handbook of item response theory: Models, statistics and applications. New York: Taylor & Francis Inc.Google Scholar
- Linacre, J. M. (1989). Multi-facet Rasch measurement. Chicago: MESA Press.Google Scholar
- van der Linden, W. (Ed.). (2016). Handbook of item response theory: Models, statistics and applications. New York: Taylor & Francis Inc.Google Scholar