A Three-Parameter Speeded Item Response Model: Estimation and Application
When given time constraints, it is possible that examinees leave the harder items till later and are not able to finish answering every item in time. In this paper, this situation was modeled by incorporating a speeded-effect term into a three-parameter logistic item response model. Due to the complexity of the likelihood structure, a Bayesian estimation procedure with Markov chain Monte Carlo method was presented. The methodology is applied to physics examination data of the Department Required Test for college entrance in Taiwan for illustration.
KeywordsItem response model Markov chain Monte Carlo Test speededness
The research was supported by Academia Sinica and the Ministry of Science and Technology of the Republic of China under grant number MOST 102-2118-M-001 -007 -MY2. The authors would like to thank the co-editor, Professor Wen-Chung Wang, and Dr. Yu-Wei Chang for their helpful comments and suggestions, and the College Entrance Examination Center (CEEC) for providing the data.
- Bejar, I. I. (1985). Test speededness under number-right scoring: An analysis of the test of English as a foreign language (Research Rep. RR-85-11). Princeton: Educational Testing Service.Google Scholar
- Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord, & M. R. Novick (Eds.), Statistical theories of mental test scores (pp. 397–479). Reading, MA: Addison-Wesley.Google Scholar
- de Ayala, R. J. (2009). The theory and practice of item response theory. New York: Guilford Press.Google Scholar
- Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah: L. Erlbaum Associates.Google Scholar
- Huang, H.-Y., & Hung, S.-P. (2010). Implementation and application of Bayesian three-level IRT random intercept latent regression model. Chinese Journal of Psychology, 52, 309–326. (in Chinese)Google Scholar
- Wang, W.-C. (2004). Rasch measurement theory and application in education and psychology. Journal of Education and Psychology, 27, 637–694 (in Chinese).Google Scholar
- Yamamoto, K. (1989). HYBRID model of IRT and latent class models (ETS Research Rep. No. RR-89-41). Princeton: Educational Testing Service.Google Scholar
- Yamamoto, K. (1995). Estimating the effects of test length and test time on parameter estimation using the HYBRID model (TOEFL Technical Rep. No. TR-10). Princeton: Educational Testing Service.Google Scholar
- Yamamoto, K., & Everson, H. (1997). Modeling the effects of test length and test time on parameter estimation using the hybrid model. In J. Rost (Ed.), Applications of latent trait and latent class models in the social sciences (pp. 89–98). Munster: Waxmann.Google Scholar