Abstract
When given time constraints, it is possible that examinees leave the harder items till later and are not able to finish answering every item in time. In this paper, this situation was modeled by incorporating a speeded-effect term into a three-parameter logistic item response model. Due to the complexity of the likelihood structure, a Bayesian estimation procedure with Markov chain Monte Carlo method was presented. The methodology is applied to physics examination data of the Department Required Test for college entrance in Taiwan for illustration.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Agresti, A. (2002). Categorical data analysis. Hoboken, NJ: Wiley.
Angoff, W. H. (1989). Does guessing really help? Journal of Educational Measurement, 26, 323–336.
Bejar, I. I. (1985). Test speededness under number-right scoring: An analysis of the test of English as a foreign language (Research Rep. RR-85-11). Princeton: Educational Testing Service.
Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord, & M. R. Novick (Eds.), Statistical theories of mental test scores (pp. 397–479). Reading, MA: Addison-Wesley.
Bolt, D. M., Cohen, A. S., & Wollack, J. A. (2002). Item parameter estimation under conditions of test speededness: Application of a mixture Rasch model with ordinal constraints. Journal of Educational Measurement, 39, 331–348.
Boughton, K. A., & Yamamoto, K. (2007). A HYBRID model for test speededness. In M. von Davier, & C. H. Carstensen (Eds.), Multivariate and mixture distribution Rasch models (pp. 147–156). New York: Springer.
Cao, J., & Stokes, S. L. (2008). Bayesian IRT guessing models for partial guessing behaviors. Psychometrika, 73, 209–230.
Chang, Y.-W., Tsai, R.-C., & Hsu, N.-J. (2014). A speeded item response model: Leave the harder till later. Psychometrika, 79, 255–274.
de Ayala, R. J. (2009). The theory and practice of item response theory. New York: Guilford Press.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah: L. Erlbaum Associates.
Fox, J.-P. (2010). Bayesian item response modeling-theory and applications. New York: Springer.
Goegebeur, Y., De Boeck, P., Wollack, J. A., & Cohen, A. S. (2008). A speeded item response model with gradual process change. Psychometrika, 73, 65–87.
Huang, H.-Y., & Hung, S.-P. (2010). Implementation and application of Bayesian three-level IRT random intercept latent regression model. Chinese Journal of Psychology, 52, 309–326. (in Chinese)
Lee, Y.-H., & Ying, Z. (2015). A mixture cure-rate model for responses and response times in time-limit tests. Psychometrika, 80, 748–775.
Li, Y., Bolt, D. M., & Fu, J. (2006). A comparison of alternative models for testlets. Applied Psychological Measurement, 30, 3–21.
Lord, F. M. (1975). Formula scoring and number-right scoring. Journal of Educational Measurement, 12, 7–11.
Meyer, J. P. (2010). A mixture Rasch model with item response time components. Applied Psychological Measurement, 34, 521–538.
Mislevy, R. L. (1986). Bayes modal estimation in item response theory. Psychometrika, 51, 177–195.
Rost, J. (1990). Rasch models in latent classes: an integration of two approaches to item analysis. Applied Psychological Measurement, 14, 271–282.
Sinharay, S., Johnson, M. S., & Stern, H. S. (2006). Posterior predictive assessment of item response theory models. Applied Psychological Measurement, 30, 298–321.
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & van der Linde, A. (2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society. Series B, 64, 583–616.
Swaminathan, H., & Gifford, J. A. (1982). Bayesian estimation in the Rasch model. Journal of Educational Statistics, 7, 175–192.
Swaminathan, H., & Gifford, J. A. (1985). Bayesian estimation in the twoparameter logistic model. Psychometrika, 50, 349–364.
Swaminathan, H., & Gifford, J. A. (1986). Bayesian estimation in the three-parameter logistic model. Psychometrika, 51, 589–601.
van der Linden, W. J. (2007). A hierarchical framework for modeling speed and accuracy on test items. Psychometrika, 72, 287–308.
Wang, W.-C. (2004). Rasch measurement theory and application in education and psychology. Journal of Education and Psychology, 27, 637–694 (in Chinese).
Wang, C., & Xu, G. (2015). A mixture hierarchical model for response times and response accuracy. British Journal of Mathematical and Statistical Psychology, 68, 456–477.
Yamamoto, K. (1989). HYBRID model of IRT and latent class models (ETS Research Rep. No. RR-89-41). Princeton: Educational Testing Service.
Yamamoto, K. (1995). Estimating the effects of test length and test time on parameter estimation using the HYBRID model (TOEFL Technical Rep. No. TR-10). Princeton: Educational Testing Service.
Yamamoto, K., & Everson, H. (1997). Modeling the effects of test length and test time on parameter estimation using the hybrid model. In J. Rost (Ed.), Applications of latent trait and latent class models in the social sciences (pp. 89–98). Munster: Waxmann.
Acknowledgements
The research was supported by Academia Sinica and the Ministry of Science and Technology of the Republic of China under grant number MOST 102-2118-M-001 -007 -MY2. The authors would like to thank the co-editor, Professor Wen-Chung Wang, and Dr. Yu-Wei Chang for their helpful comments and suggestions, and the College Entrance Examination Center (CEEC) for providing the data.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Chang, J., Tsai, H., Su, YH., Lin, E.M.H. (2016). A Three-Parameter Speeded Item Response Model: Estimation and Application. In: van der Ark, L., Bolt, D., Wang, WC., Douglas, J., Wiberg, M. (eds) Quantitative Psychology Research. Springer Proceedings in Mathematics & Statistics, vol 167. Springer, Cham. https://doi.org/10.1007/978-3-319-38759-8_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-38759-8_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-38757-4
Online ISBN: 978-3-319-38759-8
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)