Skip to main content

A Speed-Accuracy Response Model with Conditional Dependence Between Items

  • Conference paper
  • First Online:
Quantitative Psychology (IMPS 2022)

Part of the book series: Springer Proceedings in Mathematics & Statistics ((PROMS,volume 422))

Included in the following conference series:

Abstract

Conditional independence assumptions play an important role in many psychometric models, but can sometimes be too restrictive in modeling process data from educational and psychological tests such as response times. For this reason, a continuous speed-accuracy response model is developed that relaxes the assumption of conditional independence of items given latent proficiency (“local” independence). Our model is a generalization of the speed-accuracy response model developed by Maris and van der Maas (Psychometrika, 77:615-633, 2012) in which a scoring rule incorporating both accuracy and speed of item responses is assumed to produce a sufficient statistic for a latent proficiency variable. The assumption of local independence is dropped in a similar way as in the interaction model developed for dichotomous item responses by Haberman (Multivariate and Mixture Distribution Rasch Models, pp. 201–216. Springer, New York, 2007). Recently, Verhelst (Theoretical and Practical Advances in Computer-Based Educational Measurement, pp. 135–160. Springer, Cham, 2019) discussed similar models in the context of exponential family models for continuous item responses. A pairwise conditional maximum likelihood approach is developed to estimate item parameters. The model is illustrated by an application to data from a listening test.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Andersen, E. B. (1970). Asymptotic properties of conditional maximum-likelihood estimators. Journal of the Royal Statistical Society, Series B (Methodological), 32, 283–301.

    Article  Google Scholar 

  • Besag, J. (1975). Statistical analysis of non-lattice data. Journal of the Royal Statistical Society: Series D (The Statistician), 24(3), 179–195.

    Google Scholar 

  • Bolsinova, M., Tijmstra, J., Molenaar, D., & De Boeck, P. (2017). Conditional independence between response time and accuracy: An overview of its possibles sources and directions for distinguishing between them. Frontiers in Psychology, 8. https://doi.org/10.3389/fpsyg.2017.00202

  • Eggen, T. J. H. M., & Verhelst, N. D. (2011). Item calibration in incomplete testing designs. Psicológica, 32(1), 107–132.

    Google Scholar 

  • Haberman, S. J. (2007). The interaction model. In M. von Davier & C. H. Carstensen (Eds.), Multivariate and mixture distribution Rasch models (pp. 201–216). Springer.

    Google Scholar 

  • Lord, F. M. & Novick, M. R. (1968). Statistical theories of mental test scores. Addison-Wesley.

    Google Scholar 

  • Maris, G., & van der Maas, H. L. J. (2012). Speed-accuracy response models: Scoring rules based on response time and accuracy. Psychometrika, 77, 615-633. https://doi.org/10.1007/s11336-012-9288-y

    Article  Google Scholar 

  • Maris, G., & Bechger, T. (2021). Boltzmann machines as multidimensional item response theory models. Available via http://www.psyarxiv.com.

  • Maris, G., Bechger, T., Koops, J., & Partchev, I. (2022). dexter: Data management and analysis of tests [Computer software manual]. Available via https://dexter-psychometrics.github.io/dexter/.

  • McDonald, R. P. (1999). Test theory: A unified treatment. Lawrence Erlbaum.

    Google Scholar 

  • Müller, H. (1987). A Rasch model for continuous responses. Psychometrika, 52, 165–181. https://doi.org/10.1007/BF02294232

    Article  Google Scholar 

  • Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Paedagogike Institut.

    Google Scholar 

  • van der Linden, W. J., & Eggen, T. J. H. M. (1986). An empirical Bayesian approach to item banking. Applied Psychological Measurement, 10(4), 345–354.

    Article  Google Scholar 

  • van Rijn, P. W., & Ali, U. S. (2018a). A generalized speed-accuracy response model for dichotomous items. Psychometrika, 83, 109–131. https://doi.org/10.1007/s11336-017-9590-0

    Article  PubMed  Google Scholar 

  • van Rijn, P. W., & Ali, U. S. (2018b). SARM: A computer program for estimating speed-accuracy response models (ETS Research Report RR-18-15). Educational Testing Service.

    Google Scholar 

  • Verhelst, N. D. (2019). Exponential family models for continuous responses. In B. P. Veldkamp & C. Sluiter (Eds.), Theoretical and practical advances in computer-based educational measurement (pp. 135–160). Springer.

    Google Scholar 

  • Zwinderman, A. H. (1995). Pairwise parameter estimation in Rasch models. Applied Psychological Measurement, 19(4), 369–375.

    Article  Google Scholar 

  • Zwitser, R. J., & Maris, G. (2015). Conditional statistical inference with multistage testing designs. Psychometrika, 80(1), 65–84.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peter W. van Rijn .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rijn, P.W.v., Ali, U.S. (2023). A Speed-Accuracy Response Model with Conditional Dependence Between Items. In: Wiberg, M., Molenaar, D., González, J., Kim, JS., Hwang, H. (eds) Quantitative Psychology. IMPS 2022. Springer Proceedings in Mathematics & Statistics, vol 422. Springer, Cham. https://doi.org/10.1007/978-3-031-27781-8_11

Download citation

Publish with us

Policies and ethics