Psychometrika

, Volume 68, Issue 2, pp 251–265

Using response times to detect aberrant responses in computerized adaptive testing

  • Wim J. van der Linden
  • Edith M. L. A. van Krimpen-Stoop
Articles

DOI: 10.1007/BF02294800

Cite this article as:
van der Linden, W.J. & van Krimpen-Stoop, E.M.L.A. Psychometrika (2003) 68: 251. doi:10.1007/BF02294800

Abstract

A lognormal model for response times is used to check response times for aberrances in examinee behavior on computerized adaptive tests. Both classical procedures and Bayesian posterior predictive checks are presented. For a fixed examinee, responses and response times are independent; checks based on response times offer thus information independent of the results of checks on response patterns. Empirical examples of the use of classical and Bayesian checks for detecting two different types of aberrances in response times are presented. The detection rates for the Bayesian checks outperformed those for the classical checks, but at the cost of higher false-alarm rates. A guideline for the choice between the two types of checks is offered.

Key words

aberrant response patterns computerized adaptive testing posterior predictive checks person misfit residual analysis response times 

Copyright information

© The Psychometric Society 2003

Authors and Affiliations

  • Wim J. van der Linden
    • 1
  • Edith M. L. A. van Krimpen-Stoop
    • 1
  1. 1.Department of Research Methodology, Measurement and Data AnalysisUniversity of TwenteEnschedeThe Netherlands