Psychometrika

, Volume 73, Issue 3, pp 365–384

Bayesian Procedures for Identifying Aberrant Response-Time Patterns in Adaptive Testing

Theory and Methods

DOI: 10.1007/s11336-007-9046-8

Cite this article as:
van der Linden, W.J. & Guo, F. Psychometrika (2008) 73: 365. doi:10.1007/s11336-007-9046-8

Abstract

In order to identify aberrant response-time patterns on educational and psychological tests, it is important to be able to separate the speed at which the test taker operates from the time the items require. A lognormal model for response times with this feature was used to derive a Bayesian procedure for detecting aberrant response times. Besides, a combination of the response-time model with a regular response model in an hierarchical framework was used in an alternative procedure for the detection of aberrant response times, in which collateral information on the test takers’ speed is derived from their response vectors. The procedures are illustrated using a data set for the Graduate Management Admission Test® (GMAT®). In addition, a power study was conducted using simulated cheating behavior on an adaptive test.

Keywords

adaptive testingBayesian predictive checkscheatingcollateral informationhierarchical modelingresponse times

Copyright information

© The Psychometric Society 2008

Authors and Affiliations

  1. 1.Department of Research Methodology, Measurement, and Data AnalysisUniversity of TwenteEnschedeThe Netherlands
  2. 2.Graduate Management Admission CouncilMcLeanUSA