Bayesian Procedures for Identifying Aberrant Response-Time Patterns in Adaptive Testing
- 401 Downloads
In order to identify aberrant response-time patterns on educational and psychological tests, it is important to be able to separate the speed at which the test taker operates from the time the items require. A lognormal model for response times with this feature was used to derive a Bayesian procedure for detecting aberrant response times. Besides, a combination of the response-time model with a regular response model in an hierarchical framework was used in an alternative procedure for the detection of aberrant response times, in which collateral information on the test takers’ speed is derived from their response vectors. The procedures are illustrated using a data set for the Graduate Management Admission Test® (GMAT®). In addition, a power study was conducted using simulated cheating behavior on an adaptive test.
Keywordsadaptive testing Bayesian predictive checks cheating collateral information hierarchical modeling response times
Unable to display preview. Download preview PDF.
- Casella, G., & Berger, R.L. (2002). Statistical inference (2nd ed.). Pacific Grove: Duxbury. Google Scholar
- Fisher, R.A. (1925). Statistical methods for research workers. Edinburgh: Oliver & Boyd. Google Scholar
- Gelman, A., Carlin, J.B, Stern, H., & Rubin, D.B. (1995). Bayesian data analysis. London: Chapman & Hall. Google Scholar
- Johnson, V.E., & Albert, J.H. (1999). Ordinal data modeling. New York: Springer. Google Scholar
- Lord, F.M., & Novick, M.R. (1968). Statistical theories of mental test scores. Reading: Addison-Wesley. Google Scholar
- Owen, R.J. (1969). A Bayesian approach to tailored testing (Research Report 69-92). Princeton, NJ, Educational Testing Service. Google Scholar
- van der Linden, W.J. (2008). Using response times for item selection in adaptive tests. Journal of Educational and Behavioral Statistics, 33. In press. Google Scholar