Abstract
Computer games potentially offer a useful research tool for psychology but there has been little use made of them in assessing cognitive abilities. Two studies assessing the viability of a computer game-like test of cognitive processing speed are described. In Experiment 1, a computerized coding task that uses a mouse response method (McPherson & Burns, 2005) was the basis for a simple computer game-like test. In Experiment 2, dynamic game-like elements were added. Validity was assessed within a factor analytic framework using standardized abilities tests as marker tests. We conclude that computer game-like tests of processing speed may provide an alternative or supplementary tool for research and assessment. There is clearly potential to develop game-like tests for other cognitive abilities.
Article PDF
Similar content being viewed by others
References
Alderton, D. L., Wolfe, J. H., &Larson, G. E. (1997). The ECAT Battery.Military Psychology,9, 5–37.
Anderson, M. (1992).Intelligence and development: A cognitive theory. Oxford: Blackwell.
Bennett, R. E. (1998).Reinventing assessment: Speculations on the future of large-scale educational testing. Retrieved September 27, 2006, from www.ets.org/research/researcher/PIC-REINVENT.html.
Berger, A., Jones, L., Rothbart, M. K., &Posner, M. I. (2000). Computerized games to study the development of attention in childhood.Behavior Research Methods, Instruments, & Computers,32, 297–303.
Bors, D. A., &Stokes, T. L. (1998). Raven’s Advanced Progressive Matrices: Norms for first-year university students and the development of a short form.Educational & Psychological Measurement,58, 382–399.
Carpenter, P. A., Just, M. A., &Shell, P. (1990). What one intelligencetest measures—A theoretical account of the processing in the Raven Progressive Matrices test.Psychological Review,97, 404–431.
Carroll, J. B. (1993).Human cognitive abilities: A survey of factor analytic studies. New York: Cambridge University Press.
Cattell, R. B. (1943). The measurement of adult intelligence.Psychological Bulletin,40, 153–193.
Cattell, R. B. (1963). Theory for fluid and crystallized intelligence: A critical experiment.Journal of Educational Psychology,54, 1–22.
Cattell, R. B. (1966). The scree test for the number of factors.Multivariate Behavioral Research,1, 245–276.
Deary, I. J., &Caryl, P. G. (1997). Neuroscience and human intelligence differences.Trends in Neurosciences,20, 365–371.
Donchin, E. (1995). Video games as research tools: The Space Fortress Game.Behavior Research Methods, Instruments, & Computers,27, 217–223.
Embretson, S. E. (2003).The second century of ability testing: Some predictions and speculations (No. PIC-ANG7): Educational Testing Service: Policy Evaluation and Research Center.
Epstein, J., &Klinkenberg, W. D. (2001). From Eliza to Internet: A brief history of computerized assessment.Computers in Human Behavior,17, 295–314.
Graham, G., Cook, M., Cohen, M., Phelps, M., &Gerkovich, M. (1985). STAR: A unique embedded performance assessment technique.Behavior Research Methods, Instruments, & Computers,17, 642–651.
Horn, J. L., &Noll, J. (1997). Human cognitive capabilities: Gf-Gc theory. In D. P. Flanagan, J. L. Genshaft, & P. L. Harrison (Eds.),Contemporary intellectual assessment: Theories, tests and issues (pp. 53–91). New York: Guilford.
Jackson, D. N., III,Vernon, P. A., &Jackson, D. N. (1993). Dynamic spatial performance and general intelligence.Intelligence,17, 451–460.
Jensen, A. R. (1998).The g factor: The science of mental ability. New York: Praeger.
Jones, M., Dunlap, W. P., &Bilodeau, I. M. (1986). Comparison of video game and conventional test performance.Simulation & Games,17, 435–446.
Kroner, S., Plass, J. L., &Leutner, D. (2005). Intelligence assessment with computer simulations.Intelligence,33, 347–368.
McGrew, K., &Flanagan, D. P. (1998).The intelligence test desk reference (ITDR): Gf-Gc cross-battery assessment. Boston: Allyn & Bacon.
McPherson, J., &Burns, N. R. (2005). A speeded coding task using a computer-based mouse response.Behavior Research Methods,37, 538–544.
Mead, A. D., &Drasgow, F. (1994). Equivalence of computerized and paper-and-pencil tests: A meta-analysis.Psychological Bulletin,114, 449–458.
Montanelli, R. G. J., &Humphreys, L. G. (1976). Latent roots of random data correlation matrices with squared multiple correlations on the diagonal: A Monte Carlo study.Psychometrika,41, 341–348.
Peterson, N. G., Hough, L. M., Dunnette, M. D., Rosse, R. L., Houston, J. S., &Toquam, J. L. (1990). Project A: Specification of the predictor domain and development of new selection/classification tests.Personnel Psychology,43, 247–276.
Porter, D. B. (1995). Computer games: Paradigms of opportunity.Behavior Research Methods, Instruments, & Computers,27, 229–234.
Prokosch, M. D., Yeo, R. A., &Miller, G. F. (2005). Intelligence tests with higher g-loadings show higher correlations with body symmetry: Evidence for a general fitness factor mediated by developmental stability.Intelligence,33, 203–213.
Rabbitt, P., Banerji, N., &Szymanski, A. (1989). Space Fortress as an IQ test? Predictions of learning and of practised performance in a complex interactive video-game.Acta Psychologica,71, 243–257.
Ree, W. R., &Carretta, T. R. (1998). Computerized testing in the United States Air Force.International Journal of Selection & Assessment,6, 82–89.
Ryan, E. B. (1994). Memory for Goblins: A computer game for assessing and training working memory skill.Computers in Human Services,11, 213–217.
Stankov, L. (1998).g: A diminutive general. In R. J. Sternberg & E. L. Grigorenko (Eds.),The general factor of intelligence: How general is it? (pp. 19–37). Mahwah, NJ: Erlbaum.
Thurstone, L. L. (1938). The perceptual factor.Psychometrika,3, 1–17.
Thurstone, L. L. (1947).Multiple factor analysis. Chicago: University of Chicago Press.
Van de Vijver, F. J. R., &Harsveld, M. (1994). The incomplete equivalence of the paper-and-pencil and computerized versions of the General Aptitude Test battery.Journal of Applied Psychology,79, 852–859.
Washburn, D. A. (2003). The games psychologists play (and the data they provide).Behavior Research Methods, Instruments, & Computers,35, 185–193.
Wood, R. T. A., Griffiths, M. D., Chappell, D., &Davies, M. N. O. (2004). The structural characteristics of video games: A psychostructural analysis.Cyberpsychology & Behavior,7, 1–10.
Woodcock, R. W., &Johnson, M. B. (1989).Woodcock-Johnson Psycho-Educational Battery-Revised. Allen, TX: DLM Teaching Resources.
Woodcock, R. W., McGrew, K., &Mather, N. (2001).Woodcock- Johnson III Test of Cognitive Abilities. Itasca, IL: Riverside Publishing.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
McPherson, J., Burns, N.R. Gs Invaders: Assessing a computer game-like test of processing speed. Behavior Research Methods 39, 876–883 (2007). https://doi.org/10.3758/BF03192982
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03192982