Connecting Theory and Design Through Research: Cognitive Skills Training Games
- 1 Citations
- 1.4k Downloads
Abstract
How can the effectiveness of games for learning be enhanced? In this paper, we present an approach that connects theory and research to enhance the design of games that train cognitive skills. Specifically, we combine our model for designing games for learning with Value-Added Design Research, which can provide design guidance for decisions that the model alone cannot provide. We applied this method in the context of designing games to train executive functions, an application area that is highly promising but nevertheless has produced many games that are not effective. We discuss three examples of design research studies we conducted, including the emotional design of the game, the use of an adaptive algorithm, and the design of level progressions privileging either speed or accuracy in learners’ responses. We conclude that this approach is able to contribute to both the enhancement of CHI related design challenges and to theory.
Keywords
Game design methodology Value added research Executive functionsNotes
Acknowledgments
This work was partially supported by IES Grant R305A150417, “Focused Computer Games that Promote Executive Functions Skills, and by PSC-CUNY Award #60816-00 48: Virtual Reality and Emotional Design for the Development of Executive Functions in Adolescents.
References
- 1.Ahissar, M., Hochstein, S.: The reverse hierarchy theory of visual perceptual learning. Trends Cogn. Sci. 8(10), 457–464 (2004)CrossRefGoogle Scholar
- 2.Alexander, P.A., Judy, J.E.: The interaction of domain-specific and strategic knowledge in academic performance. Rev. Educ. Res. 58(4), 375–404 (1988)CrossRefGoogle Scholar
- 3.Alexander, M., Stuss, D.: Disorders of frontal lobe functioning. Semin. Neurol. 20, 427–437 (2000)CrossRefGoogle Scholar
- 4.Baddeley, A.D.: Exploring the central executive. Q. J. Exp. Psychol. 49A, 5–28 (1996)CrossRefGoogle Scholar
- 5.Biddiss, E., Irwin, J.: Active video games to promote physical activity in children and youth: a systematic review. Arch. Pediatr. Adolesc. Med. 164(7), 664–672 (2010)CrossRefGoogle Scholar
- 6.Blair, C., Razza, R.P.: Relating effortful control, executive function, and false belief understanding to emerging math and literacy ability in kindergarten. Child Dev. 78(2), 647–663 (2007)CrossRefGoogle Scholar
- 7.Blakemore, S.J., Choudhury, S.: Development of the adolescent brain: implications for executive function and social cognition. J. Child Psychol. Psychiatry 47(3–4), 296–312 (2006)CrossRefGoogle Scholar
- 8.Bogacz, R., Wagenmakers, E.J., Forstmann, B.U., Nieuwenhuis, S.: The neural basis of the speed–accuracy tradeoff. Trends Neurosci. 33(1), 10–16 (2010)CrossRefGoogle Scholar
- 9.Conati, C.: Probabilistic assessment of user’s emotions in educational games. Appl. Artif. Intell. 16(7–8), 555–575 (2002)CrossRefGoogle Scholar
- 10.Conchas, G.: The Color of Success: Race and High Achieving Urban Youth. Teachers College Press, New York (2006)Google Scholar
- 11.Connolly, T.M., Boyle, E.A., MacArthur, E., Hainey, T., Boyle, J.M.: A systematic literature review of empirical evidence on computer games and serious games. Comput. Educ. 59(2), 661–686 (2012)CrossRefGoogle Scholar
- 12.Craig, S., Graesser, A., Sullins, J., Gholson, B.: Affect and learning: an exploratory look into the role of affect in learning with AutoTutor. J. Educ. Media 29(3), 241–250 (2004)CrossRefGoogle Scholar
- 13.Desimone, L.: Linking parent involvement with student achievement: do race and income matter. J. Educ. Res. 93(1), 11–30 (1999)CrossRefGoogle Scholar
- 14.Diamond, A.: Executive functions. Annu. Rev. Psychol. 64, 135–168 (2013). https://doi.org/10.1146/annurev-psych-113011-143750CrossRefGoogle Scholar
- 15.Diamond, A., Lee, K.: Interventions shown to aid executive function development in children 4 to 12 years old. Science 333(6045), 959–964 (2011)CrossRefGoogle Scholar
- 16.Eriksen, B.A., Eriksen, C.W.: Effects of noise letters upon the identification of a target letter in a nonsearch task. Atten. Percept. Psychophys. 16(1), 143–149 (1974)CrossRefGoogle Scholar
- 17.Eriksen, C.W.: The flankers task and response competition: a useful tool for investigating a variety of cognitive problems. Vis. Cogn. 2(2–3), 101–118 (1995)CrossRefGoogle Scholar
- 18.Friedman, N.P., Miyake, A., Young, S.E., Defries, J.C., Corley, R.P., Hewitt, J.K.: Individual differences in executive functions are almost entirely genetic in origin. J. Exp. Psychol. 137(2), 201–225 (2009)CrossRefGoogle Scholar
- 19.Fullerton, T.: Game Design Workshop: A Playcentric Approach to Creating Innovative Games. CRC Press, Boca Raton (2014)CrossRefGoogle Scholar
- 20.Hedden, T., Yoon, C.: Individual differences in executive processing predict susceptibility to interference in verbal working memory. Neuropsychology 20(5), 511–528 (2006)CrossRefGoogle Scholar
- 21.Hoadley, C.M.: Methodological alignment in design-based research. Educ. Psychol. 39(4), 203–212 (2004)CrossRefGoogle Scholar
- 22.Holmes, J., Gathercole, S.E., Dunning, D.L.: Adaptive training leads to sustained enhancement of poor working memory in children. Dev. Sci. 12(4), F9–F15 (2009)CrossRefGoogle Scholar
- 23.Homer, B.D.: Using video games to enhance executive functions across the lifespan. In: Invited Symposium at Annual Meeting of the Jean Piaget Society, San Francisco (2017)Google Scholar
- 24.Huizinga, J.: Homo Ludens Versuch Einer Bestimmung des Spielelementest der Kultur. Pantheon Akademische Verlagsanstalt, Amsterdam (1939)Google Scholar
- 25.Isbister, K., Schaffer, N.: Game Usability: Advancing the Player Experience. CRC press, Boca Raton (2015)Google Scholar
- 26.Izard, C.E.: Basic emotions, natural kinds, emotion schemas, and a new paradigm. Perspect. Psychol. Sci. 2, 260–280 (2007)CrossRefGoogle Scholar
- 27.Klingberg, T., et al.: Computerized training of working memory in children with ADHD – a randomized, controlled, trial. J. Am. Acad. Child Adolesc. Psychiatry 44(2), 177–186 (2005)CrossRefGoogle Scholar
- 28.Lench, H.C., Flores, S.A., Bench, S.W.: Discrete emotions predict changes in cognition, judgment, experience, behavior, and physiology: a meta-analysis of experimental emotion elicitations. Psychol. Bull. 137(5), 834–855 (2011)CrossRefGoogle Scholar
- 29.MacKay, D.G.: The problems of flexibility, fluency, and speed–accuracy trade-off in skilled behavior. Psychol. Rev. 89(5), 483 (1982)CrossRefGoogle Scholar
- 30.Mayer, R.E.: Computer Games for Learning: An Evidence-Based Approach. MIT, Cambridge (2014)Google Scholar
- 31.Miller, M., Hinshaw, S.P.: Does childhood executive function predict adolescent functional outcomes in girls with ADHD? J. Abnorm. Child Psychol. 38(3), 315–326 (2010)CrossRefGoogle Scholar
- 32.Miyake, A., Friedman, N.P., Emerson, M.J., Witzki, A.H., Howerter, A., Wager, T.D.: The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: a latent variable analysis. Cogn. Psychol. 41(1), 49–100 (2000)CrossRefGoogle Scholar
- 33.Morrison, A.B., Chein, J.M.: Does working memory training work? The promise and challenges of enhancing cognition by training working memory. Psychon. Bull. Rev. 18(1), 46–60 (2011)CrossRefGoogle Scholar
- 34.Mullane, J.C., Corkum, P.V., Klein, R.M., McLaughlin, E.: Interference control in children with and without ADHD: a systematic review of Flanker and Simon task performance. Child Neuropsychol. 15(4), 321–342 (2009)CrossRefGoogle Scholar
- 35.Nouchi, R., et al.: Brain training game improves executive functions and processing speed in the elderly: a randomized controlled trial. PLoS ONE 7(1), e29676 (2012)CrossRefGoogle Scholar
- 36.Owen, A.M., et al.: Putting brain training to the test. Nature 465(7299), 775–778 (2010)CrossRefGoogle Scholar
- 37.Papastergiou, M.: Exploring the potential of computer and video games for health and physical education: a literature review. Comput. Educ. 53(3), 603–622 (2009)CrossRefGoogle Scholar
- 38.Parong, J., Mayer, R.E., Fiorella, L., MacNamara, A., Homer, B.D., Plass, J.L.: Learning executive function skills by playing focused video games. Contemp. Educ. Psychol. 51, 141–151 (2017)CrossRefGoogle Scholar
- 39.Pekrun, R.: The impact of emotions on learning and achievement: towards a theory of cognitive/motivational mediators. Appl. Psychol. 41(4), 359–376 (1992)CrossRefGoogle Scholar
- 40.Peng, W., Lin, J.H., Crouse, J.: Is playing exergames really exercising? A meta-analysis of energy expenditure in active video games. Cyberpsychol. Behav. Soc. Netw. 14(11), 681–688 (2011)CrossRefGoogle Scholar
- 41.Picard, R.W.: Affective Computing. MIT Press, Cambridge (1997)CrossRefGoogle Scholar
- 42.Plass, J.L., Homer, B.D.: Popular game mechanics as inspirations for learning mechanics and assessment mechanics. Paper Presented at the Game Developers Conference, 5–9 March 2012, San Francisco (2012)Google Scholar
- 43.Plass, J.L., Perlin, K., Nordlinger, J.: The games for learning institute: research on design patterns for effective educational games. Paper Presented at the Game Developers Conference, 9–13 March 2010, San Francisco (2010)Google Scholar
- 44.Plass, J.L., Heidig, S., Hayward, E.O., Homer, B.D., Um, E.: Emotional design in multimedia learning: effects of shape and color on affect and learning. Learn. Instr. 29, 128–140 (2014)CrossRefGoogle Scholar
- 45.Plass, J.L., Homer, B.D., Kinzer, C.K.: Foundations of game-based learning. Educ. Psychol. 50(4), 258–283 (2015)CrossRefGoogle Scholar
- 46.Plass, J.L., Kaplan, U.: Emotional design in digital media for learning. In: Emotions, Technology, Design, and Learning, pp. 131–161 (2015)CrossRefGoogle Scholar
- 47.Plass, J.L.: A taxonomy of adaptivity in learning. In: Panel on Personalized and Adaptive Learning Systems, CRESSTCON 2016, Los Angeles, CA, 20 September 2016 (2016)Google Scholar
- 48.Plass, J.L.: Basing the design of cognitive skills training games on developmental psychology. In: Invited Symposium Using Video Games to Enhance Executive Functions Across the Lifespan, Annual Meeting of the Jean Piaget Society, San Francisco, CA (2017)Google Scholar
- 49.Powers, K.L., Brooks, P.J., Aldrich, N.J., Palladino, M.A., Alfieri, L.: Effects of video-game play on information processing: a meta-analytic investigation. Psychon. Bull. Rev. 20(6), 1055–1079 (2013)CrossRefGoogle Scholar
- 50.Primack, B.A., et al.: Role of video games in improving health-related outcomes: a systematic review. Am. J. Prev. Med. 42(6), 630–638 (2012)CrossRefGoogle Scholar
- 51.Qu, L., Wang, N., Johnson, W.L.: Detecting the learner’s motivational states in an interactive learning environment. In: Looi, C.K., et al. (eds.) Artificial Intelligence in Education, pp. 547–554. IOS Press, Amsterdam (2005)Google Scholar
- 52.Rogers, R.D., Monsell, S.: Costs of a predictable switch between simple cognitive tasks. J. Exp. Psychol. Gen. 124(2), 207–231 (1995)CrossRefGoogle Scholar
- 53.Shah, J.J., Smith, S.M., Vargas-Hernandez, N.: Metrics for measuring ideation effectiveness. Des. Stud. 24(2), 111–134 (2003)CrossRefGoogle Scholar
- 54.Smith, E.E., Jonides, J.: Storage and executive processes in the frontal lobes. Science 283, 1657–1661 (1999)CrossRefGoogle Scholar
- 55.Squire, K.: Open-ended video games: a model for developing learning for the interactive age. In: Salen, K. (ed.) The John D. and Catherine T. MacArthur Foundation Series on Digital Media and Learning, pp. 167–198. MIT Press, Cambridge (2008)Google Scholar
- 56.Tobias, S.: Interest, prior knowledge, and learning. Rev. Educ. Res. 64(1), 37–54 (1994)CrossRefGoogle Scholar
- 57.Um, E., Plass, J.L., Hayward, E.O., Homer, B.D.: Emotional design in multimedia learning. J. Educ. Psychol. 104(2), 485 (2012)CrossRefGoogle Scholar
- 58.Von Bastian, C.C., Eschen, A.: Does working memory training have to be adaptive? Psychol. Res. 80(2), 181–194 (2016)CrossRefGoogle Scholar
- 59.Yeniad, N., Malda, M., Mesman, J., van IJzendoorn, M.H., Pieper, S.: Shifting ability predicts math and reading performance in children: a meta-analytical study. Learn. Individ. Differ. 23, 1–9 (2013)CrossRefGoogle Scholar
- 60.Young, S.E., et al.: Behavioral disinhibition: liability for externalizing spectrum disorders and its genetic and environmental relation to response inhibition across adolescence. J. Abnorm. Psychol. 118(1), 117 (2009)CrossRefGoogle Scholar
- 61.Zelazo, P.D.: The Dimensional Change Card Sort (DCCS): a method of assessing executive function in children. Nat. Protoc. 1(1), 297 (2006)CrossRefGoogle Scholar
- 62.Zelazo, P.D., Carlson, S.M.: Hot and cool executive function in childhood and adolescence: development and plasticity. Child. Dev. Perspect. 6(4), 354–360 (2012)Google Scholar