Advertisement

Connecting Theory and Design Through Research: Cognitive Skills Training Games

  • Jan L. PlassEmail author
  • Bruce D. Homer
  • Shashank Pawar
  • Frankie Tam
Conference paper
First Online:
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11243)

Abstract

How can the effectiveness of games for learning be enhanced? In this paper, we present an approach that connects theory and research to enhance the design of games that train cognitive skills. Specifically, we combine our model for designing games for learning with Value-Added Design Research, which can provide design guidance for decisions that the model alone cannot provide. We applied this method in the context of designing games to train executive functions, an application area that is highly promising but nevertheless has produced many games that are not effective. We discuss three examples of design research studies we conducted, including the emotional design of the game, the use of an adaptive algorithm, and the design of level progressions privileging either speed or accuracy in learners’ responses. We conclude that this approach is able to contribute to both the enhancement of CHI related design challenges and to theory.

Keywords

Game design methodology Value added research Executive functions 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgments

This work was partially supported by IES Grant R305A150417, “Focused Computer Games that Promote Executive Functions Skills, and by PSC-CUNY Award #60816-00 48: Virtual Reality and Emotional Design for the Development of Executive Functions in Adolescents.

References

  1. 1.
    Ahissar, M., Hochstein, S.: The reverse hierarchy theory of visual perceptual learning. Trends Cogn. Sci. 8(10), 457–464 (2004)CrossRefGoogle Scholar
  2. 2.
    Alexander, P.A., Judy, J.E.: The interaction of domain-specific and strategic knowledge in academic performance. Rev. Educ. Res. 58(4), 375–404 (1988)CrossRefGoogle Scholar
  3. 3.
    Alexander, M., Stuss, D.: Disorders of frontal lobe functioning. Semin. Neurol. 20, 427–437 (2000)CrossRefGoogle Scholar
  4. 4.
    Baddeley, A.D.: Exploring the central executive. Q. J. Exp. Psychol. 49A, 5–28 (1996)CrossRefGoogle Scholar
  5. 5.
    Biddiss, E., Irwin, J.: Active video games to promote physical activity in children and youth: a systematic review. Arch. Pediatr. Adolesc. Med. 164(7), 664–672 (2010)CrossRefGoogle Scholar
  6. 6.
    Blair, C., Razza, R.P.: Relating effortful control, executive function, and false belief understanding to emerging math and literacy ability in kindergarten. Child Dev. 78(2), 647–663 (2007)CrossRefGoogle Scholar
  7. 7.
    Blakemore, S.J., Choudhury, S.: Development of the adolescent brain: implications for executive function and social cognition. J. Child Psychol. Psychiatry 47(3–4), 296–312 (2006)CrossRefGoogle Scholar
  8. 8.
    Bogacz, R., Wagenmakers, E.J., Forstmann, B.U., Nieuwenhuis, S.: The neural basis of the speed–accuracy tradeoff. Trends Neurosci. 33(1), 10–16 (2010)CrossRefGoogle Scholar
  9. 9.
    Conati, C.: Probabilistic assessment of user’s emotions in educational games. Appl. Artif. Intell. 16(7–8), 555–575 (2002)CrossRefGoogle Scholar
  10. 10.
    Conchas, G.: The Color of Success: Race and High Achieving Urban Youth. Teachers College Press, New York (2006)Google Scholar
  11. 11.
    Connolly, T.M., Boyle, E.A., MacArthur, E., Hainey, T., Boyle, J.M.: A systematic literature review of empirical evidence on computer games and serious games. Comput. Educ. 59(2), 661–686 (2012)CrossRefGoogle Scholar
  12. 12.
    Craig, S., Graesser, A., Sullins, J., Gholson, B.: Affect and learning: an exploratory look into the role of affect in learning with AutoTutor. J. Educ. Media 29(3), 241–250 (2004)CrossRefGoogle Scholar
  13. 13.
    Desimone, L.: Linking parent involvement with student achievement: do race and income matter. J. Educ. Res. 93(1), 11–30 (1999)CrossRefGoogle Scholar
  14. 14.
    Diamond, A.: Executive functions. Annu. Rev. Psychol. 64, 135–168 (2013).  https://doi.org/10.1146/annurev-psych-113011-143750CrossRefGoogle Scholar
  15. 15.
    Diamond, A., Lee, K.: Interventions shown to aid executive function development in children 4 to 12 years old. Science 333(6045), 959–964 (2011)CrossRefGoogle Scholar
  16. 16.
    Eriksen, B.A., Eriksen, C.W.: Effects of noise letters upon the identification of a target letter in a nonsearch task. Atten. Percept. Psychophys. 16(1), 143–149 (1974)CrossRefGoogle Scholar
  17. 17.
    Eriksen, C.W.: The flankers task and response competition: a useful tool for investigating a variety of cognitive problems. Vis. Cogn. 2(2–3), 101–118 (1995)CrossRefGoogle Scholar
  18. 18.
    Friedman, N.P., Miyake, A., Young, S.E., Defries, J.C., Corley, R.P., Hewitt, J.K.: Individual differences in executive functions are almost entirely genetic in origin. J. Exp. Psychol. 137(2), 201–225 (2009)CrossRefGoogle Scholar
  19. 19.
    Fullerton, T.: Game Design Workshop: A Playcentric Approach to Creating Innovative Games. CRC Press, Boca Raton (2014)CrossRefGoogle Scholar
  20. 20.
    Hedden, T., Yoon, C.: Individual differences in executive processing predict susceptibility to interference in verbal working memory. Neuropsychology 20(5), 511–528 (2006)CrossRefGoogle Scholar
  21. 21.
    Hoadley, C.M.: Methodological alignment in design-based research. Educ. Psychol. 39(4), 203–212 (2004)CrossRefGoogle Scholar
  22. 22.
    Holmes, J., Gathercole, S.E., Dunning, D.L.: Adaptive training leads to sustained enhancement of poor working memory in children. Dev. Sci. 12(4), F9–F15 (2009)CrossRefGoogle Scholar
  23. 23.
    Homer, B.D.: Using video games to enhance executive functions across the lifespan. In: Invited Symposium at Annual Meeting of the Jean Piaget Society, San Francisco (2017)Google Scholar
  24. 24.
    Huizinga, J.: Homo Ludens Versuch Einer Bestimmung des Spielelementest der Kultur. Pantheon Akademische Verlagsanstalt, Amsterdam (1939)Google Scholar
  25. 25.
    Isbister, K., Schaffer, N.: Game Usability: Advancing the Player Experience. CRC press, Boca Raton (2015)Google Scholar
  26. 26.
    Izard, C.E.: Basic emotions, natural kinds, emotion schemas, and a new paradigm. Perspect. Psychol. Sci. 2, 260–280 (2007)CrossRefGoogle Scholar
  27. 27.
    Klingberg, T., et al.: Computerized training of working memory in children with ADHD – a randomized, controlled, trial. J. Am. Acad. Child Adolesc. Psychiatry 44(2), 177–186 (2005)CrossRefGoogle Scholar
  28. 28.
    Lench, H.C., Flores, S.A., Bench, S.W.: Discrete emotions predict changes in cognition, judgment, experience, behavior, and physiology: a meta-analysis of experimental emotion elicitations. Psychol. Bull. 137(5), 834–855 (2011)CrossRefGoogle Scholar
  29. 29.
    MacKay, D.G.: The problems of flexibility, fluency, and speed–accuracy trade-off in skilled behavior. Psychol. Rev. 89(5), 483 (1982)CrossRefGoogle Scholar
  30. 30.
    Mayer, R.E.: Computer Games for Learning: An Evidence-Based Approach. MIT, Cambridge (2014)Google Scholar
  31. 31.
    Miller, M., Hinshaw, S.P.: Does childhood executive function predict adolescent functional outcomes in girls with ADHD? J. Abnorm. Child Psychol. 38(3), 315–326 (2010)CrossRefGoogle Scholar
  32. 32.
    Miyake, A., Friedman, N.P., Emerson, M.J., Witzki, A.H., Howerter, A., Wager, T.D.: The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: a latent variable analysis. Cogn. Psychol. 41(1), 49–100 (2000)CrossRefGoogle Scholar
  33. 33.
    Morrison, A.B., Chein, J.M.: Does working memory training work? The promise and challenges of enhancing cognition by training working memory. Psychon. Bull. Rev. 18(1), 46–60 (2011)CrossRefGoogle Scholar
  34. 34.
    Mullane, J.C., Corkum, P.V., Klein, R.M., McLaughlin, E.: Interference control in children with and without ADHD: a systematic review of Flanker and Simon task performance. Child Neuropsychol. 15(4), 321–342 (2009)CrossRefGoogle Scholar
  35. 35.
    Nouchi, R., et al.: Brain training game improves executive functions and processing speed in the elderly: a randomized controlled trial. PLoS ONE 7(1), e29676 (2012)CrossRefGoogle Scholar
  36. 36.
    Owen, A.M., et al.: Putting brain training to the test. Nature 465(7299), 775–778 (2010)CrossRefGoogle Scholar
  37. 37.
    Papastergiou, M.: Exploring the potential of computer and video games for health and physical education: a literature review. Comput. Educ. 53(3), 603–622 (2009)CrossRefGoogle Scholar
  38. 38.
    Parong, J., Mayer, R.E., Fiorella, L., MacNamara, A., Homer, B.D., Plass, J.L.: Learning executive function skills by playing focused video games. Contemp. Educ. Psychol. 51, 141–151 (2017)CrossRefGoogle Scholar
  39. 39.
    Pekrun, R.: The impact of emotions on learning and achievement: towards a theory of cognitive/motivational mediators. Appl. Psychol. 41(4), 359–376 (1992)CrossRefGoogle Scholar
  40. 40.
    Peng, W., Lin, J.H., Crouse, J.: Is playing exergames really exercising? A meta-analysis of energy expenditure in active video games. Cyberpsychol. Behav. Soc. Netw. 14(11), 681–688 (2011)CrossRefGoogle Scholar
  41. 41.
    Picard, R.W.: Affective Computing. MIT Press, Cambridge (1997)CrossRefGoogle Scholar
  42. 42.
    Plass, J.L., Homer, B.D.: Popular game mechanics as inspirations for learning mechanics and assessment mechanics. Paper Presented at the Game Developers Conference, 5–9 March 2012, San Francisco (2012)Google Scholar
  43. 43.
    Plass, J.L., Perlin, K., Nordlinger, J.: The games for learning institute: research on design patterns for effective educational games. Paper Presented at the Game Developers Conference, 9–13 March 2010, San Francisco (2010)Google Scholar
  44. 44.
    Plass, J.L., Heidig, S., Hayward, E.O., Homer, B.D., Um, E.: Emotional design in multimedia learning: effects of shape and color on affect and learning. Learn. Instr. 29, 128–140 (2014)CrossRefGoogle Scholar
  45. 45.
    Plass, J.L., Homer, B.D., Kinzer, C.K.: Foundations of game-based learning. Educ. Psychol. 50(4), 258–283 (2015)CrossRefGoogle Scholar
  46. 46.
    Plass, J.L., Kaplan, U.: Emotional design in digital media for learning. In: Emotions, Technology, Design, and Learning, pp. 131–161 (2015)CrossRefGoogle Scholar
  47. 47.
    Plass, J.L.: A taxonomy of adaptivity in learning. In: Panel on Personalized and Adaptive Learning Systems, CRESSTCON 2016, Los Angeles, CA, 20 September 2016 (2016)Google Scholar
  48. 48.
    Plass, J.L.: Basing the design of cognitive skills training games on developmental psychology. In: Invited Symposium Using Video Games to Enhance Executive Functions Across the Lifespan, Annual Meeting of the Jean Piaget Society, San Francisco, CA (2017)Google Scholar
  49. 49.
    Powers, K.L., Brooks, P.J., Aldrich, N.J., Palladino, M.A., Alfieri, L.: Effects of video-game play on information processing: a meta-analytic investigation. Psychon. Bull. Rev. 20(6), 1055–1079 (2013)CrossRefGoogle Scholar
  50. 50.
    Primack, B.A., et al.: Role of video games in improving health-related outcomes: a systematic review. Am. J. Prev. Med. 42(6), 630–638 (2012)CrossRefGoogle Scholar
  51. 51.
    Qu, L., Wang, N., Johnson, W.L.: Detecting the learner’s motivational states in an interactive learning environment. In: Looi, C.K., et al. (eds.) Artificial Intelligence in Education, pp. 547–554. IOS Press, Amsterdam (2005)Google Scholar
  52. 52.
    Rogers, R.D., Monsell, S.: Costs of a predictable switch between simple cognitive tasks. J. Exp. Psychol. Gen. 124(2), 207–231 (1995)CrossRefGoogle Scholar
  53. 53.
    Shah, J.J., Smith, S.M., Vargas-Hernandez, N.: Metrics for measuring ideation effectiveness. Des. Stud. 24(2), 111–134 (2003)CrossRefGoogle Scholar
  54. 54.
    Smith, E.E., Jonides, J.: Storage and executive processes in the frontal lobes. Science 283, 1657–1661 (1999)CrossRefGoogle Scholar
  55. 55.
    Squire, K.: Open-ended video games: a model for developing learning for the interactive age. In: Salen, K. (ed.) The John D. and Catherine T. MacArthur Foundation Series on Digital Media and Learning, pp. 167–198. MIT Press, Cambridge (2008)Google Scholar
  56. 56.
    Tobias, S.: Interest, prior knowledge, and learning. Rev. Educ. Res. 64(1), 37–54 (1994)CrossRefGoogle Scholar
  57. 57.
    Um, E., Plass, J.L., Hayward, E.O., Homer, B.D.: Emotional design in multimedia learning. J. Educ. Psychol. 104(2), 485 (2012)CrossRefGoogle Scholar
  58. 58.
    Von Bastian, C.C., Eschen, A.: Does working memory training have to be adaptive? Psychol. Res. 80(2), 181–194 (2016)CrossRefGoogle Scholar
  59. 59.
    Yeniad, N., Malda, M., Mesman, J., van IJzendoorn, M.H., Pieper, S.: Shifting ability predicts math and reading performance in children: a meta-analytical study. Learn. Individ. Differ. 23, 1–9 (2013)CrossRefGoogle Scholar
  60. 60.
    Young, S.E., et al.: Behavioral disinhibition: liability for externalizing spectrum disorders and its genetic and environmental relation to response inhibition across adolescence. J. Abnorm. Psychol. 118(1), 117 (2009)CrossRefGoogle Scholar
  61. 61.
    Zelazo, P.D.: The Dimensional Change Card Sort (DCCS): a method of assessing executive function in children. Nat. Protoc. 1(1), 297 (2006)CrossRefGoogle Scholar
  62. 62.
    Zelazo, P.D., Carlson, S.M.: Hot and cool executive function in childhood and adolescence: development and plasticity. Child. Dev. Perspect. 6(4), 354–360 (2012)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.New York UniversityNew YorkUSA
  2. 2.The Graduate Center, CUNYNew YorkUSA

Personalised recommendations

Cite paper

Buy options