Games, Learning, and Assessment
Learning in games has historically been assessed indirectly and/or in a post hoc manner. What’s needed instead is real-time assessment and support of learning based on the dynamic needs of players. We need to be able to experimentally determine the degree to which games can support learning, and how and why they achieve this objective. In this chapter we describe an approach to designing and developing evidence-based diagnostic assessments that may be embedded in a game environment. When embedded assessments are so seamlessly woven into the game that they’re virtually invisible, we call this “stealth assessment.” Embedding assessments within games provides a way to monitor a player’s current level on valued competencies, and then use that information as the basis for support, such as adjusting the difficulty level of challenges or providing a report for the teacher.
KeywordsCompetency Model Educational Game Digital Game Game Environment 21st Century Skill
We’d like to offer special thanks to Matthew Ventura and Yoon Jeon Kim for their help on conceptualizing various parts of this paper, regarding the categorization of the seven core elements of games and game-based assessment issues.
- Anderson, J. R. (1995). Learning and memory: An integrated approach. New York: Wiley.Google Scholar
- Bethesda Softworks (2006). Elder schools VI: Oblivion. Retrieved April 9, 2012, from http://www.bethsoft.com/games/games_oblivion.html.
- Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32–42.Google Scholar
- Bruner, J. S. (1961). The act of discovery. Harvard Educational Review, 31(1), 21–32.Google Scholar
- Csikszentmihalyi, M. (1990). Flow: The psychology of optical experience. New York: Harper Perrennial.Google Scholar
- Dempsey, J. V., Rasmussen, K., & Lucassen, B. (1996). Instructional gaming: Implications for instructional technology. Paper presented at the annual meeting of the Association for Educational Communications and Technology, Nashville, TN.Google Scholar
- Emes, C. E. (1997). Is Mr Pac Man eating our children? A review of the effect of digital games on children. Canadian Journal of Psychiatry, 42(4), 409–414.Google Scholar
- Falmagne, J.-C., Cosyn, E., Doignon, J.-P., & Thiery, N. (2003). The assessment of knowledge, in theory and in practice. In R. Missaoui & J. Schmidt (Eds.), Fourth international conference on formal concept analysis (Lecture notes in computer science, Vol. 3874, pp. 61–79). New York: Springer.CrossRefGoogle Scholar
- Gee, J. P. (2003). What digital games have to teach us about learning and literacy. New York: Palgrave Macmillan.Google Scholar
- Gee, J. P. (2009). Deep learning properties of good digital games: How far can they go? In U. Ritterfeld, M. Cody, & P. Vorderer (Eds.), Serious games: Mechanisms and effects (pp. 65–80). New York: Routledge.Google Scholar
- Gonzales, P., Williams, T., Jocelyn, L., Roey, S., Kastberg, D., & Brenwald, S. (2008). Highlights from TIMSS 2007: Mathematics and science achievement of U.S. fourth- and eighth-grade students in an international context (NCES 2009–001). Washington, DC: National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education.Google Scholar
- Hays, R. T. (2005). The effectiveness of instructional games: A literature review and discussion. Retrieved May 10, 2006, from http://adlcommunity.net/file.php/23/GrooveFiles/Instr_Game_Review_Tr_2005.pdf.
- Hogle, J. G. (1996). Considering games as cognitive tools: In search of effective “Edutainment”. Retrieved January 12, 2005, from ERIC, ED 425737.Google Scholar
- Howard, L. F., Paul, J. H., Marisa, P. P., & Brooke, E. S. (2010). Highlights from PISA 2009: Performance of U.S. 15-year-old students in reading, mathematics, and science literacy in an international context (NCES 2011–004). Washington, DC: National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education.Google Scholar
- Kafai, Y. B. (2005). The classroom as “living laboratory”: Design-based research for understanding, comparing, and evaluating learning science through design. Educational Technology, 65(1), 28–34.Google Scholar
- Klopfer, E., Osterweil, S., & Salen, K. (2009). Moving learning games forward: Obstacles, opportunities & openness. Cambridge, MA: The Education Arcade.Google Scholar
- Laurel, B. (1991). Computers as theatre. Reading, MA: Addison-Wesley.Google Scholar
- Malone, T. W., & Lepper, M. R. (1987). Making learning fun: A taxonomy of intrinsic motivations for learning. In R. E. Snow & M. J. Farr (Eds.), Aptitude, learning and instruction: III. Cognitive and affective process analyses (pp. 223–253). Hilsdale, NJ: Erlbaum.Google Scholar
- McGonigal, J. (2011). Reality is broken: Why games make us better and how they can change the world. New York: Penguin Press.Google Scholar
- Mislevy, R. J. (1994). Evidence and inference in educational assessment. Psychometrika, 59, 439–483.Google Scholar
- Mislevy, R. J., & Haertel, G. D. (2006). Implications of evidence-centered design for educational testing. Educational Measurement: Issues and Practice, 25(4), 6–20.Google Scholar
- Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003). On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives, 1, 3–62.Google Scholar
- Partnership for 21st Century Skills. (2006). Results that matter: 21st century skills and high school reform. Retrieved from April 28, 2012. http://www.p21.org/documents/RTM2006.pdf.
- Pellegrini, A. D. (1995). The future of play theory: A multidisciplinary inquiry into the contributions of Brian Sutton-Smith. Albany, NY: State University of New York Press.Google Scholar
- Pillay, H. (2002). An investigation of cognitive processes engaged in by recreational computer game players: Implications for skills of the future. Journal of Research on Technology in Education, 34(3), 336–350.Google Scholar
- Pillay, H., Brownlee, J., & Wilss, L. (1999). Cognition and recreational computer games: Implications for educational technology. Journal of Research on Computing in Education, 32(1), 203.Google Scholar
- Prensky, M. (2001). Digital game-based learning. New York: McGraw-Hill.Google Scholar
- Prensky, M. (2006). Don’t bother me mom, I’m learning!: How computer and digital games are preparing your kids for 21st century success and how you can help! St. Paul, MN: Paragon House.Google Scholar
- Quinn, C. (2005). Engaging learning: Designing e-learning simulation games. San Francisco: Pfeiffer.Google Scholar
- Rupp, A. A., Gushta, M., Mislevy, R. J., & Shaffer, D. W. (2010). Evidence-centered design of epistemic games: Measurement principles for complex learning environments. The Journal of Technology, Learning, and Assessment, 8(4). Retrieved April 9, 2012, from http://escholarship.bc.edu/jtla/vol8/4.
- Salen, K., & Zimmerman, E. (2005). Game design and meaningful play. In J. Raessens & J. Goldstein (Eds.), Handbook of computer game studies (pp. 59–80). Cambridge, MA: MIT Press.Google Scholar
- Shaffer, D. W. (2005). Studio mathematics: The epistemology and practice of design pedagogy as a model for mathematics learning. Wisconsin Center for Education Research Working paper, No. 2005-3.Google Scholar
- Shaffer, D. W. (2007). How computer games help children learn. New York: Palgrave.Google Scholar
- Shaffer, D. W., Squire, K. A., Halverson, R., & Gee, J. P. (2005). Digital games and the future of learning. Phi Delta Kappan, 87(2), 104–111.Google Scholar
- Shute, V. J. (2007). Tensions, trends, tools, and technologies: Time for an educational sea change. In C. A. Dwyer (Ed.), The future of assessment: Shaping teaching and learning (pp. 139–187). New York: Lawrence Erlbaum/Taylor & Francis.Google Scholar
- Shute, V. J. (2011). Stealth assessment in computer-based games to support learning. In S. Tobias & J. D. Fletcher (Eds.), Computer games and instruction (pp. 503–524). Charlotte, NC: Information Age.Google Scholar
- Shute, V. J., Rieber, L., & Van Eck, R. (2011). Games … and … learning. In R. Reiser & J. Dempsey (Eds.), Trends and issues in instructional design and technology (3rd ed., pp. 321–332). Upper Saddle River, NJ: Pearson Education.Google Scholar
- Shute, V. J., Ventura, M., Bauer, M. I., & Zapata-Rivera, D. (2009). Melding the power of serious games and embedded assessment to monitor and foster learning: Flow and grow. In U. Ritterfeld, M. Cody, & P. Vorderer (Eds.), Serious games: Mechanisms and effects (pp. 295–321). Mahwah, NJ: Routledge, Taylor and Francis.Google Scholar
- Squire, K. (2004). Replaying history: Learning world history through playing Civilization III. ProQuest Dissertations, Indiana University.Google Scholar
- Steinberg, L. S., & Gitomer, D. G. (1996). Intelligent tutoring and assessment built on an understanding of a technical problem-solving task. Instructional Science, 24, 223–258.Google Scholar
- Suits, B. H. (1978). The grasshopper: Games, life and utopia. Toronto, ON: University of Toronto Press.Google Scholar
- Vygotsky, L. S. (1978). Mind in society: The development of higher mental processes. Cambridge, MA: Harvard University Press.Google Scholar
- Vygotsky, L. S. (1987). The collected works of L. S. Vygotsky. New York: Plenum.Google Scholar
- Zimmerman, B. J., & Schunk, D. H. (2001). Self-regulated learning and academic achievement: Theoretical perspectives. Mahwah, NJ: Lawrence Erlbaum.Google Scholar