Skip to main content
SpringerLink
Log in
Book cover

Game-Based Assessment Revisited pp 105–119Cite as

Examining Designed Experiences: A Walkthrough for Understanding Video Games as Performance Assessments

  • Chapter
  • First Online:

Part of the book series: Advances in Game-Based Learning ((AGBL))

Abstract

Although there is an extensive body of video game research, very few resources exist that outline the potential for games to provide process-oriented data related to human behavior and learning. The current chapter offers guidance for researchers to extract dynamic, emergent, and complex data from video game contexts, and thus unlock the potential for games to function as performance assessments. This chapter describes how to leverage behavioral observation as a means to examine player interactions that are associated with knowledge acquisition, formative (within-game) activities, and summative (end-game) outcomes. Specifically, through employing a moral-choice video game as an example, we walk through deconstructing the game, defining game elements, and the construction of a behavioral observation protocol. Although some games aren’t well-suited for this approach, we provide a framework for how in-game player interactions can be captured, coded, and analyzed. Each step is used to illustrate how games can function as performance assessments.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Alevizos, P., DeRisi, W., Liberman, R., Eckman, T., & Callahan, E. (1978). The behavior observation instrument: A method of direct observation for program evaluation. Journal of Applied Behavior Analysis, 11(2), 243–257. https://doi.org/10.1901/jaba.1978.11-243

    Article  Google Scholar 

  • Anetta, L. A., Minogue, J., Holmes, S. Y., & Cheng, M. (2009). Investigating the impact of video games on high school students’ engagement and learning about genetics. Computers & Education, 53, 74–85.

    Article  Google Scholar 

  • de Freitas, S. (2018). Are games effective learning tools? A review of educational games. Journal of Educational Technology & Society, 21(2), 74–84. Retrieved from http://www.jstor.org/stable/26388380

    Google Scholar 

  • Dewey, J. (1899). The school and society. Chicago, IL: University of Chicago Press.

    Google Scholar 

  • Fortes Tondello, G., Valtchanov, D., Reetz, A., Wehbe, R. R., Orji, R., & Nacke, L. E. (2018). Towards a trait model of video game preferences. International Journal of Human–Computer Interaction, 34(8), 732–748.

    Article  Google Scholar 

  • Govaerts, M. J. B., Van der Vleuten, C. P. M., Schuwirth, L. W. T., & Muijtjens, A. M. M. (2007). Broadening perspectives on clinical performance assessment: Rethinking the nature of in-training assessment. Advances in Health Sciences Education, 12(2), 239–260. https://doi.org/10.1007/s10459-006-9043-1

    Article  Google Scholar 

  • Grab the Games. (2015). The deed [Computer software]. Retrieved from http://store.steampowered.com/app/420740/The_Deed/

  • Harvianinen, J. T., Lainema, T., & Saarinen, E. (2014). Player-reported impediments to game- based learning. Transactions of the Digital Games Research Association, 1(2), 1–11. Retrieved June 14, 2018, from http://todigra.org/index.php/todigra/article/view/14/21

    Google Scholar 

  • Jabbari, N., & Eslami, Z. R. (2019). Second language learning in the context of massively multiplayer online games: A scoping review. ReCALL, 31(1), 92–113.

    Article  Google Scholar 

  • Kline, T. (2005). Psychological testing: A practical approach to design and evaluation. Thousand Oaks, CA: Sage.

    Book  Google Scholar 

  • Little, T. D., Bovaird, J. A., & Slegers, D. W. (2006). Methods for the analysis of change. In D. K. Mroczek & T. D. Little (Eds.), Handbook of personality development (pp. 181–211). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.

    Google Scholar 

  • Mancini, T., Imperato, C., & Sibilla, F. (2019). Does avatar’s character and emotional bond expose to gaming addiction? Two studies on virtual self-discrepancy, avatar identification and gaming addiction in massively multiplayer online role-playing game players. Computers in Human Behavior, 92, 297–305.

    Article  Google Scholar 

  • McCreery, M. P., Krach, S. K., Schrader, P. G., & Boone, R. (2012). Defining the virtual self: Personality, behavior and the psychology of embodiment. Computers in Human Behavior, 28(3), 976–983. https://doi.org/10.1016/j.chb.2011.12.019

    Article  Google Scholar 

  • McCreery, M. P., Laferriere, J., Bacos, C. A., & Krach, S. K. (2018). Video games as a model for assessing learning behaviors. In American Educational Research Association Annual Conference, New York, NY.

    Google Scholar 

  • McCreery, M. P., Schrader, P. G., & Krach, S. K. (2011). Navigating massively multiplayer online games: Evaluating 21st century skills for learning within virtual environments. Journal of Educational Computing Research, 44(4), 473–493. https://doi.org/10.2190/EC.44.4.f

    Article  Google Scholar 

  • McCreery, M. P., Vallett, D., & Clark, C. (2015). Social interaction in a virtual environment: Examining sociospatial interactivity and social presence using behavioral analytics. Computers in Human Behavior, 51, 203–206. https://doi.org/10.1016/j.chb.2015.04.044

    Article  Google Scholar 

  • McHugh, M. L. (2012). Interrater reliability: The kappa statistic. Biochemia Medica, 22(3), 276–282. Retrieved from https://hrcak.srce.hr/89395

    Article  Google Scholar 

  • Milne, D. (Ed.). (2015). Evaluating mental health practice (psychology revivals): Methods and applications. London, UK: Routledge.

    Google Scholar 

  • Moore, M. G. (1993). Theory of transactional distance. In Theoretical principles of distance education (Vol. 1, pp. 22–38). London, UK: Routledge.

    Google Scholar 

  • Schrader, P. G., Deniz, H., & Keilty, J. (2016). Breaking SPORE: Building instructional value in science education using a commercial, off-the shelf game. Journal of Learning and Teaching in Digital Age, 1(1), 32–46. Retrieved from http://joltida.org/index.php/joltida/article/view/6/54

    Google Scholar 

  • Schrader, P. G., & McCreery, M. (2008). The acquisition of skill and expertise in massively multiplayer online games. Educational Technology Research & Development, 56(5–6), 557–574.

    Article  Google Scholar 

  • Schrader, P. G., & McCreery, M. (2012). Are all games the same? Examining three frameworks for assessing learning from, with, and in games. In D. Ifenthaler, D. Eseryel, & X. Ge (Eds.), Assessment in game-based learning: Foundations, innovations, and perspectives (pp. 11–28). New York, NY: Springer.

    Chapter  Google Scholar 

  • Schrader, P. G., McCreery, M. P., & Vallett, D. (2017). Performance in situ. In Y. K. Baek (Ed.), Game-based learning: Theory, strategies and performance outcomes (pp. 421–438). Hauppauge, NY: Nova Science Publishers.

    Google Scholar 

  • Shaffer, D. W., Squire, K. R., Halverson, R., & Gee, J. P. (2005). Video games and the future of learning. Phi Delta Kappan, 87(2), 104–111. https://doi.org/10.1177/003172170508700205

    Article  Google Scholar 

  • Shavelson, R., Baxter, G., & Gao, X. (1993). Sampling variability of performance assessments. Journal of Educational Measurement, 30(3), 215–232. Retrieved from http://www.jstor.org/stable/1435044

    Article  Google Scholar 

  • Shute, V. J., Ke, F., & Wang, L. (2017). Assessment and adaptation in games. In P. Wouters & H. van Oostendorp (Eds.), Instructional techniques to facilitate learning and motivation of serious games. Cham, Switzerland: Springer International Publishing. https://doi.org/10.1007/978-3-319-39298-1_4

    Chapter  Google Scholar 

  • Shute, V. J., Leighton, J. P., Jang, E. E., & Chu, M. W. (2016). Advances in the science of assessment. Educational Assessment, 21(1), 34–59.

    Article  Google Scholar 

  • Squire, K. D. (2011). Video games and learning: Teaching and participatory culture in the digital age. New York, NY: Teachers College Press.

    Google Scholar 

  • Stefanidis, K., Psaltis, A., Apostolakis, K. C., Dimitropoulos, K., & Daras, P. (2019). Learning prosocial skills through multiadaptive games: A case study. Journal of Computers in Education, 6, 167–190.

    Google Scholar 

  • Tapp, J., Wehby, J., & Ellis, D. (1995). A multiple option observation system for experimental studies: MOOSES. Behavior Research Methods, Instruments, & Computers, 27(1), 25–31.

    Article  Google Scholar 

  • Vallett, D. (2016). Soft failure in educational and learning games. In R. Lamb & D. McMahon (Eds.), Educational and learning games: New research. New York, NY: Nova Science.

    Google Scholar 

  • Wang, L., Shute, V., & Moore, G. R. (2015). Lessons learned and best practices of stealth assessment. International Journal of Gaming and Computer-Mediated Simulations, 7(4), 66–87.

    Article  Google Scholar 

  • Whiteside, A. L., & Garrett Dikkers, A. (2012). Using the Social Presence Model to maximize interactions in online environments. In K. S. Amant & S. Kelsey (Eds.), Computer-mediated communication across cultures: International interactions in online environments. Hershey, PA: IGI Global.

    Google Scholar 

  • Wouters, P., Van Nimwegen, C., Van Oostendorp, H., & Van der Spek, E. D. (2013). A meta-analysis of the cognitive and motivational effects of serious games. Journal of Educational Psychology, 105(2), 249–265. https://doi.org/10.1037/a0031311

    Article  Google Scholar 

  • Yen, W. (1993). Scaling performance assessments: Strategies for managing local item dependence. Journal of Educational Measurement, 30(3), 187–213. https://doi.org/10.1111/j.1745-3984.1993.tb00423.x

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Nevada, Las Vegas, Las Vegas, NV, USA

    Michael P. McCreery, P. G. Schrader, Catherine A. Bacos & Joseph P. Fiorentini

  2. Florida State University, Tallahassee, FL, USA

    S. Kathleen Krach

  3. Lebanon Valley College, Annville, PA, USA

    Jeffrey R. Laferriere

Authors
  1. Michael P. McCreery
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. P. G. Schrader
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. S. Kathleen Krach
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jeffrey R. Laferriere
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Catherine A. Bacos
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Joseph P. Fiorentini
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Michael P. McCreery .

Editor information

Editors and Affiliations

  1. Learning, Design and Technology, University of Mannheim, Mannheim, Germany

    Dirk Ifenthaler

  2. Teaching Systems Lab, Massachusetts Institute of Technology, Cambridge, MA, USA

    Yoon Jeon Kim

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

McCreery, M.P., Schrader, P.G., Krach, S.K., Laferriere, J.R., Bacos, C.A., Fiorentini, J.P. (2019). Examining Designed Experiences: A Walkthrough for Understanding Video Games as Performance Assessments. In: Ifenthaler, D., Kim, Y.J. (eds) Game-Based Assessment Revisited. Advances in Game-Based Learning. Springer, Cham. https://doi.org/10.1007/978-3-030-15569-8_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-15569-8_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-15568-1

  • Online ISBN: 978-3-030-15569-8

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation