Skip to main content

Vicarious Learning with a Digital Educational Game: Eye-Tracking and Survey-Based Evaluation Approaches

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 6389))

Abstract

The paper presents an empirical study with a digital educational game (DEG) called 80Days that aims at teaching geographical content. The goal of the study is twofold: (i) investigating the potential of the eye-tracking approach for evaluating DEG; (ii) studying the issue of vicarious learning in the context of DEG. Twenty-four university students were asked to view the videos of playing two micro-missions of 80Days, which varied with regard to the position of the non-player character (NPC) window (i.e. lower right vs. upper left) and the delivery of cognitive hints (i.e. with vs. without) in this text window. Eye movements of the participants were recorded with an eye-tracker. Learning effect and user experience were measured by questionnaires and interviews. Significant differences between the pre- and post-learning assessment tests suggest that observers can benefit from passive viewing of the recorded gameplay. However, the hypotheses that the game versions with cognitive hints and with the NPC window on the upper left corner can induce stronger visual attention and thus better learning effect are refuted.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Jacob, R.J.K., Karn, K.S.: Eye Tracking in Human-Computer Interaction and Usability Research: Ready to Deliver the Promises. In: Hyona, R., Deubel (eds.) The Mind’s Eye: Cognitive and Applied Aspects of Eye Movement Research, Elsevier, Oxford (2003)

    Google Scholar 

  2. Poole, A., Ball, L.J.: Eye tracking in HCI and Usability Research. In: Ghaoui, C. (ed.) Encyclopedia of Human-Computer Interaction. Idea Group Inc., Pennsylvania (2006)

    Google Scholar 

  3. Buscher, G., Cutrell, E., Morris, M.R.: What Do You See When You’re Surfing? Using Eye Tracking to Predict Salient Regions of Web Pages. In: Proceedings of CHI 2009, pp. 21–30 (2009)

    Google Scholar 

  4. Cutrell, E., Guan, Z.: What Are You Looking for? An Eye-Tracking Study of Information Usage in Web Search. In: Proceedings of CHI 2007, pp. 407–416 (2007)

    Google Scholar 

  5. Sundstedt, V., Stavrakis, E., Wimmer, M., Reinhard, E.: A Psychophysical Study of Fixation Behavior in a Computer Game. In: Creem-Regehr, S., Myszkowski, K. (eds.) Proceedings of the 5th Symposium on Applied Perception in Graphics and Visualization, pp. 43–50 (2008)

    Google Scholar 

  6. Nacke, L.E., Grimshaw, M.N., Lindley, C.A.: More Than a Feeling: Measurement of Sonic User Experience and Psychophysiology in a First-Person Shooter Game. Interacting with Computers 22(5) (2010)

    Google Scholar 

  7. Hornbæk, K., Law, E.L.-C.: Meta-Analysis of Correlations among Usability Measures. In: Proceedings of CHI 2007, pp. 617–626 (2007)

    Google Scholar 

  8. Lin, T., Hu, W.: Do Physiological Data Relate to Traditional Usability Indexes? In: Proceedings of OZCHI 2005, Canberra, Australia (23-25, 2005)

    Google Scholar 

  9. Jennett, C., Cox, A.L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., Walton, A.: Measuring and Defining the Experience of Immersion in Games. International Journal of Human Computer Studies 66(9), 641–661 (2008)

    Article  Google Scholar 

  10. Johansen, S.A., Noergaard, M., Janus, R.: Can Eye Tracking Boost Usability Evaluation of Computer Games? In: Proceedings of CHI 2008, Workshop on Evaluating User Experience in Game (2008)

    Google Scholar 

  11. Gholson, B., Witherspoon, A., Morgan, B., Brittingham, J.K., Coles, R., Graesser, A.C., Sullins, J., Craig, S.D.: Exploring the Deep-Level Reasoning Questions Effect during Vicarious Learning among Eighth to Eleventh Graders in the Domains of Computer Literacy and Newtonian Physics. Instructional Science 37, 487–493 (2009)

    Article  Google Scholar 

  12. Craig, S.D., Sullins, J., Witherspoon, A., Gholson, B.: The Deep-Level Reasoning Effect: the Role of Dialogue and Deep-Level-Reasoning Questions during Vicarious Learning. Cognition and Instruction 24, 565–591 (2006)

    Article  Google Scholar 

  13. Mayer, R.E.: Multimedia Learning. Cambridge University Press, New York (2001)

    Book  Google Scholar 

  14. Marsh, T.: Vicarious Experience: Staying There Connected With and Through Our Own and Other Characters. In: Williams, S.H.P.J. (ed.) Gaming as Culture: Social Reality, Identity and Experience in Role-Playing, Collectible, and Computer Games, Jefferson, NC, McFarland, pp. 196–213 (2005)

    Google Scholar 

  15. Wright, P., McCarthy, J.: Empathy and Experience in HCI. In: Proceedings of CHI 2008, pp. 637–646 (2008)

    Google Scholar 

  16. El-Nasr, M.S., Yan, S.: Visual Attention in 3D Video Games. In: Proceedings of ACE 2006, Hollywood, California, USA (2006)

    Google Scholar 

  17. Land, M.F.: Eye Movements and the Control of Actions in Everyday Life. Progress in Retinal and Eye Research 25, 296–324 (2006)

    Article  Google Scholar 

  18. Rayner, K.: Eye Movements and Information Processing: 20 Years of Research. Psychological Bulletin 124(3), 343–372 (1998)

    Article  Google Scholar 

  19. Nakayama, M., Takahashi, K., Shimizu, Y.: The Act of Task Difficulty and Eye-Movement Frequency for the Oculo-Motor Indices. In: Eye Tracking Research & Applications (ETRA) Symposium, pp. 43–51. ACM, New York (2002)

    Google Scholar 

  20. Pan, B., Hembrooke, H.A., Gay, G.K., Granka, L.A., Fuesner, M.K., Newman, J.K.: The Determinants of Web Page Viewing Behavior: an Eye-Tracking Study. In: Proceedings of 2004 Symposium on Eye Tracking Research & Applications, pp. 147–154 (2004)

    Google Scholar 

  21. Peters, R.J., Itti, L.: Beyond Bottom-up: Incorporating Task-Dependent Influences into a Computational Model of Spatial Attention. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)

    Google Scholar 

  22. Hotchkiss, G., Alston, S., Edwards, G.: Eye Tracking Study (2006), http://www.enquiro.com/eyetrackingreport.asp (retrieved March 15, 2010)

  23. Nielsen, J.: F-Shaped Pattern for Reading Web Content (2006), http://www.useit.com/alertbox/reading_pattern.html (retrieved March 15, 2010)

  24. Gholson, B., Craig, S.D.: Promoting Constructive Activities that Support Vicarious Learning during Computer-Based Instruction. Educational Psychology Review 18, 119–138 (2006)

    Article  Google Scholar 

  25. Bandura, A.: Social Learning through Imitation. In: Jones, M.R. (ed.) Nebraska Symposium of Motivation, pp. 211–269. University of Nebraska Press, Lincoln (1962)

    Google Scholar 

  26. Bandura, A.: Social Foundations of Thought and Action: A Social Cognitive theory. Prentice Hall, Englewood Cliffs (1986)

    Google Scholar 

  27. Rosenthal, R.L., Zimmerman, B.J.: Social Learning and Cognition. Academic Press, New York (1978)

    Google Scholar 

  28. McNamara, D.S., McDaniel, M.: Suppressing Irrelevant Information: Knowledge Activation or Inhibition? Journal of Experimental Psychology: Learning, Memory, & Cognition 30, 465–482 (2004)

    Google Scholar 

  29. Craig, S.D., Driscoll, D., Gholson, B.: Constructing Knowledge from Dialog in an Intelligent Tutoring System: Interactive Learning, Vicarious Learning, and Pedagogical Agents. Journal of Educational Multimedia and Hypermedia 13, 163–183 (2004)

    Google Scholar 

  30. Melanson, B., Kelso, J., Bowman, D.: Effects of Active Exploration and Passive Observation on Spatial Learning in a CAVE, Department of Computer Science, Virginia Tech., pp. 1–11 (2001), http://eprints.cs.vt.edu:8000/archive/00000602/ (retrieved March 15, 2010)

  31. Keehner, M., Hegarty, M., Cohen, C., Khooshabeh, P., Montello, D.R.: Spatial Reasoning with External Visualizations: What Matters is What You See, not Whether You Interact. Cognitive Science 32(7), 1032–1099 (2009)

    Google Scholar 

  32. Hart, S.G., Staveland, L.E.: Development of a Multi-Dimensional Workload Rating Scale: Results of Empirical and Theoretical Research. In: Hancock, P.A., Meshkati, N. (eds.) Human Mental Workload, pp. 139–183. Elsevier, Amsterdam (1988)

    Chapter  Google Scholar 

  33. Hassenzahl, M.: The interplay between beauty, goodness, and usability in interactive products. Human Computer Interaction 19, 319–349 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Law, E.LC., Mattheiss, E.E., Kickmeier-Rust, M.D., Albert, D. (2010). Vicarious Learning with a Digital Educational Game: Eye-Tracking and Survey-Based Evaluation Approaches. In: Leitner, G., Hitz, M., Holzinger, A. (eds) HCI in Work and Learning, Life and Leisure. USAB 2010. Lecture Notes in Computer Science, vol 6389. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16607-5_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-16607-5_33

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-16606-8

  • Online ISBN: 978-3-642-16607-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics