Comparative Visualization of Player Behavior for Serious Game Analytics
Telemetry opens new possibilities for the assessment of serious games through the continuous, unobtrusive, monitoring of in-game behavior. Data obtained through telemetry thus not only contains information about the outcomes but also about the intermediate processes. In this sense, telemetry data can be of value for various stakeholders of serious games, including developers, educators, and learners themselves to increase the effectiveness of the intervention. In doing so, particular significance should be attached to differences among individuals and demographic groups in order to understand and better accommodate for these variations. However, the large amounts of data gathered via telemetry can make it challenging to derive meaningful information from it. Visualizations can support this process by providing a means to explore, to compare, and to draw insights from the data sets. In this chapter, we discuss three common visual design strategies that facilitate comparative data analysis. Several examples, drawn from the game-based learning literature and related areas as well as two detailed case studies are used to illustrate how these strategies can be leveraged in the context of serious game analytics.
KeywordsGame telemetry Player behavior Visualization Visual comparison
We would like to thank Helmut Hlavacs from the Entertainment Computing group of the University of Vienna for his permission to use the telemetry data from Internet Hero for examples in this chapter. Internet Hero was funded by netidee (www.netidee.at, project number 326).
- Andersen, E., Liu, Y.-E., Apter, E., Boucher-Genesse, F., & Popović, Z. (2010). Gameplay analysis through state projection. In Proceedings of the 5th International Conference on the Foundations of Digital Games (pp. 1–8). doi: 10.1145/1822348.1822349.
- Andrews, K., Wohlfahrt, M., & Wurzinger, G. (2009). Visual graph comparison. In Proceedings of the 13th International Conference Information Visualisation (pp. 62–67). doi: 10.1109/IV.2009.108.
- Anolli, L., & Confalonieri, L. (2011). Learning, dynamic assessment and serious games. In A. Méndez-Vilas (Ed.), Education in a technological world: Communicating current and emerging research and technological efforts (pp. 279–287). Badajoz, Spain: Formatex.Google Scholar
- Beck, F., Burch, M., Diehl, S., & Weiskopf, D. (2014). The state of the art in visualizing dynamic graphs. In EuroVis—STARs (pp. 83–103). doi: 10.2312/eurovisstar.20141174.
- Beck, F., Burch, M., & Weiskopf, D. (2013). Visual comparison of time-varying athletes’ performance. In Proceedings of the 1st Workshop on Sports Data Visualization.Google Scholar
- Becker, K., & Parker, J. R. (2011). The guide to computer simulations and games. Indianapolis, IN: Wiley.Google Scholar
- Bellotti, F., Kapralos, B., Lee, K., Moreno-Ger, P., & Berta, R. (2013). Assessment in and of serious games: An overview. Advances in Human-Computer Interaction, 2013. doi:10.1155/2013/136864.Google Scholar
- Buendía-García, F., García-Martínez, S., Navarrete-Ibañez, E. M., & Jesús, M. (2013). Designing serious games for getting transferable skills in training settings. Interaction Design and Architecture(s), 19, 47–62.Google Scholar
- Butler, E., & Banerjee, R. (2014). Visualizing progressions for education and game design. Retrieved from http://cse512-14w.github.io/fp-edbutler-piscean/final/paper-edbutler-piscean.pdf
- de Freitas, S., & Jarvis, S. (2006). A framework for developing serious games to meet learner needs. In Proceedings of the Interservice/Industry Training, Simulation & Education Conference.Google Scholar
- Desmarais, M. C., & Lemieux, F. (2013). Clustering and visualizing study state sequences. In Proceedings of 6th International Conference on Educational Data Mining (pp. 224–227).Google Scholar
- Duval, E. (2011). Attention please!: Learning analytics for visualization and recommendation. In Proceedings of the 1st International Conference on Learning Analytics and Knowledge (pp. 9–17). doi: 10.1145/2090116.2090118.
- Dwyer, T., Hong, S.-H., Koschützki, D., Schreiber, F., & Xu, K. (2006). Visual analysis of network centralities. In Proceedings of the Asia-Pacific Symposium on Information Visualisation (pp. 189–197).Google Scholar
- Erten, C., Kobourov, S. G., Le, V., & Navabi, A. (2003). Simultaneous graph drawing: Layout algorithms and visualization schemes. In Proceedings of the 11th Symposium on Graph Drawing (pp. 437–449).Google Scholar
- Fardinpour, A., Reiners, T., & Dreher, H. (2013). Action-based learning assessment method (ALAM) in virtual training environments. In Proceedings of the 30th Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education (pp. 267–277).Google Scholar
- Federico, P., Aigner, W., Miksch, S., Windhager, F., & Zenk, L. (2011). A visual analytics approach to dynamic social networks. In Proceedings of the 11th International Conference on Knowledge Management and Knowledge Technologies (pp. 47:1–47:8). doi: 10.1145/2024288.2024344.
- Ferster, B., & Shneiderman, B. (2012). Interactive visualization: Insight through inquiry. Cambridge, MA: MIT Press.Google Scholar
- Gelderblom, H., & Kotzé, P. (2009). Ten design lessons from the literature on child development and children’s use of technology. In Proceedings of the 8th International Conference on Interaction Design and Children (pp. 52–60). doi: 10.1145/1551788.1551798.
- Govaerts, S., Verbert, K., Duval, E., & Pardo, A. (2012). The student activity meter for awareness and self-reflection. In CHI’12 Extended Abstracts on Human Factors in Computing Systems (pp. 869–884). doi: 10.1145/2212776.2212860.
- Griffin, A. L., MacEachren, A. M., Hardisty, F., Steiner, E., & Li, B. (2006). A comparison of animated maps with static small-multiple maps for visually identifying space-time clusters. Annals of the Association of American Geographers, 96(4), 740–753. doi: 10.1111/j.1467-8306.2006.00514.x.CrossRefGoogle Scholar
- Guerra-Gómez, J. A., Buck-Coleman, A., Pack, M. L., Plaisant, C., & Shneiderman, B. (2013). TreeVersity: Interactive visualizations for comparing hierarchical data sets. Transportation Research Record: Journal of the Transportation Research Board, 2392, 48–58. doi: 10.3141/2392-06.CrossRefGoogle Scholar
- Holten, D., & van Wijk, J. J. (2008). Visual comparison of hierarchically organized data. In Proceedings of the 10th Joint Eurographics/IEEE—VGTC Conference on Visualization (pp. 759–766). doi: 10.1111/j.1467-8659.2008.01205.x.
- Houghton, S. (2011). Balance and flow maps. Retrieved April, 2015, from http://www.gamasutra.com/view/news/125213/Opinion_Balance_and_Flow_Maps.php.
- Javed, W., & Elmqvist, N. (2012). Exploring the design space of composite visualization. In Proceedings of the IEEE Pacific Visualization Symposium (pp. 1–8). doi: 10.1109/PacificVis.2012.6183556.
- Kirk, A. (2012). Data visualization: A successful design process. Birmingham, England: Packt Publishing.Google Scholar
- Kriglstein, S., Wallner, G., & Rinderle-Ma, S. (2013). A visualization approach for difference analysis of process models and instance traffic. In Proceedings of the 11th International Conference on Business Process Management (pp. 219–226). doi: 10.1007/978-3-642-40176-3_18.
- Kruskal, J. B., & Wish, M. (1978). Multidimensional scaling. Beverly Hills, CA: Sage.Google Scholar
- Linek, S. B., Öttl, G., & Albert, D. (2010). Non-invasive data tracking in educational games: Combination of logfiles and natural language processing. In Proceeding of the International Technology, Education and Development Conference (pp. 2977–2988).Google Scholar
- Liu, Y.-E., Andersen, E., Snider, R., Cooper, S., & Popović, Z. (2011). Feature-based projections for effective playtrace analysis. In Proceedings of the 6th International Conference on Foundations of Digital Games (pp. 69–76). doi: 10.1145/2159365.2159375.
- Mehigan, T. J., Barry, M., Kehoe, A., & Pitt, I. (2011). Using eye tracking technology to identify visual and verbal learners. In Proceedings of the IEEE International Conference on Multimedia and Expo (pp. 1–6). doi: 10.1109/ICME.2011.6012036.
- Minović, M., & Milovanović, M. (2013). Real-time learning analytics in educational games. In Proceedings of the 1st International Conference on Technological Ecosystem for Enhancing Multiculturality (pp. 245–251). doi: 10.1145/2536536.2536574.
- Mislevy, R. J., & Riconscente, M. (2005). Evidence-centered assessment design: Layers, structures, and terminology (PADI Technical Report No. 9). Menlo Park, CA: SRI International.Google Scholar
- Moreno-Ger, P., Torrente, J., Hsieh, Y. G., & Lester, W. T. (2012). Usability testing for serious games: Making informed design decisions with user data. Advances in Human-Computer Interaction, 2012. doi:10.1155/2012/369637.Google Scholar
- O’Rourke, E., Butler, E., Liu, Y.-E., Ballweber, C., & Popović, Z. (2013). The effects of age on player behavior in educational games. In Proceedings of the 8th International Conference on the Foundations of Digital Games (pp. 158–165).Google Scholar
- Ritsos, P. D., & Roberts, J. C. (2014). Towards more visual analytics in learning analytics. In Proceedings of the 5th EuroVis Workshop on Visual Analytics (pp. 61–65). doi: 10.2312/eurova.20141147.
- Rowe, J. P., Shores, L. R., Mott, B. W., & Lester, J. C. (2010). Individual differences in gameplay and learning: A narrative-centered learning perspective. In Proceedings of the 5th International Conference on the Foundations of Digital Games (pp. 171–178). doi: 10.1145/1822348.1822371.
- Scarlatos, L. L., & Scarlatos, T. (2010). Visualizations for the assessment of learning in computer games. In Proceedings of the 7th International Conference & Expo on Emerging Technologies for a Smarter World.Google Scholar
- Shute, V., Ventura, M., Bauer, M., & Zapata-Rivera, D. (2009). Melding the power of serious games and embedded assessment to monitor and foster learning: Flow and grow. In U. Ritterfield, M. J. Cody, & P. Vorderer (Eds.), The social science of serious games: Theories and applications (pp. 295–321). New York: Routledge.Google Scholar
- Steiner, C. M., Kickmeier-Rust, M. D., & Albert, D. (2009). Little big difference: Gender aspects and gender-based adaptation in educational games. In M. Chang, R. Kuo, K. Kinshuk, G.-D. Chen, & M. Hirose (Eds.), Learning by playing. Game-based education system design and development (pp. 150–161). Berlin: Springer.CrossRefGoogle Scholar
- Stewart, C. A., Hart, D., Berry, D. K., Olsen, G. J., Wernert, E. A., & Fischer, W. (2001). Parallel implementation and performance of fastDNAml: A program for maximum likelihood phylogenetic inference. In Proceedings of the ACM/IEEE Conference on Supercomputing. doi: 10.1145/582034.582054.
- Tominski, C., Schulze-Wollgast, P., & Schumann, H. (2005). 3D information visualization for time dependent data on maps. In Proceedings of the nineth International Conference on Information Visualisation (pp. 175–181). doi: 10.1109/IV.2005.3.
- Tufte, E. R. (1990). Envisioning information. Cheshire, UK: Graphics Press.Google Scholar
- Urness, T., Interrante, V., Marusic, I., Longmire, E., & Ganapathisubramani, B. (2003). Effectively visualizing multi-valued flow data using color and texture. In Proceedings of the IEEE Visualization (pp. 115–121). doi: 10.1109/VISUAL.2003.1250362.
- van Wijk, J. J. (2005). The value of visualization. In Proceedings of the IEEE Visualization (pp. 79–86). doi: 10.1109/VISUAL.2005.1532781.
- Wallner, G. (2013). Play-Graph: A methodology and visualization approach for the analysis of gameplay data. In Proceedings of the 8th International Conference on the Foundations of Digital Games (pp. 253–260).Google Scholar
- Wallner, G., & Kriglstein, S. (2012a). DOGeometry: Teaching geometry through play. In Proceedings of the 4th International Conference on Fun and Games (pp. 11–18). doi: 10.1145/2367616.2367618.
- Wallner, G., & Kriglstein, S. (2012b). A spatiotemporal visualization approach for the analysis of gameplay data. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1115–1124). doi: 10.1145/2207676.2208558.
- Westera, W., Nadolski, R., Hummel, H. (2014). Serious gaming analytics: What students’ log files tell us about gaming and learning. International Journal of Serious Games, 1(2). doi:10.17083/ijsg.v1i2.9.Google Scholar
- Wouters, P., van der Spek, E. D., & Van Oostendorp, H. (2009). Current practices in serious game research: A review from a learning outcomes perspective. In T. M. Connolly, M. Stansfield, & L. Boyle (Eds.), Games-based learning advancements for multisensory human computer interfaces: Techniques and effective practices. Hershey, PA: IGI Global.Google Scholar
- Yau, N. (2011). Visualize this: The FlowingData guide to design, visualization, and statistics. Indianapolis, IN: Wiley.Google Scholar