Abstract
Capturing the player’s emotions in an interactive story can serve many purposes, such as to understand player response to a story or to alter the story’s path. The concept of diegesis defines the boundary between the story world and the real world, and has been used to explore different ways of conceptualizing user interface (UI) elements in interactive media. This paper explores methods of capturing players’ emotions during an interactive story and the concept of diegesis. Specifically, we posit that whether emotion capture exists in a diegetic versus a non-diegetic space can affect its accuracy when capturing player emotion. We developed two interactive stories with two emotion capture methods, one using a diegetic approach, and the other using a non-diegetic approach. We conducted a study with 64 participants to compare the two emotion capture approaches. Our results show that a diegetic approach leads to a better story experience, but that a non-diegetic approach leads to the player’s emotion being captured more accurately. We discuss the implications of the study results for integrating emotion capture in the design of interactive stories.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Amresh, A., Sinha, M., Birr, R., Salla, R.: Interactive cause and effect comic-book storytelling for improving nutrition outcomes in children. In: Proceedings of the 5th International Conference on Digital Health 2015, pp. 9–14 (2015)
Bateman, C., Nacke, L.E.: The neurobiology of play. In: Proceedings of the International Academic Conference on the Future of Game Design and Technology, pp. 1–8 (2010)
Bratitsis, T.: A digital storytelling approach for fostering empathy towards autistic children: lessons learned. In: Proceedings of the 7th International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-exclusion, pp. 301–308 (2016)
Bunia, R.: Diegesis and representation: beyond the fictional world, on the margins of story and narrative. Poetics Today 31(4), 679–720 (2010)
Callejas-Cuervo, M., Martínez-Tejada, L.A., Alarcón-Aldana, A.C.: Emotion recognition techniques using physiological signals and video games-systematic review. Rev. Fac. de Ingeniería 26(46), 19–28 (2017)
Carter, M., Gibbs, M., Arnold, M.: Avatars, characters, players and users: multiple identities at/in play. In: Proceedings of the 24th Australian Computer-Human Interaction Conference, pp. 68–71 (2012)
Chauveau, L.A., Szilas, N., Luiu, A.L., Ehrler, F.: Dimensions of personalization in a narrative pedagogical simulation for alzheimer’s caregivers. In: 2018 IEEE 6th International Conference on Serious Games and Applications for Health (SeGAH), pp. 1–8. IEEE (2018)
Gilroy, S., Porteous, J., Charles, F., Cavazza, M.: Exploring passive user interaction for adaptive narratives. In: Proceedings of the 2012 ACM International Conference on Intelligent User Interfaces, pp. 119–128 (2012)
Granato, M., Gadia, D., Maggiorini, D., Ripamonti, L.A.: Feature extraction and selection for real-time emotion recognition in video games players. In: 2018 14th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS), pp. 717–724. IEEE (2018)
Hernandez, S.P., Bulitko, V., Hilaire, E.S.: Emotion-based interactive storytelling with artificial intelligence. In: Tenth Artificial Intelligence and Interactive Digital Entertainment Conference (2014)
Iacovides, I., Cox, A., Kennedy, R., Cairns, P., Jennett, C.: Removing the HUD: the impact of non-diegetic game elements and expertise on player involvement. In: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play, pp. 13–22 (2015)
IJsselsteijn, W.A., de Kort, Y.A., Poels, K.: The game experience questionnaire. Eindhoven: Technische Universiteit Eindhoven, pp. 3–9 (2013)
Jørgensen, K.: Between the game system and the fictional world: a study of computer game interfaces. Games Cult. 7(2), 142–163 (2012)
Kleinman, E., Carstensdottir, E., Seif El-Nasr, M.: A model for analyzing diegesis in digital narrative games. In: Cardona-Rivera, R.E., Sullivan, A., Young, R.M. (eds.) ICIDS 2019. LNCS, vol. 11869, pp. 8–21. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-33894-7_2
Melcer, E.F., et al.: Teaching responsible conduct of research through an interactive storytelling game. In: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–10 (2020)
Nogueira, P.A., Rodrigues, R., Oliveira, E., Nacke, L.E.: Guided emotional state regulation: understanding and shaping players’ affective experiences in digital games. In: Ninth Artificial Intelligence and Interactive Digital Entertainment Conference (2013)
Ogier, H., Buchan, J.: Exploring the feasibility of diegetic in-game store user interfaces. In: Proceedings of the Australasian Computer Science Week Multiconference, pp. 1–10 (2017)
Pedersen, C., Togelius, J., Yannakakis, G.N.: Modeling player experience for content creation. IEEE Trans. Comput. Intell. AI Games 2(1), 54–67 (2010)
Pfister, L., Ghellal, S.: Exploring the influence of non-diegetic and diegetic elements on the immersion of 2D games. In: Proceedings of the 30th Australian Conference on Computer-Human Interaction, pp. 490–494 (2018)
Prestopnik, N.R., Tang, J.: Points, stories, worlds, and diegesis: comparing player experiences in two citizen science games. Comput. Hum. Behav. 52, 492–506 (2015)
Roberts, D.L., Narayanan, H., Isbell, C.L.: Learning to influence emotional responses for interactive storytelling. In: AAAI Spring Symposium: Intelligent Narrative Technologies II, pp. 95–102 (2009)
Saldaña, J.: The Coding Manual for Qualitative Researchers. Sage, California (2015)
Schneider, E.F., Lang, A., Shin, M., Bradley, S.D.: Death with a story: how story impacts emotional, motivational, and physiological responses to first-person shooter video games. Hum. Commun. Res. 30(3), 361–375 (2004)
Shantz, C., et al.: Measuring Emotions in Infants and Children. Cambridge University Press, United Kingdom (1982)
Stapleton, C., Hughes, C.: Interactive imagination: tapping the emotions through interactive story for compelling simulations. IEEE Comput. Graph. Appl. 23(5), 11–15 (2003)
Szilas, N., Richle, U., Boggini, T., Dumas, J.: Using highly interactive drama to help young people cope with traumatic situations. In: Aylett, R., Lim, M.Y., Louchart, S., Petta, P., Riedl, M. (eds.) ICIDS 2010. LNCS, vol. 6432, pp. 279–282. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-16638-9_42
Taylor, M.: Augmenting the HUD: a mixed methods analysis on the impact of extending the game UI beyond the screen (2017)
Van Looy, J., Courtois, C., De Vocht, M., De Marez, L.: Player identification in online games: validation of a scale for measuring identification in mmogs. Media Psychol. 15(2), 197–221 (2012)
Yannakakis, G.N., Togelius, J.: Experience-driven procedural content generation. IEEE Trans. Affect. Comput. 2(3), 147–161 (2011)
Zhao, H.: Emotion in interactive storytelling. In: FDG, pp. 183–189 (2013)
Acknowledgements
This research was supported by NSF Grant #1736225, To Enact, To Tell, To Write: A Bridge to Expressive Writing through Digital Enactment.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Anne Brown, S., Resch, C., Han, V., Vaishnavi Surampudi, S., Karanam, P., Lynn Chu, S. (2020). Capturing User Emotions in Interactive Stories: Comparing a Diegetic and a Non-diegetic Approach to Self-reporting Emotion. In: Bosser, AG., Millard, D.E., Hargood, C. (eds) Interactive Storytelling. ICIDS 2020. Lecture Notes in Computer Science(), vol 12497. Springer, Cham. https://doi.org/10.1007/978-3-030-62516-0_21
Download citation
DOI: https://doi.org/10.1007/978-3-030-62516-0_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-62515-3
Online ISBN: 978-3-030-62516-0
eBook Packages: Computer ScienceComputer Science (R0)