Abstract
User interaction is a central component of Interactive Storytelling, yet it has often been neglected, as precedence is often granted to the pursuit of narrative generation techniques. This chapter presents several paradigms of interaction using examples drawn from fully implemented Interactive Storytelling systems and proposes an empirical classification of modes of interaction based on the nature of user involvement. First is provided a context for the need for multimodal interaction with the story world and the influence of the user’s intervention onto the dynamics of story generation. Then, the requirements of affective interaction within the context of Interactive Storytelling are covered and illustrated through traditional multimodal interaction, as well as physiological interfaces. Finally, the potential of Brain-Computer Interfaces (BCI) to support Interactive Storytelling is discussed, in particular through the unification of user experience, user input, and affective filmic theories.
Keywords
Recommended Reading
G. Aranyi, F. Charles, M. Cavazza. Anger-based BCI using fNIRS neurofeedback. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST ’15). ACM, New York, NY, USA, pp. 511–521 (2015). http://dx.doi.org/10.1145/2807442.2807447
B.-C. Bae, R.M. Young, A use of flashback and foreshadowing for surprise arousal in narrative using a plan-based approach, in Proceedings 1st Joint International Conference on Interactive Digital Storytelling (ICIDS), Springer-Verlag, Berlin, Heidelberg, pp. 156–167 (2008)
R. Barthes. Introduction Á L’analyse Structurale Des Récits. In: L’analyse structurale du récit, Communications, Paris, Seuil, 8, 7–33 (1966) (in French)
M. Cavazza, F. Charles, S.J. Mead, Characters in search of an author: AI-based virtual storytelling, in Proceedings 1st International Conference on Virtual Storytelling (ICVS), Springer-Verlag, Berlin, Heidelberg, pp. 145–154 (2001)
M. Cavazza, F. Charles, S. Mead. Interacting with virtual characters in interactive storytelling, in Proceedings 1st International Joint Conference on Autonomous Agents and MultiAgent Systems (AAMAS), IFAAMAS, Bologna, Italy, pp. 318–325 (2002)
M. Cavazza, O. Martin, F. Charles, S.J. Mead, X. Marichal, Interacting with virtual agents in mixed reality interactive storytelling, in Proceedings of the 4th International Workshop, IVA 2003, Kloster Irsee, Germany, 15–17 Sept, pp. 231–235 (2003)
M. Cavazza, F. Charles, S. Mead, Multi-modal acting in mixed reality interactive storytelling. IEEE Multimedia 11(3), 30–39 (2004)
M. Cavazza, G. Aranyi, F. Charles, J. Porteous, S. Gilroy, I. Klovatch, G. Jackont, E. Soreq, N.J. Keynan, A. Cohen, G. Raz, T. Hendler, Towards empathic neurofeedback for interactive storytelling, in Proceedings of 2014 Workshop on Computational Models of Narrative (CMN 2014), 31 July –2 Aug, Quebec City (2014)
Y.G. Cheong, R.M. Young, Narrative generation for suspense: modeling and evaluation, in Interactive storytelling (Springer, Berlin/Heidelberg, 2008), pp. 144–155
R. Damiano, V. Lombardo, A unified approach for reconciling characters and story in the realm of agency, in Proceedings 1st International Conference on Agents and Artificial Intelligence (ICAART), Porto, Portugal, pp. 430–437 (2009)
R.J. Davidson, Anterior cerebral asymmetry and the nature of emotion. Brain Cogn. 20(1), 125–151 (1992)
S.H. Fairclough, Fundamentals of physiological computing. Interact. Comput. 21(1), 133–145 (2009)
S.W. Gilroy, J. Porteous, F. Charles, M. Cavazza, Exploring passive user interaction for adaptive narratives, in Proceedings of the 2012 ACM International Conference on Intelligent User Interfaces (IUI 2012) (ACM, New York, 2012), pp. 119–128
S.W. Gilroy, J. Porteous, F. Charles, M. Cavazza, E. Soreq, G. Raz, L. Ikar, A. Or-Borichov, U. Ben-Arie, I. Klovatch, T. Hendler, A brain-computer interface to a plan-based narrative, in Proceedings of the Twenty-Third international joint conference on Artificial Intelligence (IJCAI ‘13), ed. by F. Rossi. (AAAI Press, Palo Alto, 1997–2005, 2013)
J. Gratch, Why you should buy an emotional planner, in Proceedings 3rd International Conference on Autonomous Agents. Workshop on Emotion-Based Agent Architectures (EBAA), ACM, New York (1999)
S.N. Light, J.A. Coan, C. Zahn-Waxler, C. Frye, H.H. Goldsmith, R.J. Davidson, Empathy is associated with dynamic change in prefrontal brain electrical activity during positive emotion in children. Child Dev. 80(4), 1210–1231 (2009)
J.-L. Lugrin, M. Cavazza, D. Pizzi, T. Vogt, E. André, Exploring the usability of immersive interactive storytelling, in Proceedings 7th ACM Symposium on Virtual Reality Software and Technology (VRST), ACM, New York, pp. 103–110 (2010)
M. Mateas, A. Stern, A behavior language for story-based believable agents. IEEE Intell. Syst. 17(4), 39–47 (2002)
A. Mettinger, Aspects of Semantic Opposition in English (Oxford University Press, Oxford, 1994)
D. Pizzi, M. Cavazza, Affective storytelling based on characters’ feelings, in Proceedings Intelligent Narrative Technologies: Papers from the AAAI Fall Symposium, AAAI Press, Palo Alto (2007)
D. Pizzi, F. Charles, J.-L. Lugrin, M. Cavazza, Interactive storytelling with literary feelings, in Proceedings 2nd International Conference on Affective Computing and Intelligent Interaction (ACII), Springer-Verlag, Berlin, Heidelberg, pp. 630–641 (2007)
G. Raz, Y. Winetraub, Y. Jacob, S. Kinreich, A. Maron-Katz, G. Shaham, I. Podlipsky, G. Gilam, E. Soreq, T. Hendler, Portraying emotions at their unfolding: a multilayered approach for probing dynamics of neural networks. Neuroimage 60(2), 1448–1461 (2012)
J. Rickel, S. Marsella, J. Gratch, R. Hill, D.R. Traum, W.R. Swartout, Toward a new generation of virtual humans for interactive experiences. IEEE Intell. Syst. 17(4), 32–38 (2002)
G.M. Smith, Film Structure and the Emotion System (Cambridge University Press, Cambridge, 2003)
T.J. Smith, D.T. Levin, J. Cutting, A window on reality: perceiving edited moving images. Curr. Dir. Psychol. Sci. 21, 107–113 (2012)
S.K. Sutton, R.J. Davidson, Prefrontal brain asymmetry: a biological substrate of the behavioral approach and inhibition systems. Psychol. Sci. 8(3), 204–210 (1997)
W. Swartout, J. Gratch, J.R. Hill, E. Hovy, S. Marsella, J. Rickel et al., Toward virtual humans. AI Magazine 27(2), 96 (2006)
E.S. Tan, Emotion and the structure of narrative film: Film as an emotion machine (L. Erlbaum Associates, Mahwah, 1996)
T. Vogt, E. André, N. Bee. EmoVoice – a framework for online recognition of emotions from voice, in Proceedings 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems, Springer-Verlag, Berlin, Heidelberg, pp. 188–199 (2008)
N. Zagalo, A. Torres, V. Branco. Passive interactivity, an answer to interactive emotion, in Entertainment Computing (ICEC), Springer-Verlag, Berlin, Heidelberg, pp. 43–52 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer Science+Business Media Singapore
About this entry
Cite this entry
Cavazza, M., Charles, F. (2016). User Interaction for Interactive Storytelling. In: Nakatsu, R., Rauterberg, M., Ciancarini, P. (eds) Handbook of Digital Games and Entertainment Technologies. Springer, Singapore. https://doi.org/10.1007/978-981-4560-52-8_57-1
Download citation
DOI: https://doi.org/10.1007/978-981-4560-52-8_57-1
Received:
Accepted:
Published:
Publisher Name: Springer, Singapore
Online ISBN: 978-981-4560-52-8
eBook Packages: Springer Reference EngineeringReference Module Computer Science and Engineering