User Interaction for Interactive Storytelling

Living reference work entry


User interaction is a central component of Interactive Storytelling, yet it has often been neglected, as precedence is often granted to the pursuit of narrative generation techniques. This chapter presents several paradigms of interaction using examples drawn from fully implemented Interactive Storytelling systems and proposes an empirical classification of modes of interaction based on the nature of user involvement. First is provided a context for the need for multimodal interaction with the story world and the influence of the user’s intervention onto the dynamics of story generation. Then, the requirements of affective interaction within the context of Interactive Storytelling are covered and illustrated through traditional multimodal interaction, as well as physiological interfaces. Finally, the potential of Brain-Computer Interfaces (BCI) to support Interactive Storytelling is discussed, in particular through the unification of user experience, user input, and affective filmic theories.


Multimodal interfaces Affective interfaces Physiological computing Brain-Computer Interfaces 

Recommended Reading

  1. G. Aranyi, F. Charles, M. Cavazza. Anger-based BCI using fNIRS neurofeedback. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST ’15). ACM, New York, NY, USA, pp. 511–521 (2015).
  2. B.-C. Bae, R.M. Young, A use of flashback and foreshadowing for surprise arousal in narrative using a plan-based approach, in Proceedings 1st Joint International Conference on Interactive Digital Storytelling (ICIDS), Springer-Verlag, Berlin, Heidelberg, pp. 156–167 (2008)Google Scholar
  3. R. Barthes. Introduction Á L’analyse Structurale Des Récits. In: L’analyse structurale du récit, Communications, Paris, Seuil, 8, 7–33 (1966) (in French)Google Scholar
  4. M. Cavazza, F. Charles, S.J. Mead, Characters in search of an author: AI-based virtual storytelling, in Proceedings 1st International Conference on Virtual Storytelling (ICVS), Springer-Verlag, Berlin, Heidelberg, pp. 145–154 (2001)Google Scholar
  5. M. Cavazza, F. Charles, S. Mead. Interacting with virtual characters in interactive storytelling, in Proceedings 1st International Joint Conference on Autonomous Agents and MultiAgent Systems (AAMAS), IFAAMAS, Bologna, Italy, pp. 318–325 (2002)Google Scholar
  6. M. Cavazza, O. Martin, F. Charles, S.J. Mead, X. Marichal, Interacting with virtual agents in mixed reality interactive storytelling, in Proceedings of the 4th International Workshop, IVA 2003, Kloster Irsee, Germany, 15–17 Sept, pp. 231–235 (2003)Google Scholar
  7. M. Cavazza, F. Charles, S. Mead, Multi-modal acting in mixed reality interactive storytelling. IEEE Multimedia 11(3), 30–39 (2004)CrossRefGoogle Scholar
  8. M. Cavazza, G. Aranyi, F. Charles, J. Porteous, S. Gilroy, I. Klovatch, G. Jackont, E. Soreq, N.J. Keynan, A. Cohen, G. Raz, T. Hendler, Towards empathic neurofeedback for interactive storytelling, in Proceedings of 2014 Workshop on Computational Models of Narrative (CMN 2014), 31 July –2 Aug, Quebec City (2014)Google Scholar
  9. Y.G. Cheong, R.M. Young, Narrative generation for suspense: modeling and evaluation, in Interactive storytelling (Springer, Berlin/Heidelberg, 2008), pp. 144–155CrossRefGoogle Scholar
  10. R. Damiano, V. Lombardo, A unified approach for reconciling characters and story in the realm of agency, in Proceedings 1st International Conference on Agents and Artificial Intelligence (ICAART), Porto, Portugal, pp. 430–437 (2009)Google Scholar
  11. R.J. Davidson, Anterior cerebral asymmetry and the nature of emotion. Brain Cogn. 20(1), 125–151 (1992)CrossRefGoogle Scholar
  12. S.H. Fairclough, Fundamentals of physiological computing. Interact. Comput. 21(1), 133–145 (2009)CrossRefGoogle Scholar
  13. S.W. Gilroy, J. Porteous, F. Charles, M. Cavazza, Exploring passive user interaction for adaptive narratives, in Proceedings of the 2012 ACM International Conference on Intelligent User Interfaces (IUI 2012) (ACM, New York, 2012), pp. 119–128Google Scholar
  14. S.W. Gilroy, J. Porteous, F. Charles, M. Cavazza, E. Soreq, G. Raz, L. Ikar, A. Or-Borichov, U. Ben-Arie, I. Klovatch, T. Hendler, A brain-computer interface to a plan-based narrative, in Proceedings of the Twenty-Third international joint conference on Artificial Intelligence (IJCAI ‘13), ed. by F. Rossi. (AAAI Press, Palo Alto, 1997–2005, 2013)Google Scholar
  15. J. Gratch, Why you should buy an emotional planner, in Proceedings 3rd International Conference on Autonomous Agents. Workshop on Emotion-Based Agent Architectures (EBAA), ACM, New York (1999)Google Scholar
  16. S.N. Light, J.A. Coan, C. Zahn-Waxler, C. Frye, H.H. Goldsmith, R.J. Davidson, Empathy is associated with dynamic change in prefrontal brain electrical activity during positive emotion in children. Child Dev. 80(4), 1210–1231 (2009)CrossRefGoogle Scholar
  17. J.-L. Lugrin, M. Cavazza, D. Pizzi, T. Vogt, E. André, Exploring the usability of immersive interactive storytelling, in Proceedings 7th ACM Symposium on Virtual Reality Software and Technology (VRST), ACM, New York, pp. 103–110 (2010)Google Scholar
  18. M. Mateas, A. Stern, A behavior language for story-based believable agents. IEEE Intell. Syst. 17(4), 39–47 (2002)CrossRefGoogle Scholar
  19. A. Mettinger, Aspects of Semantic Opposition in English (Oxford University Press, Oxford, 1994)Google Scholar
  20. D. Pizzi, M. Cavazza, Affective storytelling based on characters’ feelings, in Proceedings Intelligent Narrative Technologies: Papers from the AAAI Fall Symposium, AAAI Press, Palo Alto (2007)Google Scholar
  21. D. Pizzi, F. Charles, J.-L. Lugrin, M. Cavazza, Interactive storytelling with literary feelings, in Proceedings 2nd International Conference on Affective Computing and Intelligent Interaction (ACII), Springer-Verlag, Berlin, Heidelberg, pp. 630–641 (2007)Google Scholar
  22. G. Raz, Y. Winetraub, Y. Jacob, S. Kinreich, A. Maron-Katz, G. Shaham, I. Podlipsky, G. Gilam, E. Soreq, T. Hendler, Portraying emotions at their unfolding: a multilayered approach for probing dynamics of neural networks. Neuroimage 60(2), 1448–1461 (2012)CrossRefGoogle Scholar
  23. J. Rickel, S. Marsella, J. Gratch, R. Hill, D.R. Traum, W.R. Swartout, Toward a new generation of virtual humans for interactive experiences. IEEE Intell. Syst. 17(4), 32–38 (2002)CrossRefGoogle Scholar
  24. G.M. Smith, Film Structure and the Emotion System (Cambridge University Press, Cambridge, 2003)CrossRefGoogle Scholar
  25. T.J. Smith, D.T. Levin, J. Cutting, A window on reality: perceiving edited moving images. Curr. Dir. Psychol. Sci. 21, 107–113 (2012)CrossRefGoogle Scholar
  26. S.K. Sutton, R.J. Davidson, Prefrontal brain asymmetry: a biological substrate of the behavioral approach and inhibition systems. Psychol. Sci. 8(3), 204–210 (1997)CrossRefGoogle Scholar
  27. W. Swartout, J. Gratch, J.R. Hill, E. Hovy, S. Marsella, J. Rickel et al., Toward virtual humans. AI Magazine 27(2), 96 (2006)Google Scholar
  28. E.S. Tan, Emotion and the structure of narrative film: Film as an emotion machine (L. Erlbaum Associates, Mahwah, 1996)Google Scholar
  29. T. Vogt, E. André, N. Bee. EmoVoice – a framework for online recognition of emotions from voice, in Proceedings 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems, Springer-Verlag, Berlin, Heidelberg, pp. 188–199 (2008)Google Scholar
  30. N. Zagalo, A. Torres, V. Branco. Passive interactivity, an answer to interactive emotion, in Entertainment Computing (ICEC), Springer-Verlag, Berlin, Heidelberg, pp. 43–52 (2006)Google Scholar

Authors and Affiliations

  1. 1.School of Electronics and Digital ArtsUniversity of KentKentUK
  2. 2.School of ComputingTeesside UniversityMiddlesbroughUK

Personalised recommendations