Skip to main content

Interactive Narrative in Augmented Reality: An Extended Reality of the Holocaust

Part of the Lecture Notes in Computer Science book series (LNISA,volume 12191)


In this research, the author descripted new narrative media known as Immersive Augmented Reality Environment (IARE) with HoloLens. Aarseth’s narrative model [17] and all available input design in IARE were reviewed and summarised. Based on these findings, The AR Journey, a HoloLens app aiming at interactive narrative for moral education purpose, was developed and assessed. Qualitative methods of interview and observation were used and the results were analysed. In general, narrative in IARE were proved to be valid for moral education purpose, and findings including valid narrative structure, input model, design guidelines were revealed.


  • Interactive narrative
  • Augmented reality
  • Mixed reality
  • Holocaust
  • Moral education
  • Microsoft Hololens

This is a preview of subscription content, access via your institution.

Buying options

USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-49698-2_17
  • Chapter length: 21 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
USD   69.99
Price excludes VAT (USA)
  • ISBN: 978-3-030-49698-2
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   89.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.


  1. 1.

    Kindertransport was the title for historical events that British government made efforts to bring Jewish children out of Nazi Germany, occupied Austria and Czechoslovakia before the outbreak of World War II. During a nine-month period, 10,000 Jewish children aged between 1 and 17 were transported to the UK.

  2. 2.

    Chartman claimed a kernel is the key event that makes people recognise the story and satellites refer to the constitutive and supplementary events; take away the kernel and the story is no longer the same while satellites are what can be replaced or removed while still keeping the story recognizable.

  3. 3.

    A film terminology refers to the temporary acceptance as believable of events or characters that would ordinarily be seen as incredible. This is usually to allow an audience to appreciate works of literature or drama that are exploring unusual ideas.

  4. 4.

    The motion controllers are hardware accessories developed by Microsoft that extend the user's physical capabilities by providing precise 6DoF tracking, several buttons and tactile feedback while using one or both hands. They are compatible with all mixed reality headset with Bluetooth.

  5. 5.

    The HoloLens Clicker (clicker for short) is the peripheral device built specifically for HoloLens 1 & 2. It is a miniature controller that lets the user click on whatever he or she is looking at and there is a motion sensor inside to check the clicker’s up, down, left, and right.


  1. Ryan, M.-L.: Narrative Across Media: The Languages of Storytelling. U of Nebraska Press (2004)

    Google Scholar 

  2. Hammady, R., Ma, M., Strathern, C., Mohamad, M.: Design and development of a spatial mixed reality touring guide to the Egyptian Museum. Multimedia Tools Appl., 1–30 (2019)

    Google Scholar 

  3. Hanna, M.G., Ahmed, I., Nine, J., Prajapati, S., Pantanowitz, L.: Augmented reality technology using microsoft HoloLens in anatomic pathology. Arch. Pathol. Lab. Med. 142(5), 638–644 (2017)

    CrossRef  Google Scholar 

  4. Dow, S., Mehta, M., Macintyre, B., Mateas, M.: AR façade: an augmented reality interactive drama. In: Proceedings of the 2007 ACM Symposium on Virtual Reality Software and Technology, pp. 215–216 (2007)

    Google Scholar 

  5. Busselle, R., Bilandzic, H.: Measuring narrative engagement. Media Psychol. 12(4), 321–347 (2009)

    CrossRef  Google Scholar 

  6. Hoffman, M.L.: Interaction of affect and cognition in empathy. Emot. Cogn. Behav., 103–131 (1984)

    Google Scholar 

  7. Saarni, C., Crowley, M.: The development of emotion regulation: effects on emotional state and expression. In: Emotions and the Family: for Better or for Worse, pp. 53–73(1990)

    Google Scholar 

  8. Obama, B., Biden, J.: Remarks by the president and the vice president on gun violence. In: The White House Office of the Press Secretary, 16 January 2013

    Google Scholar 

  9. Nikonanou, N., Bounia, A.: Digital applications in museums: an analysis from a museum education perspective. In: Karagiannidis, C., Politis, P., Karasavvidis, I. (eds.) Research on e-Learning and ICT in Education, pp. 179–194. Springer, New York (2014).

    CrossRef  Google Scholar 

  10. Best, K.: Making museum tours better: understanding what a guided tour really is and what a tour guide really does. Mus. Manag. Curatorship 27(1), 35–52 (2012)

    CrossRef  Google Scholar 

  11. Hololens 1 Hardware Specification page. Accessed 31 Jan 2020

  12. Magic Leap One Homepage. Accessed 31 Jan 2020

  13. Hololens 2 Hardware Specification. Accessed 31 Jan 2020

  14. Microsoft’s Documentation of The Mixed Reality Toolkit (MRTK). Accessed 3 Jan 2020

  15. Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments: a presence questionnaire. Presence 7(3), 225–240 (1998)

    CrossRef  Google Scholar 

  16. Newton, K., Soukup, K.: The Storyteller’s Guide to the Virtual Reality Audience. The Stanford D School (2016)

    Google Scholar 

  17. Aylett, R., Louchart, S.: Towards a narrative theory of virtual reality. Virtual Reality 7(1), 2–9 (2003)

    CrossRef  Google Scholar 

  18. Aarseth, E.: A narrative theory of games. In: Proceedings of the International Conference on the Foundations of Digital Games, pp. 129–133. ACM (2012)

    Google Scholar 

  19. Austin, T.R., Chatman, S.: Story and Discourse: Narrative Structure in Fiction and Film. Cornell University Press, New York (1980)

    Google Scholar 

  20. Microsoft’s Documentation of Direct Manipulation with Hands. Accessed 31 Jan 2020

  21. Microsoft’s Documentation of Motion Controllers. Accessed 31 Jan 2020

  22. Microsoft’s Documentation of Hand Gestures. Accessed 31 Jan 2020

  23. Microsoft’s Documentation of Voice Input. Accessed 31 Jan 2020

  24. Microsoft’s Documentation of Eye-gaze-based Interaction. Accessed 31 Jan 2020

  25. Mixed Reality Interaction Models Documentation from Microsoft. Accessed 31 Jan 2020

  26. O’Brien, D., Lawless, K.A., Schrader, P.: A taxonomy of educational games. In: Gaming for Classroom-Based Learning: Digital Role Playing as a Motivator of Study, pp. 1–23 (2010)

    Google Scholar 

  27. Ferguson, C.J.: Violent video games and the Supreme Court: lessons for the scientific community in the wake of brown v. entertainment merchants association. Am. Psychol. 68(2), 57 (2013)

    Google Scholar 

  28. Lemola, S., Brand, S., Vogler, N., Perkinson-Gloor, N., Allemand, M., Grob, A.: Habitual computer game playing at night is related to depressive symptoms. Pers. Individ. Differ. 51(2), 117–122 (2011)

    CrossRef  Google Scholar 

  29. Lewis, J.R.: IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum. Comput. Interact. 7(1), 57–78 (1995)

    CrossRef  Google Scholar 

  30. McAuley, E., Duncan, T., Tammen, V.V.: Psychometric properties of the intrinsic motivation inventory in a competitive sport setting: a confirmatory factor analysis. Res. Q. Exerc. Sport 60(1), 48–58 (1989)

    CrossRef  Google Scholar 

  31. Saldaña, J.: The Coding Manual for Qualitative Researchers. Sage, Thousand Oaks (2015)

    Google Scholar 

Download references


This work was jointly funded by the National Key Research and Development Program of China (2018 YFB1004903) and Staffordshire University in the UK. We would also like to acknowledge the support from Jake Lynch for script development and the support from Elinor Rosa Williams, Zhang Nan, Zhang Zian, Yu Guodong for motion capture.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Yun Liu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Jin, Y., Ma, M., Liu, Y. (2020). Interactive Narrative in Augmented Reality: An Extended Reality of the Holocaust. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality. Industrial and Everyday Life Applications. HCII 2020. Lecture Notes in Computer Science(), vol 12191. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49697-5

  • Online ISBN: 978-3-030-49698-2

  • eBook Packages: Computer ScienceComputer Science (R0)