Abstract
Many outdoor spaces have hidden stories connected with them that can be used to enrich a tourist’s experience. These stories are often related to environmental features which are far from the user and far apart from each other. Therefore, they are difficult to explore by locomotion, but can be visually explored from a vantage point. Telling a story from a vantage point is challenging since the system must ensure that the user can identify the relevant features in the environment. Gaze-guided narratives are an interaction concept that helps in such situations by telling a story dynamically depending on the user’s current and previous gaze on a panorama. This chapter suggests a formal modeling approach for gaze-guided narratives, based on narrative mediation trees. The approach is illustrated with an example from the Swiss saga around ‘Wilhelm Tell’.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
References
Anagnostopoulos VA, Havlena M, Kiefer P, Giannopoulos I, Schindler K, Raubal M (2017) Gaze-informed location based services. Int J Geogr Inf Sci 31(9):1770–1797. https://doi.org/10.1080/13658816.2017.1334896
Azaryahu M, Foote KE (2008) Historical space as narrative medium: on the configuration of spatial narratives of time at historical sites. Geo J 73(3):179–194. https://doi.org/10.1007/s10708-008-9202-4
Bal M, Van Boheemen C (2009) Narratology: introduction to the theory of narrative. University of Toronto Press
Bednarik R, Vrzakova H, Hradis M (2012) What do you want to do next: a novel approach for intent prediction in gaze-based interaction. In: Proceedings of the symposium on eye tracking research and applications. ACM, pp 83–90
Bettini C, Mascetti S (2016) Safetrekker: towards automatic recognition of critical situations in mountain excursions. In: (UbiMount) ubiquitous computing in the mountains (2016)
Bulling A, Gellersen H (2010) Toward mobile eye-based human-computer interaction. IEEE Pervasive Comput 9(4):8–12
Cavazza M, Charles F, Mead SJ (2002) Emergent situations in interactive storytelling. In: Proceedings of the 2002 ACM symposium on applied computing. ACM, pp 1080–1085
Cheverst, KWJ, Gregory IN, Turner H (2016) Encouraging visitor engagement and reflection with the landscape of the english lake district: exploring the potential of locative media. In: International workshop on ‘Unobtrusive user experiences with technology in nature’, pp 1–5
Farman J (2013) The mobile story: narrative practices with locative technologies. Routledge
Giannopoulos I, Kiefer P, Raubal M (2013) Mobile outdoor gaze-based GeoHCI. Geographic human-computer interaction. Workshop at CHI 2013. France, Paris, pp 12–13
Häkkilä J, Cheverst J, Schöning K, Bidwell J, Robinson NJS, Colley A (2016) NatureCHI: Unobtrusive user experiences with technology in nature. In: Proceedings of the 2016 CHI conference extended abstracts on human factors in computing systems, CHI EA ’16. ACM, New York, NY, USA, pp 3574–3580. https://doi.org/10.1145/2851581.2856495
Hansen DW, Pece AE (2005) Eye tracking in the wild. Comput Vis Image Underst 98(1):155–181
Huang MX, Li J, Ngai G, Leong HV, Bulling A (2019) Moment-to-moment detection of internal thought during video viewing from eye vergence behavior. In: Proceedings of the ACM multimedia (MM) (2019). https://doi.org/10.1145/3343031.3350573
Kiefer P (2019) Gaze-based narratives for location-based games. In: Designing for outdoor play, workshop at CHI. https://doi.org/10.3929/ethz-b-000337913
Kiefer P, Giannopoulos I, Kremer D, Schlieder C, Raubal M (2014) Starting to get bored: an outdoor eye tracking study of tourists exploring a city panorama. In: Proceedings of the symposium on eye tracking research and applications, ETRA ’14. ACM, New York, NY, USA, pp 315–318. https://doi.org/10.1145/2578153.2578216
Kiefer P, Matyas S, Schlieder C (2006) Learning about cultural heritage by playing Geogames. In: Harper R, Rauterberg M, Combetto M (eds) Entertainment computing—ICEC 2006, lecture notes in computer science, vol 4161. Springer, Berlin, Heidelberg, pp 217–228. https://doi.org/10.1007/11872320_26
Kiefer P, Raubal M, Probst T, Bär H (2014) Linear location-based services. In: Proceedings of the 11th international symposium on location-based services (LBS 2014), pp 239–243
Kiefer P, Straub F, Raubal M (2012) Towards location-aware mobile eye tracking. In: Proceedings of the symposium on eye tracking research and applications, ETRA ’12. ACM, New York, NY, USA, pp 313–316. https://doi.org/10.1145/2168556.2168624
Krejtz K, Duchowski A, Krejtz I, Szarkowska A, Kopacz A (2016) Discerning ambient/focal attention with coefficient k. ACM Trans Appl Percept (TAP) 13(3):11
Kwok TC, Kiefer P, Schinazi V, Adams B, Raubal M (2019) Gaze-guided narratives: Adapting audio guide content to gaze in virtual and real environments. In: Proceedings of the 2019 CHI conference on human factors in computing systems, CHI ’19. ACM, New York, NY, USA. https://doi.org/10.1145/3290605.3300721
Losing V, Rottkamp L, Zeunert M, Pfeiffer T (2014) Guiding visual search tasks using gaze-contingent auditory feedback. In: Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing: adjunct publication, UbiComp ’14 adjunct. ACM, New York, NY, USA, pp 1093–1102. https://doi.org/10.1145/2638728.2641687
Majaranta P, Bulling A (2014) Eye tracking and eye-based human–computer interaction. In: Advances in physiological computing. Springer, pp 39–65
Nisi V, Wood A, Davenport G, Oakley I (2004) Hopstory: an interactive, location-based narrative distributed in space and time. In: International conference on technologies for interactive digital storytelling and entertainment. Springer, pp 132–141
Porteous J, Cavazza M, Charles F (2010) Applying planning to interactive storytelling: narrative control using state constraints. ACM Trans Intell Syst Technol (TIST) 1(2):10
Riedl MO, Bulitko V (2012) Interactive narrative: an intelligent systems approach. AI Mag 34(1):67
Riedl MO, Stern A, Dini D, Alderman J (2008) Dynamic experience management in virtual worlds for entertainment, education, and training. Int Trans Syst Sci Appl Spec Issue Agent Based Syst Hum Learn 4(2):23–42
Riedl MO, Young RM (2006) From linear story generation to branching story graphs. IEEE Comput Graph Appl 26(3):23–31
Riedl MO, Young RM (2010) Narrative planning: balancing plot and character. J Artif Intell Res 39:217–268
Sailer C, Kiefer P, Schito J, Raubal M (2016) Map-based visual analytics of moving learners. Int J Mob Hum Comput Interact 8(4). https://doi.org/10.4018/IJMHCI.2016100101
Schiller F (2001) Wilhelm Tell. Reclam
Schöning J, Hecht B, Starosielski N (2008) Evaluating automatically generated location-based stories for tourists. In: CHI’08 extended abstracts on human factors in computing systems. ACM, pp 2937–2942
Turner J, Velloso E, Gellersen H, Sundstedt V (2014) Eyeplay: applications for gaze in games. In: Proceedings of the first ACM SIGCHI annual symposium on computer-human interaction in play, CHI PLAY ’14. ACM, New York, NY, USA, pp 465–468. https://doi.org/10.1145/2658537.2659016
Webster A (2019) Assassin’s creed origins new educational mode is a violence-free tour through ancient Egypt. https://www.theverge.com/2018/2/20/17033024/assassins-creed-origins-discovery-tour-educational-mode-release. Accessed 28 May 2019
Wiehr F, Kosmalla F, Daiber F, Krüger A (2016) Interfaces for assessing the rated perceived exertion (rpe) during high-intensity activities. In: Proceedings of the 2016 ACM international joint conference on pervasive and ubiquitous computing: adjunct, UbiComp ’16. ACM, New York, NY, USA, pp 851–855. https://doi.org/10.1145/2968219.2968532
Young RM, Ware SG, Cassell BA, Robertson J (2013) Plans and planning in narrative generation: a review of plan-based approaches to the generation of story, discourse and interactivity in narratives. Sprache und Datenverarb Spec Issue Form ComputMod Narrat 37(1–2):41–64
Acknowledgments
This work has been supported by ETH Zurich Research Grant ETH-38 14-2. We thank Lisa Stähli for helping with the content for the Tell scenario.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Kiefer, P., Adams, B., Kwok, T.C.K., Raubal, M. (2020). Modeling Gaze-Guided Narratives for Outdoor Tourism. In: McCrickard, D.S., Jones, M., Stelter, T.L. (eds) HCI Outdoors: Theory, Design, Methods and Applications. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-030-45289-6_17
Download citation
DOI: https://doi.org/10.1007/978-3-030-45289-6_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-45288-9
Online ISBN: 978-3-030-45289-6
eBook Packages: Computer ScienceComputer Science (R0)