Abstract
Omnidirectional video (ODV) provides possibilities for capture and presentation of cultural content for museums and other exhibitions. 360° video capture can record authentic environments and activities, and enables immersive viewing of such material. We present the potential of ODV by reporting the learnings from long-term user experience data collection with two ODV-based museum installations; a head mounted display (HMD) based rally simulator, and a road grader simulator utilizing three projectors and haptic feedback. The results show the value of immersion, provide insights into the possibilities and challenges of interactivity, and show, how haptic feedback can improve the overall experience. The results also provide support to the use of physical elements in museum installations. In addition, we managed to avoid cyber sickness, a common problem with immersive VR content, in the installations. Overall, the respondents strongly support the conception that these kinds of installations would make museums more desirable places to visit.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Argyriou, L., Economou, D., Bouki, V., Doumanis, I.: Engaging immersive video consumers: challenges regarding 360-degree gamified video applications. In: 15th IEEE International Conference on Ubiquitous Computing and Communications and 2016 International Symposium on Cyberspace and Security (IUCC-CSS 2016), pp. 145–152. IEEE (2016). https://doi.org/10.1109/iucc-css.2016.028
Benko, H., Wilson, A.D.: Multi-point interactions with immersive omnidirectional visualizations in a dome. In: ACM International Conference on Interactive Tabletops and Surfaces (ITS 2010), pp. 19–28. ACM, New York (2010). https://doi.org/10.1145/1936652.1936657
Berning, M., Yonezawa, T., Riedel, T., Nakazawa, J., Beigl, M., Tokuda, H.: pARnorama. 360 degree interactive video for augmented reality prototyping. In: The 2013 ACM Conference on Pervasive and Ubiquitous Computing (UbiComp 2013), pp. 1471–1474. ACM, New York (2013). https://doi.org/10.1145/2494091.2499570
Bleumers, L., Van den Broeck, W., Lievens, B., Pierson, J.: Seeing the bigger picture: a user perspective on 360° TV. In: 10th European Conference on Interactive TV and Video (EuroiTV 2012), pp. 115–124. ACM, New York (2012). https://doi.org/10.1145/2325616.2325640
Boult, T.E.: Remote reality via omnidirectional imaging. In: ACM SIGGRAPH 98 Conference Abstracts and applications (SIGGRAPH 1998), p. 253. ACM, New York (1998). https://doi.org/10.1145/280953.282215
Concert - 360-degree Video from ZuZuVideo. https://www.youtube.com/watch?v=1Kp1_icG328
De la Torre, F., Vallespi, C., Rybski, P.E., Veloso, M., Kanade, T.: Omnidirectional video capturing, multiple people tracking and identification for meeting monitoring. Technical report (2005). http://repository.cmu.edu/robotics/128/
Decock, J., Van Looy, J., Bleumers, L., Bekaert, P.: The pleasure of being (there?): an explorative study into the effects of presence and identification on the enjoyment of an interactive theatrical performance using omnidirectional video. AI Soc. 29(4), 449–459 (2014). https://doi.org/10.1007/s00146-013-0487-6
Fassbender, E., Heiden, W.: Atmosphaeres – 360° video environments for stress and pain management. In: Ma, M., Oliveira, M.F., Baalsrud Hauge, J. (eds.) SGDA 2014. LNCS, vol. 8778, pp. 48–58. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-11623-5_5
Ekola, L., Järvinen, A.: KÄÄNNEKOHTA: 360-videon soveltuminen viittomakielen tulkkausharjoitteluun. Bachelor’s thesis. Diaconia University of Applied Sciences, Degree Programme in Sign Language Interpretation (2014). https://publications.theseus.fi/bitstream/handle/10024/73100/Ekola_Jarvinen.pdf?sequence=1
Kallioniemi, P., Mäkelä, V., Saarinen, S., Turunen, M., Winter, Y., Istudor, A.: User experience and immersion of interactive omnidirectional videos in CAVE systems and head-mounted displays. In: Bernhaupt, R., Dalvi, G., Joshi, A., K. Balkrishan, D., O’Neill, J., Winckler, M. (eds.) INTERACT 2017. LNCS, vol. 10516, pp. 299–318. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-68059-0_20
Kasahara, S., Nagai, S., Rekimoto, J.: First person omnidirectional video: system design and implications for immersive experience. In: ACM International Conference on Interactive Experiences for TV and Online Video (TVX 2015), pp. 33–42. ACM, New York (2015). https://doi.org/10.1145/2745197.2745202
Kasahara, S., Rekimoto, J.: JackIn head: immersive visual telepresence system with omnidirectional wearable camera for remote collaboration. In: 21st ACM Symposium on Virtual Reality Software and Technology (VRST 2015), pp. 217–225. ACM, New York (2015). https://doi.org/10.1145/2821592.2821608
Keskinen, T.: Evaluating the user experience of interactive systems in challenging circumstances. Ph.D. thesis. Dissertations in interactive technology 22, University of Tampere (2015). http://urn.fi/URN:ISBN:978-951-44-9972-2
Kwiatek, K.: How to preserve inspirational environments that once surrounded a poet? Immersive 360° video and the cultural memory of Charles Causley’s poetry. In: 18th International Conference on Virtual Systems and Multimedia (VSMM 2012), pp. 243–250. IEEE (2012). https://doi.org/10.1109/vsmm.2012.6365931
Kwiatek, K., Woolner, M.: Transporting the viewer into a 360° heritage story: panoramic interactive narrative presented on a wrap-around screen. In: 16th International Conference on Virtual Systems and Multimedia (VSMM 2010), pp. 234–241. IEEE (2010). https://doi.org/10.1109/vsmm.2010.5665980
Mammut #project360. https://play.google.com/store/apps/details?id=ch.mammut.project360&hl=en
Michelis, D., Müller, J.: The audience funnel: observations of gesture based interaction with multiple large displays in a city center. Int. J. Hum. Comput. Interact. 27(6), 562–579 (2011). https://doi.org/10.1080/10447318.2011.555299
Neng, L.A.R., Chambel, T.: Get around 360° hypervideo. In: 14th International Academic MindTrek Conference: Envisioning Future Media Environments (MindTrek 2010), pp. 119–122. ACM, New York (2010). https://doi.org/10.1145/1930488.1930512
Okura, F., Kanbara, M., Yokoya, N.: Fly-through Heijo palace site: augmented telepresence using aerial omnidirectional videos. In: ACM SIGGRAPH 2011 Posters (SIGGRAPH 2011), Article 78. ACM, New York (2011). https://doi.org/10.1145/2037715.2037803
Onoe, Y., Yamazawa, K., Takemura, H., Yokoya, N.: Telepresence by real-time view-dependent image generation from omnidirectional video streams. Comput. Vis. Image Underst. 71(2), 154–165 (1998). https://doi.org/10.1006/cviu.1998.0705
Pakkanen, T., Hakulinen, J., Jokela, T., Rakkolainen, I., Kangas, J., Piippo, P., Raisamo, T., Salmimaa, M.: Interaction with WebVR 360° video player: comparing three interaction paradigms. In: 2017 IEEE Virtual Reality (VR), pp. 279–280. IEEE (2017). https://doi.org/10.1109/vr.2017.7892285
Parra, G., De Croon, R., Klerkx, J., Duval, E.: Quantifying the interaction stages of a public display campaign in the wild. In: 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI 2014), pp. 757–760. ACM, New York (2014). https://doi.org/10.1145/2639189.2639216
Peñate, W., Pitti, C.T., Bethencourt, J.M., de la Fuente, J., Gracia, R.: The effects of a treatment based on the use of virtual reality exposure and cognitive-behavioral therapy applied to patients with agoraphobia. Int. J. Clin. Health Psychol. 8(1), 5–22 (2008)
Petry, B., Huber, J.: Towards effective interaction with omnidirectional videos using immersive virtual reality headsets. In: 6th Augmented Human International Conference (AH 2015), pp. 217–218. ACM, New York (2015). https://doi.org/10.1145/2735711.2735785
Ramalho, J., Chambel, T.: Windy sight surfers: sensing and awareness of 360° immersive videos on the move. In: 11th European Conference on Interactive TV and Video (EuroITV 2013), pp. 107–116. ACM, New York (2013). https://doi.org/10.1145/2465958.2465969
Rebenitsch, L., Owen, C.: Review on cybersickness in applications and visual displays. Virtual Reality 20(2), 101–125 (2016). https://doi.org/10.1007/s10055-016-0285-9
Rizzo, A.A., Ghahremani, K., Pryor, L., Gardner, S.: Immersive 360-degree panoramic video environments: research on creating useful and usable applications. In: Jacko, J.A., Stephanidis, C. (eds.) Human-Computer Interaction: Theory and Practice, Part 1, pp. 1233–1237. Lawrence Erlbaum Associates, Mahwah (2003)
Rovelo Ruiz, G.A., Vanacken, D., Luyten, K., Abad, F., Camahort, E.: Multi-viewer gesture-based interaction for omnidirectional video. In: 32nd ACM Conference on Human Factors in Computing Systems (CHI 2014), pp. 4077–4086. ACM, New York (2014). https://doi.org/10.1145/2556288.2557113
Saarinen, S., Mäkelä, V., Kallioniemi, P., Hakulinen, J., Turunen, M.: Guidelines for designing interactive omnidirectional video applications. In: Bernhaupt, R., Dalvi, G., Joshi, A., K. Balkrishan, D., O’Neill, J., Winckler, M. (eds.) INTERACT 2017. LNCS, vol. 10516, pp. 263–272. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-68059-0_17
Slater, M.: A note on presence terminology. Presence Connect 3(3), 1–5 (2003)
Turunen, M., et al.: Multimodal media center interface based on speech, gestures and haptic feedback. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5727, pp. 54–57. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-03658-3_9
Turunen, M., Hakulinen, J., Melto, A., Heimonen, T., Laivo, T., Hella, J.: SUXES - user experience evaluation method for spoken and multimodal interaction. In: 10th Annual Conference of the International Speech Communication Association, ISCA, pp. 2567–2570 (2009)
Ware, C., Osborne, S.: Exploration and virtual camera control in virtual three dimensional environments. In: The 1990 Symposium on Interactive 3D Graphics (I3D 1990), pp. 175–183. ACM, New York (1990). https://doi.org/10.1145/91385.91442
Yagi, Y.: Omnidirectional sensing and its applications. IEICE Trans. Inf. Syst. E82-D(3), 568–579 (1999)
Zoric, G., Barkhuus, L., Engström, A., Önnevall, E.: Panoramic video: design challenges and implications for content interaction. In: 11th European Conference on Interactive TV and Video, pp. 153–162. ACM, New York (2013). https://doi.org/10.1145/2465958.2465959
Zoric, G., Engström, A., Barkhuus, L., Ruiz-Hidalgo, J., Kochale, A.: Gesture interaction with rich TV content in the social setting. In: Exploring and Enhancing the User Experience for Television, Workshop of ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2013) (2013)
Acknowledgements
This work was done as a part of MIRACLE project, financed by Tekes – the Finnish Funding Agency for Innovation. We appreciate the involvement and input of Mobilia personnel who participated in the design process, data collection and maintenance of the installations. We thank also Juha Salo and his co-drivers for the possibility to record the materials.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Hakulinen, J., Keskinen, T., Mäkelä, V., Saarinen, S., Turunen, M. (2018). Omnidirectional Video in Museums – Authentic, Immersive and Entertaining. In: Cheok, A., Inami, M., Romão, T. (eds) Advances in Computer Entertainment Technology. ACE 2017. Lecture Notes in Computer Science(), vol 10714. Springer, Cham. https://doi.org/10.1007/978-3-319-76270-8_39
Download citation
DOI: https://doi.org/10.1007/978-3-319-76270-8_39
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-76269-2
Online ISBN: 978-3-319-76270-8
eBook Packages: Computer ScienceComputer Science (R0)