Abstract
Immersive analytics is an emerging field of data exploration and analysis in immersive environments. The main idea is to use visual analytics in a fully immersive 3D space. The availability of immersive Extended Reality systems has increased tremendously recently, but it is still not as widely used as conventional 2D displays. We describe an immersive analysis system for spatio-temporal data and compare how it performs in an immersive environment and on a conventional 2D display. We provide a novel view called map-plot that enables analysis and exploration of spatial time series data. We also design an embodied interaction for the map-plot view. The approach is realized based on the coordinated multiple views paradigm. In addition to the map-plot view, several standard views are available. Voice commands and spatial audio are used to support interaction and increase users’ embodiment. The findings from a user study show that developed system is much more efficient in a real immersive environment than using conventional 2D displays.
D. Sardana and S. Y. Kahu—The authors contributed equally to the paper.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
IEEE VIS 2019 conference: VAST challenge: mini-challenge. https://vast-challenge.github.io/2019/. Accessed 12 Feb 2021
International Reference Ionosphere - IRI (2016). Community Coordinated Modeling Center (CCMC) \(|\) NASA. https://ccmc.gsfc.nasa.gov/modelweb/models/iri2016_vitmo.php. Accessed 12 Feb 2021
UCI Machine Learning Repository: Iris Data Set. https://archive.ics.uci.edu/ml/datasets/iris. Accessed 12 Feb 2021
Web Speech API - Web APIs — MDN. https://developer.mozilla.org/en-US/docs/Web/API/Web_Speech_API. Accessed 12 Feb 2021
Ams, L., Cook, D., Cruz-Neira, C.: The benefits of statistical visualization in an immersive environment. In: Proceedings of the IEEE Virtual Reality 1999 Conference, pp. 88–95 (1999)
Bach, B., Sicat, R., Beyer, J., Cordeil, M., Pfister, H.: The hologram in my hand: how effective is interactive exploration of 3D visualizations in immersive tangible augmented reality? IEEE Trans. Visual Comput. Graphics 24(1), 457–467 (2018)
Barrett, N., Mair, K.: Sonification for geoscience: listening to faults from the inside. In: EGU General Assembly Conference Abstracts, vol. 16 (2014)
Blum, S., Cetin, G., Stuerzlinger, W.: Immersive analytics sensemaking on different platforms. In: Proceedings of the 27th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG 2019), pp. 69–80 (2019)
Cavallo, M., Dolakia, M., Havlena, M., Ocheltree, K., Podlaseck, M.: Immersive insights: a hybrid analytics system for collaborative exploratory data analysis. In: Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology, pp. 1–12. ACM (2019)
Chandler, T., et al.: Immersive analytics. In: Proceedings of the 2015 Big Data Visual Analytics (BDVA 2015), pp. 1–8. IEEE (2015)
Cordeil, M., et al.: IATK: an immersive analytics toolkit. In: Proceedings of the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR 2019), pp. 200–209. IEEE (2019)
Donalek, C., et al.: Immersive and collaborative data visualization using virtual reality platforms. In: Proceedings of the 2014 IEEE International Conference on Big Data (Big Data 2014), pp. 609–614. IEEE (2014)
Dwyer, T., et al.: Immersive analytics: an introduction. In: Immersive Analytics. LNCS, vol. 11190, pp. 1–23. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01388-2_1
Fitch, W.T., Kramer, G.: Sonifying the body electric: superiority of an auditory over a visual display in a complex, multivariate system. In: Santa Fe Institute Studies on the Sciences of Complexity, Proceedings, vol. 18, pp. 307–307. Addison-Wesley Publishing Co (1994)
Fonnet, A., Prié, Y.: Survey of immersive analytics. IEEE Trans. Visual. Comput. Graphics 1–22 (2019)
Gračanin, D.: Immersion versus embodiment: embodied cognition for immersive analytics in mixed reality environments. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) AC 2018. LNCS (LNAI), vol. 10915, pp. 355–368. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91470-1_29
Hoppenstedt, B., et al.: Applicability of immersive analytics in mixed reality: usability study. IEEE Access 7, 71921–71932 (2019)
Johansson, M.: VR for your ears: dynamic 3D audio is key to the immersive experience. IEEE Spectr. 56(2), 24–29 (2019)
Levene, H.: Robust tests for equality of variances. Contributions to probability and statistics. Essays in honor of Harold Hotelling, pp. 279–292 (1961)
Marquardt, A., Trepkowski, C., Eibich, D., Maiero, J., Kruijff, E.: Non-visual cues for view management in narrow field of view augmented reality displays. In: Proceedings of the IEEE International Symposium for Mixed and Augmented Reality 2019 (2019)
Mauney, B.S., Walker, B.N.: Creating functional and livable soundscapes for peripheral monitoring of dynamic data. In: Proceedings of the Tenth International Conference on Auditory Display (2004)
Prouzeau, A., Lhuillier, A., Ens, B., Weiskopf, D., Dwyer, T.: Visual link routing in immersive visualisation. In: Proceedings of the 2019 International Conference on Interactive Surfaces and Spaces, pp. 241–253. ACM, New York (2019)
Shapiro, S.S., Wilk, M.B.: An analysis of variance test for normality (complete samples). Biometrika 52(3–4), 591–611 (1965). https://doi.org/10.1093/biomet/52.3-4.591
Srinivasan, A., Stasko, J.: Orko: facilitating multimodal interaction for visual exploration and analysis of networks. IEEE Trans. Visual Comput. Graphics 24(1), 511–521 (2017)
Su, S., Perry, V., Dasari, V.: Comparative study for multiple coordinated views across immersive and non-immersive visualization systems. In: Chen, J.Y.C., Fragomeni, G. (eds.) HCII 2019. LNCS, vol. 11574, pp. 321–332. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-21607-8_25
Wagner Filho, J.A., Rey, M.F., Freitas, C.M., Nedel, L.: Immersive visualization of abstract information: an evaluation on dimensionally-reduced data scatterplots. In: Proceedings of the 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR 2018), pp. 483–490. IEEE (2018)
Yang, Y., Dwyer, T., Jenny, B., Marriott, K., Cordeil, M., Chen, H.: Origin-destination flow maps in immersive environments. IEEE Trans. Visual Comput. Graphics 25(1), 693–703 (2018)
Acknowledgements
VRVis is funded by BMK, BMDW, Styria, SFG, Tyrol and Vienna Business Agency in the scope of COMET - Competence Centers for Excellent Technologies (879730) which is managed by FFG.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Sardana, D., Kahu, S.Y., Gračanin, D., Matković, K. (2021). Multi-modal Data Exploration in a Mixed Reality Environment Using Coordinated Multiple Views. In: Yamamoto, S., Mori, H. (eds) Human Interface and the Management of Information. Information Presentation and Visualization. HCII 2021. Lecture Notes in Computer Science(), vol 12765. Springer, Cham. https://doi.org/10.1007/978-3-030-78321-1_26
Download citation
DOI: https://doi.org/10.1007/978-3-030-78321-1_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-78320-4
Online ISBN: 978-3-030-78321-1
eBook Packages: Computer ScienceComputer Science (R0)