Skip to main content
View expanded cover

International Conference on Human-Computer Interaction

HCII 2021: Human Interface and the Management of Information. Information Presentation and Visualization pp 337–356Cite as

Multi-modal Data Exploration in a Mixed Reality Environment Using Coordinated Multiple Views

Part of the Lecture Notes in Computer Science book series (LNISA,volume 12765)

Abstract

Immersive analytics is an emerging field of data exploration and analysis in immersive environments. The main idea is to use visual analytics in a fully immersive 3D space. The availability of immersive Extended Reality systems has increased tremendously recently, but it is still not as widely used as conventional 2D displays. We describe an immersive analysis system for spatio-temporal data and compare how it performs in an immersive environment and on a conventional 2D display. We provide a novel view called map-plot that enables analysis and exploration of spatial time series data. We also design an embodied interaction for the map-plot view. The approach is realized based on the coordinated multiple views paradigm. In addition to the map-plot view, several standard views are available. Voice commands and spatial audio are used to support interaction and increase users’ embodiment. The findings from a user study show that developed system is much more efficient in a real immersive environment than using conventional 2D displays.

Keywords

  • Immersive analytics
  • Mixed reality
  • Embodied interaction
  • Coordinated multiple views

D. Sardana and S. Y. Kahu—The authors contributed equally to the paper.

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-78321-1_26
  • Chapter length: 20 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   84.99
Price excludes VAT (USA)
  • ISBN: 978-3-030-78321-1
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   109.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.

References

  1. IEEE VIS 2019 conference: VAST challenge: mini-challenge. https://vast-challenge.github.io/2019/. Accessed 12 Feb 2021

  2. International Reference Ionosphere - IRI (2016). Community Coordinated Modeling Center (CCMC) \(|\) NASA. https://ccmc.gsfc.nasa.gov/modelweb/models/iri2016_vitmo.php. Accessed 12 Feb 2021

  3. UCI Machine Learning Repository: Iris Data Set. https://archive.ics.uci.edu/ml/datasets/iris. Accessed 12 Feb 2021

  4. Web Speech API - Web APIs — MDN. https://developer.mozilla.org/en-US/docs/Web/API/Web_Speech_API. Accessed 12 Feb 2021

  5. Ams, L., Cook, D., Cruz-Neira, C.: The benefits of statistical visualization in an immersive environment. In: Proceedings of the IEEE Virtual Reality 1999 Conference, pp. 88–95 (1999)

    Google Scholar 

  6. Bach, B., Sicat, R., Beyer, J., Cordeil, M., Pfister, H.: The hologram in my hand: how effective is interactive exploration of 3D visualizations in immersive tangible augmented reality? IEEE Trans. Visual Comput. Graphics 24(1), 457–467 (2018)

    CrossRef  Google Scholar 

  7. Barrett, N., Mair, K.: Sonification for geoscience: listening to faults from the inside. In: EGU General Assembly Conference Abstracts, vol. 16 (2014)

    Google Scholar 

  8. Blum, S., Cetin, G., Stuerzlinger, W.: Immersive analytics sensemaking on different platforms. In: Proceedings of the 27th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG 2019), pp. 69–80 (2019)

    Google Scholar 

  9. Cavallo, M., Dolakia, M., Havlena, M., Ocheltree, K., Podlaseck, M.: Immersive insights: a hybrid analytics system for collaborative exploratory data analysis. In: Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology, pp. 1–12. ACM (2019)

    Google Scholar 

  10. Chandler, T., et al.: Immersive analytics. In: Proceedings of the 2015 Big Data Visual Analytics (BDVA 2015), pp. 1–8. IEEE (2015)

    Google Scholar 

  11. Cordeil, M., et al.: IATK: an immersive analytics toolkit. In: Proceedings of the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR 2019), pp. 200–209. IEEE (2019)

    Google Scholar 

  12. Donalek, C., et al.: Immersive and collaborative data visualization using virtual reality platforms. In: Proceedings of the 2014 IEEE International Conference on Big Data (Big Data 2014), pp. 609–614. IEEE (2014)

    Google Scholar 

  13. Dwyer, T., et al.: Immersive analytics: an introduction. In: Immersive Analytics. LNCS, vol. 11190, pp. 1–23. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01388-2_1

    CrossRef  Google Scholar 

  14. Fitch, W.T., Kramer, G.: Sonifying the body electric: superiority of an auditory over a visual display in a complex, multivariate system. In: Santa Fe Institute Studies on the Sciences of Complexity, Proceedings, vol. 18, pp. 307–307. Addison-Wesley Publishing Co (1994)

    Google Scholar 

  15. Fonnet, A., Prié, Y.: Survey of immersive analytics. IEEE Trans. Visual. Comput. Graphics 1–22 (2019)

    Google Scholar 

  16. Gračanin, D.: Immersion versus embodiment: embodied cognition for immersive analytics in mixed reality environments. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) AC 2018. LNCS (LNAI), vol. 10915, pp. 355–368. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91470-1_29

    CrossRef  Google Scholar 

  17. Hoppenstedt, B., et al.: Applicability of immersive analytics in mixed reality: usability study. IEEE Access 7, 71921–71932 (2019)

    CrossRef  Google Scholar 

  18. Johansson, M.: VR for your ears: dynamic 3D audio is key to the immersive experience. IEEE Spectr. 56(2), 24–29 (2019)

    CrossRef  Google Scholar 

  19. Levene, H.: Robust tests for equality of variances. Contributions to probability and statistics. Essays in honor of Harold Hotelling, pp. 279–292 (1961)

    Google Scholar 

  20. Marquardt, A., Trepkowski, C., Eibich, D., Maiero, J., Kruijff, E.: Non-visual cues for view management in narrow field of view augmented reality displays. In: Proceedings of the IEEE International Symposium for Mixed and Augmented Reality 2019 (2019)

    Google Scholar 

  21. Mauney, B.S., Walker, B.N.: Creating functional and livable soundscapes for peripheral monitoring of dynamic data. In: Proceedings of the Tenth International Conference on Auditory Display (2004)

    Google Scholar 

  22. Prouzeau, A., Lhuillier, A., Ens, B., Weiskopf, D., Dwyer, T.: Visual link routing in immersive visualisation. In: Proceedings of the 2019 International Conference on Interactive Surfaces and Spaces, pp. 241–253. ACM, New York (2019)

    Google Scholar 

  23. Shapiro, S.S., Wilk, M.B.: An analysis of variance test for normality (complete samples). Biometrika 52(3–4), 591–611 (1965). https://doi.org/10.1093/biomet/52.3-4.591

  24. Srinivasan, A., Stasko, J.: Orko: facilitating multimodal interaction for visual exploration and analysis of networks. IEEE Trans. Visual Comput. Graphics 24(1), 511–521 (2017)

    CrossRef  Google Scholar 

  25. Su, S., Perry, V., Dasari, V.: Comparative study for multiple coordinated views across immersive and non-immersive visualization systems. In: Chen, J.Y.C., Fragomeni, G. (eds.) HCII 2019. LNCS, vol. 11574, pp. 321–332. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-21607-8_25

    CrossRef  Google Scholar 

  26. Wagner Filho, J.A., Rey, M.F., Freitas, C.M., Nedel, L.: Immersive visualization of abstract information: an evaluation on dimensionally-reduced data scatterplots. In: Proceedings of the 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR 2018), pp. 483–490. IEEE (2018)

    Google Scholar 

  27. Yang, Y., Dwyer, T., Jenny, B., Marriott, K., Cordeil, M., Chen, H.: Origin-destination flow maps in immersive environments. IEEE Trans. Visual Comput. Graphics 25(1), 693–703 (2018)

    CrossRef  Google Scholar 

Download references

Acknowledgements

VRVis is funded by BMK, BMDW, Styria, SFG, Tyrol and Vienna Business Agency in the scope of COMET - Competence Centers for Excellent Technologies (879730) which is managed by FFG.

Author information

Authors and Affiliations

  1. Virginia Tech, Blacksburg, VA, USA

    Disha Sardana, Sampanna Yashwant Kahu & Denis Gračanin

  2. VRVis Research Center, Vienna, Austria

    Krešimir Matković

Authors
  1. Disha Sardana
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sampanna Yashwant Kahu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Denis Gračanin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Krešimir Matković
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Disha Sardana .

Editor information

Editors and Affiliations

  1. Tokyo University of Science, Tokyo, Saitama, Japan

    Sakae Yamamoto

  2. Tokyo City University, Tokyo, Japan

    Hirohiko Mori

Rights and permissions

Reprints and Permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Sardana, D., Kahu, S.Y., Gračanin, D., Matković, K. (2021). Multi-modal Data Exploration in a Mixed Reality Environment Using Coordinated Multiple Views. In: Yamamoto, S., Mori, H. (eds) Human Interface and the Management of Information. Information Presentation and Visualization. HCII 2021. Lecture Notes in Computer Science(), vol 12765. Springer, Cham. https://doi.org/10.1007/978-3-030-78321-1_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78321-1_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78320-4

  • Online ISBN: 978-3-030-78321-1

  • eBook Packages: Computer ScienceComputer Science (R0)