Abstract
This paper describes an early prototype of a distributed multimodal multi-user virtual environment used for the visualization and query of complex data. The system supports different user interfaces for viewing coloured 3D objects of various sizes representing high-dimensional data to allow visual exploration and pattern detection in the data. Users can navigate and query the environment by using multimodal interaction techniques including speech and gesture recognition. The system serves as a testbed to compare the usability of various interaction techniques for visualization and query of complex data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Dodge, S., Karam, L.: A study and comparison of human and deep learning recognition performance under visual distortions. In: Proceedings of the 26th International Conference on Computer Communication and Networks (ICCCN), Vancouver, BC, pp. 1–7 (2017)
Card, S.K., Mackinley, J.D., Shneiderman, B.: Readings in Information Visualization – Using Vision to Think. Morgan Kaufmann Publishers Inc., Burlington (1999)
Keim, D.A., Mansmann, F., Schneidewind, J., Thomas, J., Ziegler, H.: Visual analytics: scope and challenges. In: Simoff, S.J., Böhlen, M.H., Mazeika, A. (eds.) Visual Data Mining. LNCS, vol. 4404, pp. 76–90. Springer, Heidelberg (2008)
Mosavi, A.: Decision-making software architecture; the visualization and data mining assisted approach. Int. J. Inf. Comput. Secur. 3, 12–26 (2014)
Holzinger A.: Human-computer interaction and knowledge discovery (HCI-KDD): what is the benefit of bringing those two fields to work together? In: Cuzzocrea, A., Kittl, C., Simos, D.E., Weippl, E., Xu, L. (eds.) Availability, Reliability, and Security in Information Systems and HCI. LNCS, vol. 8127, pp. 319–328. Springer, Heidelberg (2013)
McGreevy, M.W.: Virtual reality and planetary exploration. In: An American Astronautical Society Publication; Volume 81 of the Science and Technologies Series – Human and Machines in Space – The Vision, The Challenge, pp. 93–115. The Payoff (1992)
Valdés, J.J.: Virtual reality representation of information systems and decision rules: an exploratory tool for understanding data and knowledge. In: Wang, G., Liu, Q., Yao, Y., Skowron, A. (eds.) Proceedings of the International Conference on Rough Sets, Fuzzy Sets, Data Mining and Granular Computing, LNAI, Chongqing, China, 8–12 October 2003, vol. 2639, pp. 615–618. Springer, heidelberg (2003)
Wickens, C.D., Baker, P.: Cognitive issues in virtual reality. In: Barfield, W., Furness III, T. (eds.) Virtual Environments and Advanced Interface Design, pp. 514–541. Oxford University Press, New York (1995)
Lapointe, J.-F., Savard, P., Vinson, N.G.: A comparative study of four input devices for desktop virtual walkthroughs. Comput. Hum. Behav. 27(6), 2186–2191 (2011)
LaViola, J.J., Kruijff, E., McMahan, R.P., Bowman, D.A., Poupyrev, I.: 3D user interfaces – Theory and practice, 2nd edn. Pearson Education Inc., London (2017)
Kruskal, J.: Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika 29(1), 1–27 (1964)
Sammon, J.W.: A nonlinear mapping for data structure analysis. IEEE Trans. Comput. C-18(5), 401–409 (1969)
Tenenbaum, J.B., De Silva, V., Langford, J.C.: A global geometric framework for nonlinear dimensionality reduction. Science 290(5500), 2319–2323 (2000)
Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 290, 2323–2326 (2000)
Belkin, M., Niyogi, P.: Laplacian Eigenmaps for dimensionality reduction and data representation. Neural Comput. 15(6), 1373–1396 (2003)
van der Maaten, L.J.P., Hinton, G.: Visualizing high-dimensional data using t-SNE. J. Mach. Learn. Res. 9, 2579–2605 (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Lapointe, JF., Valdés, J.J., Belliveau, L., Vinson, N.G., Emond, B., Léger, S. (2020). A Distributed Multimodal Multi-user Virtual Environment for Visualization and Query of Complex Data. In: Ahram, T., Taiar, R., Gremeaux-Bader, V., Aminian, K. (eds) Human Interaction, Emerging Technologies and Future Applications II. IHIET 2020. Advances in Intelligent Systems and Computing, vol 1152. Springer, Cham. https://doi.org/10.1007/978-3-030-44267-5_32
Download citation
DOI: https://doi.org/10.1007/978-3-030-44267-5_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-44266-8
Online ISBN: 978-3-030-44267-5
eBook Packages: EngineeringEngineering (R0)