Abstract
EXtended Reality (XR) is a rapidly developing paradigm for computer entertainment, and is also increasingly used for simulation, training, data analysis, and other non-entertainment purposes, often employing head-worn XR devices like the Microsoft HoloLens. In XR, integration with the physical world should also include integration with commonly used digital devices. This paper proposes an architecture to integrate head-worn displays with touchscreen devices, such as phones, tablets, or large tabletop or wall displays. The architecture emerged through the iterative development of a prototype for collaborative analysis and decision-making for the maritime domain. However, our architecture can flexibly support a range of domains and purposes. XR designers, XR entertainment researchers, and game developers can benefit from our architecture to propose new ways of gaming, considering multiple devices as user interfaces in an immersive collaborative environment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ahir, K., Govani, K., Gajera, R., Shah, M.: Application on virtual reality for enhanced education learning, military training and sports. Augmented Hum. Res. 5(1), 7 (2020)
Cadenas, C.: Geovisualization: integration and visualization of multiple datasets using mapbox. California Polytechnic State University (2014)
Calvelo, M., Piñeiro, Á., Garcia-Fandino, R.: An immersive journey to the molecular structure of sars-cov-2: Virtual reality in covid-19. Comput. Struct. Biotech. J. 18, 2621–2628 (2020)
Carrión, M., Santorum, M., Benavides, J., Aguilar, J., Ortiz, Y.: Developing a virtual reality serious game to recreational therapy using iplus methodology. In: 2019 International Conference on Virtual Reality and Visualization (ICVRV), pp. 133–137. IEEE (2019)
Crickard III, P.: Leaflet. js essentials. Packt Publishing Ltd. (2014)
Exit Games Inc: Realtime intro \(|\) photon engine. https://doc.photonengine.com/en-us/realtime/current/getting-started/realtime-intro. (Accessed 22 Apr 2022)
Gackenheimer, C., Paul, A.: Introduction to React. Apress, Berkeley, CA (2015). https://doi.org/10.1007/978-1-4842-1245-5
Genest, A.M., Gutwin, C., Tang, A., Kalyn, M., Ivkovic, Z.: Kinectarms: a toolkit for capturing and displaying arm embodiments in distributed tabletop groupware. In: Proceedings of the 2013 Conference on Computer Supported Cooperative Work, pp. 157–166 (2013)
Herz, D., Lee, P., Lutz, L., Stewart, M., Tuell, J., Wiig, J., et al.: Addressing the needs of multi-system youth: Strengthening the connection between child welfare and juvenile justice. In: Center for Juvenile Justice Reform, pp. 1–69 (2012)
Huh, S., Muralidharan, S., Ko, H., Yoo, B.: Xr collaboration architecture based on decentralized web. In: The 24th International Conference on 3D Web Technology, Web3D 2019, p. 1–9. , Association for Computing Machinery, New York, NY, USA (2019). https://doi.org/10.1145/3329714.3338137,https://doi.org/10.1145/3329714.3338137
Kaltenbrunner, M., Bovermann, T., Bencina, R., Costanza, E., et al.: Tuio: A protocol for table-top tangible user interfaces. In: Proceedings of the The 6th Int’l Workshop on Gesture in Human-Computer Interaction and Simulation, pp. 1–5. Citeseer (2005)
Kühnapfel, U., Cakmak, H.K., Maaß, H.: Endoscopic surgery training using virtual reality and deformable tissue simulation. Comput. Graph. 24(5), 671–682 (2000)
Linwood, J.: Getting started with the Mapbox SDK. In: Build Location Apps on iOS with Swift, pp. 165–178. Apress, Berkeley, CA (2020). https://doi.org/10.1007/978-1-4842-6083-8_11
Marquardt, N., Diaz-Marino, R., Boring, S., Greenberg, S.: The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, pp. 315–326 (2011)
Pérez, J., Arenas, M., Gutierrez, C.: Semantics and complexity of sparql. ACM Trans. Database Syst. (TODS) 34(3), 1–45 (2009)
Powers, J.D., Edwards, J.D., Blackman, K.F., Wegmann, K.M.: Key elements of a successful multi-system collaboration for school-based mental health: In-depth interviews with district and agency administrators. Urban Rev. 45(5), 651–670 (2013)
Ran, X., Slocum, C., Tsai, Y.Z., Apicharttrisorn, K., Gorlatova, M., Chen, J.: Multi-user augmented reality with communication efficient and spatially consistent virtual objects. In: Proceedings of the 16th International Conference on emerging Networking EXperiments and Technologies, pp. 386–398 (2020)
Reilly, D.F., Rouzati, H., Wu, A., Hwang, J.Y., Brudvik, J., Edwards, W.K.: Twinspace: an infrastructure for cross-reality team spaces. In: Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology, pp. 119–128 (2010)
Rizzo, A., et al.: Virtual reality goes to war: A brief review of the future of military behavioral healthcare. J. Clin. Psychol. Med. Settings 18(2), 176–187 (2011)
Salimian, H., Brooks, S., Reilly, D.: Mp remix: Relaxed wysiwis immersive interfaces for mixed presence collaboration with 3d content. In: Proceedings of the ACM Human-Computer Interaction 3(CSCW), Nov 2019. https://doi.org/10.1145/3359207
Salimian, M., Brooks, S., Reilly, D.: Imrce: A unity toolkit for virtual co-presence. In: Proceedings of the Symposium on Spatial User Interaction, pp. 48–59 (2018)
Seyed, T., Azazi, A., Chan, E., Wang, Y., Maurer, F.: Sod-toolkit: A toolkit for interactively prototyping and developing multi-sensor, multi-device environments. In: Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces, pp. 171–180 (2015)
Statista, A.: The statistics portal. Web site (2021). https://www.statista.com/statistics/591181/global-augmented-virtual-reality-market-size/
Studios, B.G.: The elder scrolls v: Skyrim. Bethesda Game Studios (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 IFIP International Federation for Information Processing
About this paper
Cite this paper
Porcino, T., Ghaeinian, S.A., Franz, J., Malloch, J., Reilly, D. (2022). Design of an Extended Reality Collaboration Architecture for Mixed Immersive and Multi-surface Interaction. In: Göbl, B., van der Spek, E., Baalsrud Hauge, J., McCall, R. (eds) Entertainment Computing – ICEC 2022. ICEC 2022. Lecture Notes in Computer Science, vol 13477. Springer, Cham. https://doi.org/10.1007/978-3-031-20212-4_9
Download citation
DOI: https://doi.org/10.1007/978-3-031-20212-4_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-20211-7
Online ISBN: 978-3-031-20212-4
eBook Packages: Computer ScienceComputer Science (R0)
