Abstract
The COVID-19 pandemic has had a tremendous impact on businesses, educational institutions, and other organizations that require in-person gatherings. Physical gatherings such as conferences, classes, and other social activities have been greatly reduced in favor of virtual meetings on Zoom, Webex or similar video-conferencing platforms. However, video-conferencing is quite limited in its ability to create meeting spaces that capture the authentic feel of a real-world meeting. Without the aid of body language cues, meeting participants have a harder time paying attention and keeping themselves engaged in virtual meetings. Video-conferencing, as it currently stands, falls short of providing a familiar environment that fosters personal connection between meeting participants. This paper explores an alternative approach to virtual meetings through the use of extended reality (XR) and embodied interactions. We present an application that leverages the full-body tracking capabilities of the Azure Kinect and the immersive affordances of XR to create more vibrant and engaging remote meeting environments.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Anderson, F., Grossman, T., Matejka, J., Fitzmaurice, G.: Youmove: enhancing movement training with an augmented reality mirror. In: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, pp. 311–320. ACM (2013)
Casu, A., Spano, L.D., Sorrentino, F., Scateni, R.: Riftart: bringing masterpieces in the classroom through immersive virtual reality. In: Proceedings of the Smart Tools and Apps for Graphics – Eurographics Italian Chapter Conference, pp. 77–84 (2015)
Dasgupta, A., Manuel, M., Mansur, R.S., Nowak, N., Gračanin, D.: Towards real time object recognition for context awareness in mixed reality: a machine learning approach. In: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), pp. 262–268 (2020)
Detyna, M., Kadiri, M.: Virtual reality in the he classroom: feasibility, and the potential to embed in the curriculum. J. Geogr. High. Educ. 44(3), 474–485 (2020)
Fadzli, F., Kamson, M., Ismail, A., Aladin, M.: 3D telepresence for remote collaboration in extended reality (xR) application. In: IOP Conference Series: Materials Science and Engineering, vol. 979, November 2020
Handosa, M., Schulze, H., Gračanin, D., Tucker, M., Manuel, M.: Extending embodied interactions in mixed reality environments. In: Chen, J.Y.C., Fragomeni, G. (eds.) VAMR 2018. LNCS, vol. 10909, pp. 314–327. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91581-4_23
Hunkeler, U., Truong, H.L., Stanford-Clark, A.: MQTT-S–a publish/subscribe protocol for wireless sensor networks. In: Proceedings of the 3rd International Conference on Communication Systems Software and Middleware and Workshops (COMSWARE 2008), pp. 791–798. IEEE (2008)
Johnson-Glenberg, M.C.: Immersive VR and education: embodied design principles that include gesture and hand controls. Front. Robot. AI 5, 81 (2018)
Ladwig, P., Geiger, C.: A literature review on collaboration in mixed reality. In: Auer, M.E., Langmann, R. (eds.) REV 2018. LNNS, vol. 47, pp. 591–600. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-95678-7_65
Maiese, M.: Rethinking attention deficit hyperactivity disorder. Philos. Psychol. 25(6), 893–916 (2012)
Manuel, M.: Video: Virtual classroom. https://youtu.be/XGzxcCI3RbA. Accessed 02 Sept 2021
Microsoft: Azure Kinect body tracking joints (2020). https://docs.microsoft.com/en-us/azure/kinect-dk/body-joints. Accessed 12 Feb 2021
Morris, B.: Why does Zoom exhaust you? Science has an answer. The Wall Street Journal, 27 May 2020
Sharma, S., Agada, R., Ruffin, J.: Virtual reality classroom as an constructivist approach. In: 2013 Proceedings of IEEE Southeastcon, pp. 1–5. IEEE (2013)
Shin, D.H.: The role of affordance in the experience of virtual reality learning: technological and affective affordances in virtual reality. Telematics Inform. 34(8), 1826–1836 (2017)
Sra, M., Schmandt, C.: Metaspace II: object and full-body tracking for interaction and navigation in social VR (2015). arXiv:1512.02922 [cs.HC]
Streitz, N.A., Geißler, J., Holmer, T.: Roomware for cooperative buildings: integrated design of architectural spaces and information spaces. In: Streitz, N.A., Konomi, S., Burkhardt, H.-J. (eds.) CoBuild 1998. LNCS, vol. 1370, pp. 4–21. Springer, Heidelberg (1998). https://doi.org/10.1007/3-540-69706-3_3
Streitz, N.A., et al.: i-LAND: an interactive landscape for creativity and innovation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 120–127. ACM, New York (1999)
van der Kruk, E., Reijne, M.M.: Accuracy of human motion capture systems for sport applications; state-of-the-art review. Eur. J. Sport Sci. 18(6), 806–819 (2018)
Weiser, M.: Ubiquitous computing. Computer 26(10), 71–72 (1993)
Wiederhold, B.K.: Connecting through technology during the coronavirus disease 2019 pandemic: avoiding “Zoom fatigue”. Cyberpsychol. Behav. Soc. Netw. 23(7), 437–438 (2020)
Wolf, C.R.: Virtual platforms are helpful tools but can add to our stress (2020). https://www.psychologytoday.com/ca/blog/the-desk-the-mental-health-lawyer/202005/virtual-platforms-are-helpful-tools-can-add-our-stress. Accessed 12 Feb 2021
Zhao, R., Wang, K., Divekar, R., Rouhani, R., Su, H., Ji, Q.: An immersive system with multi-modal human-computer interaction. In: Proceedings of the 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), pp. 517–524. IEEE (2018)
Acknowledgments
This work has been partially supported by a grant from the Virginia Tech Institute for Creativity, Art, and Technology.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Manuel, M., Dongre, P., Alhamadani, A., Gračanin, D. (2021). Supporting Embodied and Remote Collaboration in Shared Virtual Environments. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality. HCII 2021. Lecture Notes in Computer Science(), vol 12770. Springer, Cham. https://doi.org/10.1007/978-3-030-77599-5_44
Download citation
DOI: https://doi.org/10.1007/978-3-030-77599-5_44
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-77598-8
Online ISBN: 978-3-030-77599-5
eBook Packages: Computer ScienceComputer Science (R0)