Abstract
Room-sized immersive environments and interactive 3D spaces can support powerful visualizations and provide remarkable X-reality experiences to users. However, designing and developing applications for such spaces, in which user interaction takes place not only by gestures, but also through body movements is a demanding task. At the same time, contemporary software development methods and human-centered design mandate short iteration cycles and incremental development of prototypes. In this context, traditional design and software prototyping methods can no longer cope up with the challenges imposed by such environments. In this paper, we introduce an integrated technological framework for rapid prototyping of X-reality applications for interactive 3D spaces, featuring real-time person and object tracking, touch input support and spatial sound output. The framework comprises the interactive 3D space, and an API for developers.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bekele, M.K., et al.: A survey of augmented, virtual, and mixed reality for cultural heritage. J. Comput. Cultural Heritage (JOCCH) 11(2), 1–36 (2018)
Billinghurst, M., Clark, A., Lee, G.: A survey of augmented reality. Found. Trends® Hum.–Comput. Interaction 8(2–3), 73–272 (2015). https://doi.org/10.1561/1100000049
Cavallo, M., Dholakia, M., Havlena, M., Ocheltree, K., Podlaseck, M.: Dataspace: a reconfigurable hybrid reality environment for collaborative information analysis. In: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 145–153. IEEE (2019)
CAVELib. https://www.mechdyne.com/software.aspx?name=CAVELib. Accessed 19 June 2020
Chung, H., Andrews, C., North, C.: A survey of software frameworks for cluster-based large high-resolution displays. IEEE Trans. Vis. Comput. Graph. 20(8), 1158–1177 (2013)
Costanza, E., Kunz, A., Fjeld, M.: Mixed reality: a survey. In: Human Machine Interaction, pp. 47–68. Springer, Heidelberg (2009)
Cruz-Neira, C., Leigh, J., et al.: Scientists in wonderland: a report on visualization applications in the CAVE virtual reality environment. In: Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium, pp. 59–66. IEEE (1993)
Cruz-Neira, C., Sandin, D.J., DeFanti, T.A.: Surround-screen projection-based virtual reality: the design and implementation of the CAVE. In: Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, pp. 135–142 (1993)
Dimopoulos, A., Zidianakis, E., Stephanidis, C.: LASIMUP: large scale multi-touch support integration across multiple projections on arbitrary surfaces. In: Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference, pp. 62–66 (2018)
Farrell, R.G., Lenchner, J., et al.: Symbiotic cognitive computing. AI Mag. 37(3), 81–93 (2016)
Fast-Berglund, Å., Gong, L., Li, D.: Testing and validating Extended Reality (xR) technologies in manufacturing. Procedia Manuf. 25, 31–38 (2018)
Febretti, A., Nishimoto, A., et al.: CAVE2: a hybrid reality environment for immersive simulation and information analysis. In: The Engineering Reality of Virtual Reality 2013, vol. 8649, p. 864903. International Society for Optics and Photonics (2013)
Isakovic, K., Dudziak, T., Köchy, K.: X-rooms. In: Proceedings of the Seventh International Conference on 3D Web Technology, pp. 173–177 (2002)
Mann, S., Furness, T., Yuan, Y., Iorio, J., Wang, Z.: All reality: virtual, augmented, mixed (x), mediated (x, y), and multimediated reality. arXiv preprint arXiv:1804.08386 (2018)
Marrinan, T., Aurisano, J., et al.: SAGE2: a new approach for data intensive collaboration using Scalable Resolution Shared Displays. In: 10th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing, pp. 177–186. IEEE (2014)
Michelakis, A.: ACOUSMA: An intelligent mechanism towards providing personalized auditory feedback in ambient intelligence environments (Master's thesis) (2020). https://elocus.lib.uoc.gr/dlib/c/1/f/metadata-dlib-1593085755-225190-31302.tkl
Munaro, M., Basso, F., Menegatti, E.: OpenPTrack: Open source multi-camera calibration and people tracking for RGB-D camera networks. Robot. Autonomous Syst. 75, 525–538 (2016)
Papadopoulos, C., Petkov, K., Kaufman, A.E., Mueller, K.: The Reality Deck–an immersive gigapixel display. IEEE Comput. Graph. Appl. 35(1), 33–45 (2014)
Paradiso, J.A., Landay, J.A.: Guest editors’ introduction: Cross-reality environments. IEEE Pervasive Comput. 8(3), 14–15 (2009)
Reiners, D., Voß, G., Behr, J.: Opensg: basic concepts. In: 1. OpenSG Symposium OpenSG 2002 (2002)
Acknowledgments
This work has been supported by the FORTH-ICS internal RTD Programme ‘Ambient Intelligence and Smart Environments’. The authors would like to thank Konstantinos Tsirakos for his contribution in the development of the Projectors’ control service.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zidianakis, E. et al. (2021). A Technological Framework for Rapid Prototyping of X-reality Applications for Interactive 3D Spaces. In: Ahram, T., Taiar, R., Groff, F. (eds) Human Interaction, Emerging Technologies and Future Applications IV. IHIET-AI 2021. Advances in Intelligent Systems and Computing, vol 1378. Springer, Cham. https://doi.org/10.1007/978-3-030-74009-2_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-74009-2_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-73270-7
Online ISBN: 978-3-030-74009-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)