Abstract
To date in the defence industry, virtual reality (VR) headsets are used primarily for training and simulation, while mixed reality (MR) headsets can be used in military operations. However, technological hardware advancements that blend VR and MR headset capabilities will result in increasing convergence of VR and MR applications. Accordingly, our primary objective in the current work was to present guidelines for Unity developers to convert graphical VR content to MR content in the Unity game engine. Guidelines herein address how to change camera settings to adapt from VR to MR applications, how to convert graphical user interfaces (GUIs) from VR to MR, and how to place graphical objects in MR environments. Another important objective of this work was to describe a user-controlled GUI we developed that allows real-time, progressive conversion of graphics from full VR to various levels of MR in a MR headset. This GUI provides end-users flexibility to customize their environment for gaming, training, and operational applications along an extended reality spectrum. In our future work, we are developing a tool that automates the VR to MR graphic conversion process. This tool, the guidelines, and the GUI will help researchers compare different levels of graphic content displayed in the scene and investigate the user-centered challenges that arise. It will also help Unity developers in defence, gaming, and commercial industries generate a scene in VR and quickly convert it to MR, saving the cost associated with generating separate MR scenes from scratch for multiple applications.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Gonzalez, J.: Pilot training next, air force ROTC partner for distance learning instruction. Air Education and Training Command Public Affairs (2020)
von Niederhausem, S.: World's First Qualified Device Virtual Reality Training Allows Time to Be Credited Towards Flight Training. VRM Switzerland (2021)
Reiner, A.J., et al.: A mirror in the sky: assessment of an augmented reality method for depicting navigational information. Ergonomics 63(5), 548–562 (2020)
Douglas, D.B., et al.: Virtual reality and augmented reality: advances in surgery. Biol Eng Med 2, 1–8 (2017)
He, Z., et al.: Progress in virtual reality and augmented reality based on holographic display. Appl. Opt. 58(5), A74–A81 (2019)
XR Collaboration. XR Glossary. [Web Page] 2021 https://xrcollaboration.com/guide/a-global-resource-guide-to-xr-collaboration/xr-glossary/. Accessed 3 June 2021
Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 77(12), 1321–1329 (1994)
Lee, W.T., et al.: High‐resolution 360 video foveated stitching for real‐time VR. Computer Graphics Forum. 36, 115–123 (2017)
Saeed, S., et al.: A high-quality VR calibration and real-time stitching framework using preprocessed features. IEEE Access 8, 190300–190311 (2020)
Dickey, R.M., et al.: Augmented reality assisted surgery: a urologic training tool. Asian J. Androl. 18(5), 732 (2016)
The Khronos Group (2021). https://www.khronos.org/openxr/. Accessed 3 June 2021
Grossman, R., Salas, E.: The transfer of training: what really matters. Int. J. Train. Dev. 15(2), 103–120 (2011)
Microsoft. Camera setup in Unity. (2021). https://docs.microsoft.com/en-us/windows/mixed-reality/develop/unity/camera-in-unity. Accessed 3 June 2021
Microsoft. Using the Mixed Reality OpenXR Plugin (2021) https://docs.microsoft.com/en-us/windows/mixed-reality/develop/unity/openxr-getting-started. Accessed 3 June 2021
Microsoft. Spatial Awareness. https://microsoft.github.io/MixedRealityToolkit-Unity/Documentation/SpatialAwareness/SpatialAwarenessGettingStarted.html. Accessed 3 June 2021
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Her Majesty the Queen in Right of Canada
About this paper
Cite this paper
Kirollos, R., Harriott, M. (2021). Virtual Reality to Mixed Reality Graphic Conversion in Unity. In: Stephanidis, C., Antona, M., Ntoa, S. (eds) HCI International 2021 - Late Breaking Posters. HCII 2021. Communications in Computer and Information Science, vol 1498. Springer, Cham. https://doi.org/10.1007/978-3-030-90176-9_46
Download citation
DOI: https://doi.org/10.1007/978-3-030-90176-9_46
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-90175-2
Online ISBN: 978-3-030-90176-9
eBook Packages: Computer ScienceComputer Science (R0)