Skip to main content

Concept of Mixed Reality Application Design for Technical Solutions

  • Conference paper
  • First Online:
8th EAI International Conference on Management of Manufacturing Systems (MMS 2023)

Abstract

Mixed reality (MR) is a rapidly expanding technology whose usability is constantly growing. Some applications of MR technology have already matured, while others are still in development. MR offers new possibilities in the area of interaction with objects in space. This can be used in technical solutions, especially in employee training, education, and virtual product prototyping. In addition, users can “virtually” test and train products and machines using before they even exist, which can lead to improved usability and better ergonomic design. This article provides an overview of tools and devices for building mixed reality applications. In the design part, a step-by-step manual is devoted to the creation of an MR application depicting machinery, with which it is possible to work with a hologram in a real environment. This procedure is subsequently generalized into a methodological algorithm for creating an MR application. The universal procedure can be used by designers, application programmers, but also by the general public, as a manual according to which we can import any 3D model into HoloLens 2 smart glasses. The proposed methodology offers unlimited potential for the use of MR in technical solutions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. O. Blimber, Spatial Augmented Reality: Merging Real and Virtual Worlds (A K Peters, Wellesley, 2005)

    Book  Google Scholar 

  2. J. Husár, L. Knapčíková, Possibilities of using augmented reality in warehouse management: A study. Acta Logist. 8(2), 133–139 (2021). https://doi.org/10.1007/10.22306/al.v8i2.212

    Article  Google Scholar 

  3. T. Mazuryk, M. Gervautz, Virtual Reality-History, Applications, Technology and Future (TU Wien University, Vienna, Austria, 1996)

    Google Scholar 

  4. O. Hansson, O. Nadum, Model based operator instructions using AR-technology. M.S. thesis, Department of Industrial and Materials Science, Chalmers University of Technology, Gothenburg, Sweden, 2019. https://hdl.handle.net/20.500.12380/300753. Last accessed 2022/11/04

  5. P. Milgram, H. Takemura, A. Utsumi, F. Kishino, Augmented reality: A class of displays on the reality-virtuality continuum, in Telemanipulator and Telepresence Technologies, ed. by H. Das, (SPIE, Bellingham, 1995), pp. 282–292. https://doi.org/10.1117/12.197321

    Chapter  Google Scholar 

  6. P. Milgram, F. Kishino, A taxonomy of Mixed Reality visual displays. IEICE Trans. Inf. Syst. E77-D(12), 1321–1329 (1994)

    Google Scholar 

  7. C. Forrest, Infographic: The history of AR and VR, and what the future holds, https://www.techrepublic.com/article/infographic-the-history-of-ar-and-vr-and-what-the-future-holds/. Last accessed 2022/11/04

  8. Y. Zinchenko, P. Khoroshikh, A. Sergievich, et al., Virtual reality is more efficient in learning human heart anatomy especially for subjects with low baseline knowledge. New Ideas Psychol. 59, 100786 (2020). https://doi.org/10.1016/j.newideapsych.2020.100786

    Article  Google Scholar 

  9. A. Mahmutovic, A. Andreasson, L. Söderström, Effektivisering av plockprocessen i lager med hjälp AV AR. Bachelor thesis, Department of Industrial and Materials Science, Chalmers University of Technology, Gothenburg, Sweden, 2018. https://hdl.handle.net/20.500.12380/255328. Last accessed 2022/11/03

  10. V. Kaushal, Exploratory study: Implementation and applications of extended reality. Master’s thesis, Faculty of Science and Technology, University of Stavanger, Department of Mechanical and Structural Engineering and Materials Science, 2019

    Google Scholar 

  11. A. Heinzel, S. Azhar, A. Nadeem, Uses of augmented reality technology during construction phase, in 9th International Conference of Construction in the Twenty-first Century (CITC9), 5–7 March 2017, Dubai, UAE (2017)

    Google Scholar 

  12. J. Kaščak, J. Husár, L. Knapčíková, J. Trojanowska, V. Ivanov, Conceptual use of augmented reality in the maintenance of manufacturing facilities, in Advances in Manufacturing III. MANUFACTURING 2022, Lecture notes in mechanical engineering, ed. by J. Trojanowska, A. Kujawińska, J. Machado, I. Pavlenko, (Springer, Cham, 2022). https://doi.org/10.1007/978-3-030-99310-8_19

    Chapter  Google Scholar 

  13. Unity. https://unity.com/. Last accessed 2022/11/04

  14. J. Kascak, M. Teliskova, J. Torok, et al., Implementation of augmented reality into the training and educational process in order to support spatial perception in technical documentation, in Proceeding of the IEEE 6th International Conference on Industrial Engineering and Applications (ICIEA), 26–29 April 2019, Tokyo, Japan (2019), pp. 583–587, https://doi.org/10.1109/IEA.2019.8715120

  15. H. Dhiman, S. Buttner, C. Rocker, R. Reisch, Handling work complexity with AR/deep learning, in Proceedings of the 31st Australian Conference on Human-Computer-Interaction (OZCHI’19), 2–5 December 2019, New York, USA (2020), pp. 518–522, https://doi.org/10.1145/3369457.3370919

  16. F. Lamberti, F. Manuri, A. Sanna, G. Paravati, P. Pezzolla, P. Montuschi, Challenges, opportunities, and future trends of emerging techniques for augmented reality-based maintenance. IEEE Trans. Emerg. Top. Comput. 2(4), 411–421 (2014). https://doi.org/10.1109/TETC.2014.2368833

    Article  Google Scholar 

  17. X.W. Chen, X. Jin, K. Wang, Lighting virtual objects in a single image via coarse scene understanding. Sci. China Inf. Sci. 57(9), 092105 (2014). https://doi.org/10.1007/s11432-013-4936-0

    Article  Google Scholar 

  18. J. Husár, L. Knapčíková, Implementation of augmented reality in smart engineering manufacturing: Literature review. Mobile Netw. Appl. (2023). https://doi.org/10.1007/s11036-023-02121-x

  19. E. Kucera, O. Haffner, R. Leskovský, Interactive and virtual/mixed reality applications for mechatronics education developed in unity engine, in 2018 Cybernetics & Informatics (K&I), Lazy pod Makytou, Slovakia (2018), pp. 1–5, https://doi.org/10.1109/CYBERI.2018.8337533

  20. V.T. Nguyen, T. Dang, Setting up virtual reality and augmented reality learning environment in unity, in 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), Nantes, France (2017), pp. 315–320, https://doi.org/10.1109/ISMAR-Adjunct.2017.97

  21. D.Q. Gbadago, J. Moon, S. Hwang, Mixed Reality-based chemical reactor visualization. IFAC-PapersOnLine 55(7), 580–585 (2022). https://doi.org/10.1016/j.ifacol.2022.07.506

    Article  Google Scholar 

  22. P. Maniam, P. Schnell, L. Dan, R. Portelli, C. Erolin, R. Mountain, T. Wilkinson, Exploration of temporal bone anatomy using mixed reality (HoloLens): Development of a mixed reality anatomy teaching resource prototype. J. Vis. Commun. Med. 43(1), 17–26 (2020). https://doi.org/10.1080/17453054.2019.1671813

    Article  Google Scholar 

  23. A. Maffei, M. Dalle Mura, F.M. Monetti, E. Boffa, Dynamic mixed reality assembly guidance using optical recognition methods. Appl. Sci. 13, 1760 (2023). https://doi.org/10.3390/app13031760

    Article  Google Scholar 

  24. B.A.D. Marques, E.W.G. Clua, C.N. Vasconcelos, Deep spherical harmonics light probe estimator for mixed reality games. Comput. Graph. 76, 96–106 (2018). https://doi.org/10.1016/j.cag.2018.09.003

    Article  Google Scholar 

  25. S. Hrehova, L. Knapcikova, The study of machine learning assisted the design of selected composites properties. Appl. Sci. 12, 10863 (2022). https://doi.org/10.3390/app122110863

    Article  Google Scholar 

  26. J. Mascenik, Implementation of the designed program for calculation and check of chain gears. MM Sci. J. 2019, 3431–3434 (2019). https://doi.org/10.17973/MMSJ.2019_12_2019008

    Article  Google Scholar 

  27. M. Wieczorowski, J. Trojanowska, O. Sokolov, Digital and information technologies in Metrology 4.0, in Advances in Design, Simulation and Manufacturing VI. DSMIE 2023, Lecture notes in mechanical engineering, ed. by V. Ivanov, J. Trojanowska, I. Pavlenko, E. Rauch, J. Piteľ, (Springer, Cham, 2023). https://doi.org/10.1007/978-3-031-32767-4_8

    Chapter  Google Scholar 

  28. P. Buń, J. Husár, J. Kaščak, Hand tracking in extended reality educational applications, in Advances in Manufacturing III. MANUFACTURING 2022, Lecture notes in mechanical engineering, ed. by J. Trojanowska, A. Kujawińska, J. Machado, I. Pavlenko, (Springer, Cham, 2022). https://doi.org/10.1007/978-3-030-99310-8_25

    Chapter  Google Scholar 

Download references

Acknowledgments

This work was supported by the projects VEGA 1/0268/22, KEGA 038TUKE-4/2022 granted by the Ministry of Education, Science, Research and Sport of the Slovak Republic.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jozef Husár .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Husár, J., Hrehová, S., Knapčíková, L., Trojanowska, J. (2024). Concept of Mixed Reality Application Design for Technical Solutions. In: Knapčíková, L., Peraković, D. (eds) 8th EAI International Conference on Management of Manufacturing Systems. MMS 2023. EAI/Springer Innovations in Communication and Computing. Springer, Cham. https://doi.org/10.1007/978-3-031-53161-3_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-53161-3_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-53160-6

  • Online ISBN: 978-3-031-53161-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics