Skip to main content

Approaches of Safe and Efficient 3D UAM Traffic Management Using VR, AR, and MR with AI; HCI Requirements for Digital Twin Application

  • Conference paper
  • First Online:
Intelligent Autonomous Systems 18 (IAS 2023)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 794))

Included in the following conference series:

  • 47 Accesses

Abstract

This paper highlights the digital twin (DT) application that utilizes VR/AR/MR to develop high-level urban air mobility (UAM) operation monitoring systems. UAM operations may require precision 3D maps for planning, monitoring, and debriefing purposes. Recent VR and MR technologies have implemented vivid 3D graphics, and these are subject to the digital twin (DT) for the UAM monitoring system. Digital twin (DT) is a virtual content that visualizes synchronized features of an existing system of interest. DT has two paradigms—functional DT and physio-functional DT for its usage. This paper proceeds with a discussion of six human-DT interaction issues—the reality of 3D graphics, AI functions, DT users’ allocentric versus egocentric viewpoints, accuracy of spatial synchronization, and systems engineering process—for safe and efficient UAM operations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ma, X., Tao, F., Zhang, M., Wang, T., Zuo, Y.: Digital twin enhanced human-machine interaction in product lifecycle. Procedia Cirp. 83, 789–793 (2019)

    Article  Google Scholar 

  2. Welchman, A.E.: The human brain in depth: how we see in 3D. Ann. Rev. Vis. Sci. 2, 345–376 (2016)

    Article  Google Scholar 

  3. Hill, B. P., DeCarme, D., Metcalfe, M., Griffin, C., Wiggins, S., Metts, C., ... & Mendonca, N. L.: UAM vision concept of operations (conops) UAM maturity level (UML) 4 (2020)

    Google Scholar 

  4. Seon, D., & Jeong, S.: Terrain-driven wind environment generation for UAM. In: The Proceedings of the 2021 Asia-Pacific International Symposium on Aerospace Technology (APISAT 2021), vol. 2, pp. 531–541. Singapore, Springer Nature Singapore (2022)

    Google Scholar 

  5. Kim, B., & Kim, H.: 6G for UAM communications: challenges and visions. In: 2022 13th International Conference on Information and Communication Technology Convergence (ICTC), pp. 1526–1528. IEEE Press (2022)

    Google Scholar 

  6. Oh, C.G., Lee, K., Oh, M.: Integrating the first person view and the third person view using a connected VR-MR system for pilot training. J. Aviat. Aerospace Educ. Res. 30(1), 21–40 (2021)

    Google Scholar 

  7. Jo, K., Sunwoo, M.: Generation of a precise roadway map for autonomous cars. IEEE Trans. Intell. Transp. Syst. 15(3), 925–937 (2013)

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF), funded by the Ministry of Education (202201450002). This research was also supported by “Regional Innovation Strategy (RIS)” through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (MOE) (2021RIS-004). This research was also supported by the 2020 High-Potential Individual Global Training Program supported by the South Korean Ministry of Science, ICT (2020001510). The authors are grateful to Ms. Heeju Kim, the content sales analyst of Nurimedia Inc., for developing the MR-based DT prototype software.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chang-Geun Oh .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Oh, CG., Lee, M. (2024). Approaches of Safe and Efficient 3D UAM Traffic Management Using VR, AR, and MR with AI; HCI Requirements for Digital Twin Application. In: Lee, SG., An, J., Chong, N.Y., Strand, M., Kim, J.H. (eds) Intelligent Autonomous Systems 18. IAS 2023. Lecture Notes in Networks and Systems, vol 794. Springer, Cham. https://doi.org/10.1007/978-3-031-44981-9_14

Download citation

Publish with us

Policies and ethics