Skip to main content

Cloud XR (Extended Reality: Virtual Reality, Augmented Reality, Mixed Reality) and 5G Mobile Communication System for Medical Image-Guided Holographic Surgery and Telemedicine

  • Chapter
  • First Online:
Multidisciplinary Computational Anatomy

Abstract

In the field of medical image processing, three-dimensional image analysis has been further advanced and extended reality (XR) technologies such as virtual reality (VR), augmented reality (AR), and mixed reality (MR) have been applied to support 3D and spatial diagnosis and surgery by wearing smart XR goggles. We developed a cloud-based XR application “Holoeyes MD” for analyzing the patient individual medical images in 3D by CT, MRI, and US. The shape data of these organs is exported to polygons, the 3D shapes are digitized into coordinates. The 3D structures such as the depth and size of the organs usually used to be incompletely understood on a flat monitor screen. The introduction of the cloud-based XR and 5G has made it possible to understand more intuitively the 3D positional relationship of various anatomy and doctor’s presence and existence in online telemedicine and remote space sharing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 119.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Sugimoto M. Augmented tangibility surgical navigation using spatial interactive 3-D Hologram zSpace with OsiriX and bio-texture 3-D organ modeling. IEEE 2015 International Conference on Computer Application Technologies (CCATS 2015). 2015. p. 189–194. https://doi.org/10.1109/CCATS.2015.53

  2. Iannessi A, Marcy PY, Clatz O, Bertrand AS, Sugimoto M. A review of existing and potential computer user interfaces for modern radiology. Insights Imaging. 2018;9:599–609. https://doi.org/10.1007/s13244-018-0620-7.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Saito Y, Sugimoto M, Imura S, Morine Y, Ikemoto T, Iwahashi S, et al. Intraoperative 3D Hologram support with mixed reality techniques in liver surgery. Ann Surg. 2020;271:e4–7. https://doi.org/10.1097/SLA.0000000000003552.

    Article  PubMed  Google Scholar 

  4. Sato Y, Sugimoto M, Tanaka Y, Suetsugu T, Imai T, Hatanaka Y, et al. Holographic image-guided thoracoscopic surgery: possibility of usefulness for esophageal cancer patients with abnormal artery. Esophagus. 2020; https://doi.org/10.1007/s10388-020-00737-6.

  5. Yoshida S, Sugimoto M, Fukuda S, Taniguchi N, Saito K, Fuji Y. Mixed reality computed tomography-based surgical planning for partial nephrectomy using a head-mounted holographic computer. Int J Urol. 2019;26:681–2. https://doi.org/10.1111/iju.13954.

    Article  PubMed  Google Scholar 

  6. Holoeyes Inc. Web site. http://holoeyes.jp/en. Accessed 22 Nov 2020.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maki Sugimoto .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Sugimoto, M. (2022). Cloud XR (Extended Reality: Virtual Reality, Augmented Reality, Mixed Reality) and 5G Mobile Communication System for Medical Image-Guided Holographic Surgery and Telemedicine. In: Hashizume, M. (eds) Multidisciplinary Computational Anatomy. Springer, Singapore. https://doi.org/10.1007/978-981-16-4325-5_52

Download citation

  • DOI: https://doi.org/10.1007/978-981-16-4325-5_52

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-16-4324-8

  • Online ISBN: 978-981-16-4325-5

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics