Surgical navigation has become essential for surgeons to accurately and safely perform precision surgery. The 3D organ modeling based on individual patient’s medical image data is indispensable for simulation, navigation, and education for accurate and safe surgery. Thus, radiomics is a crucial role in systematically scientizing the enormous amount of radiological image information.
The polygon data in the shape of organs has already been put into practical use for surgical simulation and navigation using extended reality (XR), including virtual reality (VR), augmented reality (AR), mixed reality (MR), or 3D-printing technology. Machine learning with artificial intelligence may improve the accuracy of organ extraction.
We have developed an application that digitally analyzes CT and MRI data of individual patients, automatically extracts feature points of the organ shape with artificial intelligence (AI), converts them into polygons, and views these organ shape coordinates as XR. We also developed a 3D-printing surgical simulation and navigation system using anatomically accurate bio-elastic wet hemorrhagic organ replica by the resins, polyvinyl alcohol (PVA), and water based on MDCT data.
These could further develop “personalized medicine” into “precision medicine,” which selects individual analysis and establishes the optimal treatment for each specific population. Our patient-specific XR surgical navigation is highly effective and reduce surgical time, blood loss, and adverse event. This system must have value for future surgeons.
- Virtual reality (VR)
- Augmented reality (AR)
- Mixed reality (MR)
- Image-guided navigation surgery
- Surgical simulation
This is a preview of subscription content, access via your institution.
Tax calculation will be finalised at checkout
Purchases are for personal use onlyLearn about institutional subscriptions
Holoeyes Inc. http://holoeyes.jp/en. Accessed 27 Jan 2020.
Sugimoto M. Augmented tangibility surgical navigation using spatial interactive 3-D Hologram zSpace with OsiriX and Bio-Texture 3-D Organ Modeling In: IEEE 2015 international conference on computer application technologies (CCATS 2015); 2015. p. 189–194.
Saito Y, Sugimoto M, Imura S, Morine Y, Ikemoto T, Iwahashi S, Yamada S, Shimada M. Intraoperative 3D hologram support with mixed reality techniques in liver surgery. Ann Surg. 2020;271(1):e4–7.
Yamada T, Osako M, Uchimuro T, Yoon R, Morikawa T, Sugimoto M, Suda H, Shimizu H. Three-dimensional printing of life-like models for simulation and training of minimally invasive cardiac surgery. Innovations. 2017;12(6):459–65.
Soejima Y, Taguchi T, Sugimoto M, Hayashida M, Yoshizumi T, Ikegami T, Uchiyama H, Shirabe K, Maehara Y. Three-dimensional printing and biotexture modeling for preoperative simulation in living donor liver transplantation for small infants. Liver Transpl. 2016;22(11):1610–4.
Komai Y, Sugimoto M, Gotohda N, Matsubara N, Kobayashi T, Sakai Y, Shiga Y, Saito N. Patient-specific 3D printed kidney designed for “4D” surgical navigation-a novel aid to facilitate minimally invasive off-clamp partial nephrectomy in complex tumor cases. Urology. 2016;91:226–33.
Kusaka M, Sugimoto M, Fukami N, Sasaki H, Takenaka M, Anraku T, Ito T, Kenmochi T, Shiroki R, Hoshinaga K. Initial experience with a tailor-made simulation and navigation program using a 3-D printer model of kidney transplantation surgery. Transplant Proc. 2015;47(3):596–9.
This work was supported by JSPS KAKENHI Grant Numbers JP 19152948, JP 19167615.
Editors and Affiliations
© 2021 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Sugimoto, M. (2021). Extended Reality (XR:VR/AR/MR), 3D Printing, Holography, A.I., Radiomics, and Online VR Tele-Medicine for Precision Surgery. In: Takenoshita, S., Yasuhara, H. (eds) Surgery and Operating Room Innovation. Springer, Singapore. https://doi.org/10.1007/978-981-15-8979-9_7
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-8978-2
Online ISBN: 978-981-15-8979-9