Skip to main content

Advertisement

SpringerLink
Log in

3D color multimodality fusion imaging as an augmented reality educational and surgical planning tool for extracerebral tumors

  • Research
  • Published:
Neurosurgical Review Aims and scope Submit manuscript

Abstract

Extracerebral tumors often occur on the surface of the brain or at the skull base. It is important to identify the peritumoral sulci, gyri, and nerve fibers. Preoperative visualization of three-dimensional (3D) multimodal fusion imaging (MFI) is crucial for surgery. However, the traditional 3D-MFI brain models are homochromatic and do not allow easy identification of anatomical functional areas. In this study, 33 patients with extracerebral tumors without peritumoral edema were retrospectively recruited. They underwent 3D T1-weighted MRI, diffusion tensor imaging (DTI), and CT angiography (CTA) sequence scans. 3DSlicer, Freesurfer, and BrainSuite were used to explore 3D-color-MFI and preoperative planning. To determine the effectiveness of 3D-color-MFI as an augmented reality (AR) teaching tool for neurosurgeons and as a patient education and communication tool, questionnaires were administered to 15 neurosurgery residents and all patients, respectively. For neurosurgical residents, 3D-color-MFI provided a better understanding of surgical anatomy and more efficient techniques for removing extracerebral tumors than traditional 3D-MFI (P < 0.001). For patients, the use of 3D-color MFI can significantly improve their understanding of the surgical approach and risks (P < 0.005). 3D-color-MFI is a promising AR tool for extracerebral tumors and is more useful for learning surgical anatomy, developing surgical strategies, and improving communication with patients.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Data availability

The data that support the findings of this study are available from the first and corresponding author upon reasonable request.

References

  1. Chawla S, Devi S, Calvachi P, Gormley WB, Rueda-Esteban R (2022) Evaluation of simulation models in neurosurgical training according to face, content, and construct validity: a systematic review. Acta Neurochir (Wien) 164:947–966. https://doi.org/10.1007/s00701-021-05003-x

    Article  PubMed  Google Scholar 

  2. Splavski B, Hadzic E, Bagic I, Vrtaric V, Splavski B Jr (2017) Simple tumor localization scale for estimating management outcome of intracranial meningioma. World Neurosurg 104:876–882. https://doi.org/10.1016/j.wneu.2017.05.039

    Article  PubMed  Google Scholar 

  3. Nandish S, Prabhu G, Rajagopal KV (2017) Multiresolution image registration for multimodal brain images and fusion for better neurosurgical planning. Biomed J 40:329–338. https://doi.org/10.1016/j.bj.2017.09.002

    Article  PubMed  PubMed Central  Google Scholar 

  4. Hou X, Yang D, Li D, Liu M, Zhou Y, Shi M (2020) A new simple brain segmentation method for extracerebral intracranial tumors. Plos One 15:e0230754. https://doi.org/10.1371/journal.pone.0230754

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  5. Jacquesson T, Frindel C, Kocevar G, Berhouma M, Jouanneau E, Attyé A, Cotton F (2019) Overcoming challenges of cranial nerve tractography: a targeted review. Neurosurgery 84:313–325. https://doi.org/10.1093/neuros/nyy229

    Article  PubMed  Google Scholar 

  6. Yoshino M, Abhinav K, Yeh FC, Panesar S, Fernandes D, Pathak S, Gardner PA, Fernandez-Miranda JC (2016) Visualization of cranial nerves using high-definition fiber tractography. Neurosurgery 79:146–165. https://doi.org/10.1227/NEU.0000000000001241

    Article  PubMed  Google Scholar 

  7. Nicolosi F, Spena G (2020) Three-dimensional virtual intraoperative reconstruction: a novel method to explore a virtual neurosurgical field. World Neurosurg 137:e189–e193. https://doi.org/10.1016/j.wneu.2020.01.112

    Article  PubMed  Google Scholar 

  8. Shao X, Qiang D, Yuan Q (2023) A new neuroanatomical two-dimensional fitting three-dimensional imaging techniques in neuroanatomy education. BMC Med Educ 23:333. https://doi.org/10.1186/s12909-023-04323-z

    Article  PubMed  PubMed Central  Google Scholar 

  9. Sato M, Tateishi K, Murata H, Kin T, Suenaga J, Takase H, Yoneyama T, Nishii T, Tateishi U, Yamamoto T, Saito N, Inoue T, Kawahara N (2018) Three-dimensional multimodality fusion imaging as an educational and planning tool for deep-seated meningiomas. Br J Neurosurg 32:509–515. https://doi.org/10.1080/02688697.2018.1485877

    Article  PubMed  Google Scholar 

  10. Barteit S, Lanfermann L, Bärnighausen T, Neuhann F, Beiersmann C (2021) Augmented, mixed, and virtual reality-based head-mounted devices for medical education: systematic review. JMIR Serious Games 9:e29080. https://doi.org/10.2196/29080

    Article  PubMed  PubMed Central  Google Scholar 

  11. Durrani S, Onyedimma C, Jarrah R, Bhatti A, Nathani KR, Bhandarkar AR, Mualem W, Ghaith AK, Zamanian C, Michalopoulos GD, Alexander AY, Jean W, Bydon M (2022) The virtual vision of neurosurgery: how augmented reality and virtual reality are transforming the neurosurgical operating room. World Neurosurg 168:190–201. https://doi.org/10.1016/j.wneu.2022.10.002

    Article  PubMed  Google Scholar 

  12. Ogando-Rivas E, Castillo P, Beltran JQ, Arellano R, Galvan-Remigio I, Soto-Ulloa V, Diaz-Peregrino R, Ochoa-Hernandez D, Reyes-González P, Sayour E, Mitchell D (2022) Evolution and revolution of imaging technologies in neurosurgery. Neurol Med Chir (Tokyo) 62:542–551. https://doi.org/10.2176/jns-nmc.2022-0116

    Article  PubMed  Google Scholar 

  13. Shao X, Yuan Q, Qian D, Ye Z, Chen G, le Zhuang K, Jiang X, Jin Y, Qiang D (2020) Virtual reality technology for teaching neurosurgery of skull base tumor. BMC Med Educ 20:3. https://doi.org/10.1186/s12909-019-1911-5

    Article  PubMed  PubMed Central  Google Scholar 

  14. Oishi M, Fukuda M, Ishida G, Saito A, Hiraishi T, Fujii Y (2011) Prediction of the microsurgical window for skull-base tumors by advanced three-dimensional multi-fusion volumetric imaging. Neurol Med Chir (Tokyo) 51:201–207. https://doi.org/10.2176/nmc.51.201

    Article  PubMed  Google Scholar 

  15. Hanalioglu S, Romo NG, Mignucci-Jiménez G, Tunc O, Gurses ME, Abramov I, Xu Y, Sahin B, Isikay I, Tatar I, Berker M, Lawton MT, Preul MC (2022) Development and validation of a novel methodological pipeline to integrate neuroimaging and photogrammetry for immersive 3D cadaveric neurosurgical simulation. Front Surg 9:878378. https://doi.org/10.3389/fsurg.2022.878378

    Article  PubMed  PubMed Central  Google Scholar 

  16. Chen JG, Han KW, Zhang DF, Li ZX, Li YM, Hou LJ (2017) Presurgical planning for supratentorial lesions with free slicer software and Sina app. World Neurosurg 106:193–197. https://doi.org/10.1016/j.wneu.2017.06.146

    Article  PubMed  Google Scholar 

  17. He H, Chen C, Li W, Luo L, Ling C, Wang H, Chen Z, Guo Y (2019) Contralateral approach based on a preoperative 3-dimensional virtual osteotomy technique for anterior circulation aneurysms. J Stroke Cerebrovasc Dis 28:1099–1106. https://doi.org/10.1016/j.jstrokecerebrovasdis.2018.12.040

    Article  PubMed  Google Scholar 

  18. Zhou L, Wang W, Wei H, Song P, Li Z, Cheng L, Lei P, Chen Q, Liu Z, Ye H, Cai Q (2022) Clinical application of 3D Slicer combined with Sina/MosoCam multimodal system in preoperative planning of brain lesions surgery. Sci Rep 12:19258. https://doi.org/10.1038/s41598-022-22549-7

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  19. Elliott CA, Danyluk H, Aronyk KE, Au K, Wheatley BM, Gross DW, Sankar T, Beaulieu C (2019) Intraoperative acquisition of DTI in cranial neurosurgery: readout-segmented DTI versus standard single-shot DTI. J Neurosurg 1–10. https://doi.org/10.3171/2019.5.JNS19890

  20. Techavipoo U, Okai AF, Lackey J, Shi J, Dresner MA, Leist TP, Lai S (2009) Toward a practical protocol for human optic nerve DTI with EPI geometric distortion correction. J Magn Reson Imaging 30:699–707. https://doi.org/10.1002/jmri.21836

    Article  PubMed  Google Scholar 

  21. Bhushan C, Haldar JP, Choi S, Joshi AA, Shattuck DW, Leahy RM (2015) Co-registration and distortion correction of diffusion and anatomical images based on inverse contrast normalization. Neuroimage 115:269–280. https://doi.org/10.1016/j.neuroimage.2015.03.050

    Article  PubMed  Google Scholar 

  22. Liao R, Ning L, Chen Z, Rigolo L, Gong S, Pasternak O, Golby AJ, Rathi Y, O’Donnell LJ (2017) Performance of unscented Kalman filter tractography in edema: analysis of the two-tensor model. Neuroimage Clin 15:819–831. https://doi.org/10.1016/j.nicl.2017.06.027

    Article  PubMed  PubMed Central  Google Scholar 

  23. Yamura M, Hirai T, Korogi Y, Ikushima I, Yamashita Y, Oishi S (2005) Pseudostenosis in vessels adjacent to intracranial aneurysms on volume-rendered 3D angiograms: a phantom study. Acad Radiol 12:305–308. https://doi.org/10.1016/j.acra.2004.12.003

    Article  PubMed  Google Scholar 

  24. Zawy Alsofy S, Nakamura M, Suleiman A, Sakellaropoulou I, Welzel Saravia H, Shalamberidze D, Salma A, Stroop R (2021) Cerebral anatomy detection and surgical planning in patients with anterior skull base meningiomas using a virtual reality technique. J Clin Med 10:681. https://doi.org/10.3390/jcm10040681

    Article  PubMed  PubMed Central  Google Scholar 

  25. Caton MT Jr, Wiggins WF, Nunez D (2020) Three-dimensional cinematic rendering to optimize visualization of cerebrovascular anatomy and disease in CT angiography. J Neuroimaging 30:286–296. https://doi.org/10.1111/jon.12697

    Article  PubMed  Google Scholar 

  26. Salvati LF, De Marco R, Palmieri G, Minardi M, Massara A, Pesaresi A, Cagetti B, Melcarne A, Garbossa D (2021) The relevant role of navigated tractography in speech eloquent area glioma surgery: single center experience. Brain Sci 11:1436. https://doi.org/10.3390/brainsci11111436

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Neurosurgery, Sichuan Provincial People’s Hospital, University of Electronic Science and Technology of China, Chengdu, 61173, China

    Xiaolin Hou, Ruxiang Xu, Longyi Chen & Dingjun Li

  2. The Department of Neurology, Hospital of Chengdu University of Traditional Chinese Medicine, Chengdu, Sichuan, China

    Dongdong Yang

Authors
  1. Xiaolin Hou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ruxiang Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Longyi Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dongdong Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Dingjun Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Xiaolin Hou: conceptualization, methodology, and writing—original draft. Ruxiang Xu and Longyi Chen: project administration and supervision; writing, review and editing; visualization. Dongdong Yang and Dingjun Li: investigation. All authors contributed to the article and approved the submitted version.

Corresponding authors

Correspondence to Ruxiang Xu or Longyi Chen.

Ethics declarations

Competing interests

The authors declare no competing interests.

Ethics approval

The study was conducted in accordance with the Declaration 105 of Helsinki and approved by the Ethics Committee of the Sichuan Provincial People’s Hospital.

Informed consent

Informed consent was obtained from all subjects involved in the study.

Conflict of interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hou, X., Xu, R., Chen, L. et al. 3D color multimodality fusion imaging as an augmented reality educational and surgical planning tool for extracerebral tumors. Neurosurg Rev 46, 280 (2023). https://doi.org/10.1007/s10143-023-02184-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10143-023-02184-0

Keywords

Search

Navigation