Abstract
In this study, we developed an augmented-reality (AR) navigation system that can assist surgeons during transsphenoidal surgery, including identification of the tumor site. Since transsphenoidal surgery is performed by looking at an endoscopic image, thus requiring situational judgment on the image, transsphenoidal surgery poses greater challenges with regard to grasping the positional relationships between the tumor and the organs compared with normal operations. The proposed system is expected to help surgeons understand the conditions surrounding the operating field, by intraoperatively displaying a real-time overlaid 3D model based on preoperative MRI images of the patient.
Markers were used to obtain the data necessary to view the overlaid images, which were attached to the operating table and to the end of the endoscope. The patient’s head was held in a fixed position during the surgery. The relative positions of the maker on the operating table and the feature point on the patient’s head were captured by a camera mounted on top of the operating table. Then, using this information, the positions of the tumor and the organs were estimated, and a 3D model was created using the patient’s MRI scans. Further, by obtaining the relative position of the markers attached to the end and tip of the endoscope, the position of the tip of the endoscope was estimated from the marker at the end even if it could not be seen from outside after inserting it into the patient’s body during surgery. The relative positions of the tip of the endoscope and the tumor site were calculated, and a 3D model was displayed using the MRI images in conjunction with the current endoscopic image. By constantly updating the positional information in accordance with the behavior of the endoscope, the overlaid image of the tumor and the organs could be viewed. In this study, we developed a prototype of the proposed system, and discussed the accuracy of its results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Qian, K., Bai, J., Yang, X., Pan, J., Zhang, J.: Virtual reality based laparoscopic surgery simulation. In: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology, pp. 69–78 (2015). http://doi.org/10.1145/2821592.2821599
Coles, T.R., Meglan, D., John, N.W.: The role of haptics in medical training simulators: a survey of the state of the art. IEEE Trans. Haptics 4(1), 51–66 (2011). https://doi.org/10.1109/TOH.2010.19
Shousen, W., Jun-Feng, L., Shang-Ming, Z., Jun-Jie, J., Liang, X.: A virtual reality model of the clivus and surgical simulation via transoral or transnasal route. Int. J. Clin. Exp. Med. 7, 3270–3279 (2014)
Li, L., et al.: A novel augmented reality navigation system for endoscopic sinus and skull base surgery: a feasibility study. PLoS One 11(1), e0146996 (2016). https://doi.org/10.1371/journal.pone.0146996
Onishi, K., Fumiyama, S., Miki, Y., Nonaka, M., Koeda, M., Noborio, H.: A study of camera tip position estimating methods in transnasal endoscopic surgery. In: Kurosu, M. (ed.) HCII 2019. LNCS, vol. 11567, pp. 534–543. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22643-5_42
Yano, D., et al.: Accuracy verification of knife tip positioning with position and orientation estimation of the actual liver for liver surgery support system. J. Bioinf. Neurosci. (JBINS) 3(3), 79–84 (2017)
Koeda, M., Yano, D., Doi, M., Onishi, K., Noborio, H.: Calibration of surgical knife-tip position with marker-based optical tracking camera and precise evaluation of its measurement accuracy. J. Bioinf. Neurosci. (JBINS) 4(1), 155–159 (2018)
Garrido-Jurado, S., Muñoz-Salinas, R., Madrid-Cuevas, F., Medina-Carnicer, R.: Generation of fiducial marker dictionaries using mixed integer linear programming. Pattern Recognit. 51, 481–491 (2015). https://doi.org/10.1016/j.patcog.2015.09.023
Romero Ramirez, F., Muñoz-Salinas, R., Medina-Carnicer, R.: Speeded up detection of squared fiducial markers. Image Vis. Comput. 76, 38–47 (2018). https://doi.org/10.1016/j.imavis.2018.05.004
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Onishi, K., Fumiyama, S., Miki, Y., Nonaka, M., Koeda, M., Noborio, H. (2020). Study on the Development of Augmented-Reality Navigation System for Transsphenoidal Surgery. In: Kurosu, M. (eds) Human-Computer Interaction. Human Values and Quality of Life. HCII 2020. Lecture Notes in Computer Science(), vol 12183. Springer, Cham. https://doi.org/10.1007/978-3-030-49065-2_43
Download citation
DOI: https://doi.org/10.1007/978-3-030-49065-2_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49064-5
Online ISBN: 978-3-030-49065-2
eBook Packages: Computer ScienceComputer Science (R0)