Abstract
In brain tumor resection, accurate removal of cancerous tissues while preserving eloquent regions is crucial to the safety and outcomes of the treatment. However, intra-operative tissue deformation (called brain shift) can move the surgical target and render the pre-surgical plan invalid. Intra-operative ultrasound (iUS) has been adopted to provide real-time images to track brain shift, and inter-modal (i.e., MRI-iUS) registration is often required to update the pre-surgical plan. Quality control for the registration results during surgery is important to avoid adverse outcomes, but manual verification faces great challenges due to difficult 3D visualization and the low contrast of iUS. Automatic algorithms are urgently needed to address this issue, but the problem was rarely attempted. Therefore, we propose a novel deep learning technique based on 3D focal modulation in conjunction with uncertainty estimation to accurately assess MRI-iUS registration errors for brain tumor surgery. Developed and validated with the public RESECT clinical database, the resulting algorithm can achieve an estimation error of 0.59 ± 0.57 mm.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Rivaz, H., Collins, D.L.: Near real-time robust non-rigid registration of volumetric ultrasound images for neurosurgery. Ultrasound Med. Biol. 41(2), 574–587 (2015)
Xiao, Y., et al.: Evaluation of MRI to ultrasound registration methods for brain shift correction: the CuRIOUS2018 challenge. IEEE Trans. Med. Imaging 39(3), 777–786 (2019)
Marko, N.F., Weil, R.J., Schroeder, J.L., Lang, F.F., Suki, D., Sawaya, R.E.: Extent of resection of glioblastoma revisited: personalized survival modeling facilitates more accurate survival prediction and supports a maximum-safe-resection approach to surgery. J. Clin. Oncol. 32(8), 774 (2014)
Bierbrier, J., Gueziri, H.-E., Collins, D.L.: Estimating medical image registration error and confidence: a taxonomy and scoping review. Med. Image Anal. 102531 (2022)
Shams, R., Xiao, Y., Hébert, F., Abramowitz, M., Brooks, R., Rivaz, H.: Assessment of rigid registration quality measures in ultrasound-guided radiotherapy. IEEE Trans. Med. Imaging 37(2), 428–437 (2017)
Saygili, G.: Local-search based prediction of medical image registration error. In: Medical Imaging,: Image Perception, Observer Performance, and Technology Assessment, vol. 10577, pp. 327–332. SPIE 2018 (2018)
Sokooti, H., Saygili, G., Glocker, B., Lelieveldt, B.P., Staring, M.: Quantitative error prediction of medical image registration using regression forests. Med. Image Anal. 56, 110–121 (2019)
Sokooti, H., Saygili, G., Glocker, B., Lelieveldt, B.P.F., Staring, M.: Accuracy estimation for medical image registration using regression forests. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9902, pp. 107–115. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46726-9_13
Eppenhof, K.A., Pluim, J.P.: Error estimation of deformable image registration of pulmonary CT scans using convolutional neural networks. J. Med. Imaging 5(2), 024 003–024 003 (2018)
Sokooti, H., Yousefi, S., Elmahdy, M.S., Lelieveldt, B.P., Staring, M.: Hierarchical prediction of registration misalignment using a convolutional LSTM: application to chest CT scans. IEEE Access 9, 62 008–62 020 (2021)
Fonov, V.S., Dadar, M., Adni, T.P.-A.R.G., Collins, D.L.: DARQ: deep learning of quality control for stereotaxic registration of human brain MRI to the T1w MNI-ICBM 152 template. Neuroimage 257, 119266 (2022)
Bierbrier, J., Eskandari, M., Di Giovanni, D.A., Collins, D.L.: Towards estimating MRI-Ultrasound registration error in image-guided neurosurgery. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control (2023)
Yang, J., Li, C., Dai, X., Gao, J.: Focal modulation networks. Adv. Neural Inf. Process. Syst. 35, 4203–4217. Curran Associates Inc. (2022)
Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems (NeurIPS), vol. 30 (2017)
Gal, Y., Ghahramani, Z.: Dropout as a Bayesian approximation: representing model uncertainty in deep learning. In: International Conference on Machine Learning, pp. 1050–1059. PMLR (2016)
Xiao, Y., Fortin, M., Unsgård, G., Rivaz, H., Reinertsen, I.: Retrospective evaluation of cerebral tumors (RESECT): a clinical database of pre-operative MRI and intra-operative ultrasound in low-grade glioma surgeries. Med. Phys. 44(7), 3875–3882 (2017)
Lotfi, T., Tang, L., Andrews, S., Hamarneh, G.: Improving probabilistic image registration via reinforcement learning and uncertainty evaluation. In: Wu, G., Zhang, D., Shen, D., Yan, P., Suzuki, K., Wang, F. (eds.) MLMI 2013. LNCS, vol. 8184, pp. 187–194. Springer, Cham (2013). https://doi.org/10.1007/978-3-319-02267-3_24
Abdar, M., et al.: A review of uncertainty quantification in deep learning: techniques, applications and challenges. Inf. Fusion 76, 243–297 (2021)
Acknowledgment
We acknowledge the support of the Natural Sciences and Engineering Research Council of Canada (NSERC) and Fonds de Recherche du Québec Nature et Technologies (FRQNT).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Salari, S., Rasoulian, A., Rivaz, H., Xiao, Y. (2023). FocalErrorNet: Uncertainty-Aware Focal Modulation Network for Inter-modal Registration Error Estimation in Ultrasound-Guided Neurosurgery. In: Greenspan, H., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2023. MICCAI 2023. Lecture Notes in Computer Science, vol 14228. Springer, Cham. https://doi.org/10.1007/978-3-031-43996-4_66
Download citation
DOI: https://doi.org/10.1007/978-3-031-43996-4_66
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-43995-7
Online ISBN: 978-3-031-43996-4
eBook Packages: Computer ScienceComputer Science (R0)
