Abstract
Patient-specific Biomechanical Models (PBMs) can enhance computer assisted surgical procedures with critical information. Although pre-operative data allow to parametrize such PBMs based on each patient’s properties, they are not able to fully characterize them. In particular, simulation boundary conditions cannot be determined from pre-operative modalities, but their correct definition is essential to improve the PBM predictive capability. In this work, we introduce a pipeline that provides an up-to-date estimate of boundary conditions, starting from the pre-operative model of patient anatomy and the displacement undergone by points visible from an intra-operative vision sensor. The presented pipeline is experimentally validated in realistic conditions on an ex vivo pararenal fat tissue manipulation. We demonstrate its capability to update a PBM reaching clinically acceptable performances, both in terms of accuracy and intra-operative time constraints.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Project available at https://gitlab.com/altairLab/banet.
References
Alkhouli, N., et al.: The mechanical properties of human adipose tissues and their relationships to the structure and composition of the extracellular matrix. Am. J. Physiol. Endocrinol. Metab. 305(12), E1427–E1435 (2013)
Allan, M., et al.: Stereo correspondence and reconstruction of endoscopic data challenge. arXiv preprint arXiv:2101.01133 (2021)
Benligiray, B., Topal, C., Akinlar, C.: Stag: a stable fiducial marker system. Image Vis. Comput. 89, 158–169 (2019)
Brunet, J.-N., Mendizabal, A., Petit, A., Golse, N., Vibert, E., Cotin, S.: Physics-based deep neural network for augmented reality during liver surgery. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11768, pp. 137–145. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32254-0_16
Choi, H., et al.: On the use of simulation in robotics: opportunities, challenges, and suggestions for moving forward. Proc. Natl. Acad. Sci. 118(1) (2021)
Faure, F., et al.: Sofa: a multi-model framework for interactive physical simulation. In: Payan, Y. (ed.) Soft Tissue Biomechanical Modeling for Computer Assisted Surgery, pp. 283–321. Springer, Heidelberg (2012). https://doi.org/10.1007/8415_2012_125
Galbusera, F., Cina, A., Panico, M., Albano, D., Messina, C.: Image-based biomechanical models of the musculoskeletal system. Eur. Radiol. Exp. 4(1), 1–13 (2020)
Haouchine, N., Kuang, W., Cotin, S., Yip, M.: Vision-based force feedback estimation for robot-assisted surgery using instrument-constrained biomechanical three-dimensional maps. IEEE Robot. Autom. Lett. 3(3), 2160–2165 (2018). https://doi.org/10.1109/LRA.2018.2810948
Melzi, S., Ren, J., Rodolà, E., Sharma, A., Wonka, P., Ovsjanikov, M.: Zoomout: spectral upsampling for efficient shape correspondence. ACM Trans. Graph. (TOG) 38(6), 155 (2019)
Mendizabal, A., Tagliabue, E., Brunet, J.-N., Dall’Alba, D., Fiorini, P., Cotin, S.: Physics-based deep neural network for real-time lesion tracking in ultrasound-guided breast biopsy. In: Miller, K., Wittek, A., Joldes, G., Nash, M.P., Nielsen, P.M.F. (eds.) MICCAI 2018-2019, pp. 33–45. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-42428-2_4
Mendizabal, A., Tagliabue, E., Hoellinger, T., Brunet, J.-N., Nikolaev, S., Cotin, S.: Data-driven simulation for augmented surgery. In: Developments and Novel Approaches in Biomechanics and Metamaterials. ASM, vol. 132, pp. 71–96. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50464-9_5
Miller, K., Lu, J.: On the prospect of patient-specific biomechanics without patient-specific properties of tissues. J. Mech. Behav. Biomed. Mater. 27, 154–166 (2013)
Nikolaev, S., Cotin, S.: Estimation of boundary conditions for patient-specific liver simulation during augmented surgery. Int. J. Comput. Assist. Radiol. Surg. 15, 1107–1115 (2020)
Peterlik, I., Courtecuisse, H., Duriez, C., Cotin, S.: Model-based identification of anatomical boundary conditions in living tissues. In: Stoyanov, D., Collins, D.L., Sakuma, I., Abolmaesumi, P., Jannin, P. (eds.) IPCAI 2014. LNCS, vol. 8498, pp. 196–205. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07521-1_21
Peterlik, I., Haouchine, N., Ručka, L., Cotin, S.: Image-driven stochastic identification of boundary conditions for predictive simulation. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10434, pp. 548–556. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66185-8_62
Peterlik, I., Haouchine, N., Ručka, L., Cotin, S.: Image-driven stochastic identification of boundary conditions for predictive simulation. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10434, pp. 548–556. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66185-8_62
Pfeiffer, M., Riediger, C., Weitz, J., Speidel, S.: Learning soft tissue behavior of organs for surgical navigation with convolutional neural networks. Int. J. Comput. Assist. Radiol. Surg. 14(7), 1147–1155 (2019)
Plantefève, R., Peterlik, I., Haouchine, N., Cotin, S.: Patient-specific biomechanical modeling for guidance during minimally-invasive hepatic surgery. Ann. Biomed. Eng. 44(1), 139–153 (2016)
Saeed, S.U., Taylor, Z.A., Pinnock, M.A., Emberton, M., Barratt, D.C., Hu, Y.: Prostate motion modelling using biomechanically-trained deep neural networks on unstructured nodes. In: Martel, A.L., et al. (eds.) MICCAI 2020. LNCS, vol. 12264, pp. 650–659. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-59719-1_63
Schenk, O., Gärtner, K.: Solving unsymmetric sparse systems of linear equations with Pardiso. Futur. Gener. Comput. Syst. 20(3), 475–487 (2004)
Sharp, N., Crane, K.: A laplacian for nonmanifold triangle meshes. In: Computer Graphics Forum, vol. 39, pp. 69–80. Wiley Online Library (2020)
Tagliabue, E., et al.: Data-driven intra-operative estimation of anatomical attachments for autonomous tissue dissection. IEEE Robot. Autom. Lett. 6(2), 1856–1863 (2021)
Taha, A.A., Hanbury, A.: Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool. BMC Med. Imaging 15(1), 29 (2015)
Taylor, Z.A., Cheng, M., Ourselin, S.: High-speed nonlinear finite element analysis for surgical simulation using graphics processing units. IEEE Trans. Med. Imaging 27(5), 650–663 (2008)
Williams, F., Schneider, T., Silva, C., Zorin, D., Bruna, J., Panozzo, D.: Deep geometric prior for surface reconstruction. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2019
Acknowledgements
Authors would like to thank the preclinical research staff at IHU Strasbourg for their assistance and support during the experiments. This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 742671 “ARS”), from French state funds managed within the “Plan Investissements d’Avenir” and from the ANR (reference ANR-10-IAHU-02).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Tagliabue, E. et al. (2021). Intra-operative Update of Boundary Conditions for Patient-Specific Surgical Simulation. In: de Bruijne, M., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2021. MICCAI 2021. Lecture Notes in Computer Science(), vol 12904. Springer, Cham. https://doi.org/10.1007/978-3-030-87202-1_36
Download citation
DOI: https://doi.org/10.1007/978-3-030-87202-1_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-87201-4
Online ISBN: 978-3-030-87202-1
eBook Packages: Computer ScienceComputer Science (R0)
