Abstract
The objective of this study is to establish a model for predicting the outcome of endovascular aneurysm repair for abdominal aortic aneurysms using deep learning algorithms. We performed a case series analysis of 493 patients with infra-renal abdominal aortic aneurysm who underwent elective endovascular aneurysm repair procedures between January 2016 and December 2019 in our single center. ITK-SNAP software was used to draw the abdominal aortic aneurysms region of interest. Images were preprocessed and deep learning model was built using MATrix LABoratory. Randomly divided, 80% of the patients were used as the training set, and 20% of the patients were enrolled in the test set. The area under the curve from receiver-operating characteristic curve was used to evaluate the predictive effect of the model. To further understand the prediction process of the deep learning model, visualization techniques were used to analyze the features learned by the model and the response of the convolutional layer to the different outcomes of endovascular aneurysm repair. The mean follow-up was 32.0 months, including 156 patients (31.6%) experiencing endovascular aneurysm repair-related severe adverse events. Number of patients in the training set was 394 (of which 269 had no severe adverse events and 125 had severe adverse events) and the number of patients in test set was 99 (of which 68 had no severe adverse events and 31 had severe adverse events). By training on 92,012–93,925 computed tomography angiography images (n = 315) and validation on 22,269–24,182 computed tomography angiography images (n = 79), the deep learning model finally achieved encouraging predictive performance in the test set (n = 99) with an area under the curve of 0.81 SD0.01, accuracy 0.82 SD0.02, and F1 score 0.87 SD0.02. The visualization techniques improved the model interpretability. The deep learning model could be an efficient adjunctive tool to predict outcomes after endovascular aneurysm repair.
Similar content being viewed by others
References
Greenhalgh RM, Brown LC, Kwong GP, Powell JT, Thompson SG (2004) Comparison of endovascular aneurysm repair with open repair in patients with abdominal aortic aneurysm (EVAR trial 1), 30-day operative mortality results: randomised controlled trial. Lancet 364(9437):843–848. https://doi.org/10.1016/S0140-6736(04)16979-1
Patel R, Sweeting MJ, Powell JT, Greenhalgh RM (2016) Endovascular versus open repair of abdominal aortic aneurysm in 15-years’ follow-up of the UK endovascular aneurysm repair trial 1 (EVAR trial 1): a randomised controlled trial. Lancet 388(10058):2366–2374. https://doi.org/10.1016/S0140-6736(16)31135-7
De Bruin JL, Baas AF, Buth J, Prinssen M, Verhoeven EL, Cuypers PW, van Sambeek MR, Balm R, Grobbee DE, Blankensteijn JD (2010) Long-term outcome of open or endovascular repair of abdominal aortic aneurysm. N Engl J Med 362(20):1881–1889. https://doi.org/10.1056/NEJMoa0909499
Lederle FA, Kyriakides TC, Stroupe KT, Freischlag JA, Padberg FT Jr, Matsumura JS, Huo Z, Johnson GR (2019) Open versus endovascular repair of abdominal aortic aneurysm. N Engl J Med 380(22):2126–2135. https://doi.org/10.1056/NEJMoa1715955
Chaikof EL, Dalman RL, Eskandari MK, Jackson BM, Lee WA, Mansour MA, Mastracci TM, Mell M, Murad MH, Nguyen LL et al (2018) The Society for Vascular Surgery practice guidelines on the care of patients with an abdominal aortic aneurysm. J Vasc Surg 67(1):2-77.e2. https://doi.org/10.1016/j.jvs.2017.10.044
Wanhainen A, Verzini F, Van Herzeele I, Allaire E, Bown M, Cohnert T, Dick F, van Herwaarden J, Karkos C, Koelemay M et al (2019) Editor’s choice - European Society for Vascular Surgery (ESVS) 2019 clinical practice guidelines on the management of abdominal aorto-iliac artery aneurysms. Eur J Vasc Endovasc Surg 57(1):8–93. https://doi.org/10.1016/j.ejvs.2018.09.020
Nana P, Kouvelos G, Brotis A, Spanos K, Giannoukas A, Matsagkas M (2019) The effect of endovascular aneurysm repair on renal function in patients treated for abdominal aortic aneurysm. Curr Pharm Des 25(44):4675–4685. https://doi.org/10.2174/1381612825666191129094923
Harbron RW, Abdelhalim M, Ainsbury EA, Eakins JS, Alam A, Lee C, Modarai B (2020) Patient radiation dose from X-ray guided endovascular aneurysm repair: a Monte Carlo approach using voxel phantoms and detailed exposure information. J Radiol Prot 40(3):704–726. https://doi.org/10.1088/1361-6498/ab944e
Nargesi S, Abutorabi A, Alipour V, Tajdini M, Salimi J (2021) Cost-effectiveness of endovascular versus open repair of abdominal aortic aneurysm: a systematic review. Cardiovasc Drugs Ther 35(4):829–839. https://doi.org/10.1007/s10557-020-07130-6
Steuer J, Lachat M, Veith FJ, Wanhainen A (2016) Endovascular grafts for abdominal aortic aneurysm. Eur Heart J 37(2):145–151. https://doi.org/10.1093/eurheartj/ehv593
Silver D, Schrittwieser J, Simonyan K, Antonoglou I, Huang A, Guez A, Hubert T, Baker L, Lai M, Bolton A et al (2017) Mastering the game of Go without human knowledge. Nature 550(7676):354–359. https://doi.org/10.1038/nature24270
LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444. https://doi.org/10.1038/nature14539
Testolin A, Stoianov I, Grazia DFD, M, Zorzi M, (2013) Deep unsupervised learning on a desktop PC: a primer for cognitive scientists. Front Psychol 4:251. https://doi.org/10.3389/fpsyg.2013.00251
Tran KA, Kondrashova O, Bradley A, Williams ED, Pearson JV, Waddell N (2021) Deep learning in cancer diagnosis, prognosis and treatment selection. Genome Med 13(1):152. https://doi.org/10.1186/s13073-021-00968-x
Gao R, Zhao S, Aishanjiang K, Cai H, Wei T, Zhang Y, Liu Z, Zhou J, Han B, Wang J et al (2021) Deep learning for differential diagnosis of malignant hepatic tumors based on multi-phase contrast-enhanced CT and clinical data. J Hematol Oncol 14(1):154. https://doi.org/10.1186/s13045-021-01167-2
Hazlett HC, Gu H, Munsell BC, Kim SH, Styner M, Wolff JJ, Elison JT, Swanson MR, Zhu H, Botteron KN et al (2017) Early brain development in infants at high risk for autism spectrum disorder. Nature 542(7641):348–351. https://doi.org/10.1038/nature21369
Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S (2017) Dermatologist-level classification of skin cancer with deep neural networks. Nature 542(7639):115–118. https://doi.org/10.1038/nature21056
Ting DSW, Cheung CY, Lim G, Tan GSW, Quang ND, Gan A, Hamzah H, Garcia-Franco R, San Yeo IY, Lee SY et al (2017) Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA 318(22):2211–2223. https://doi.org/10.1001/jama.2017.18152
Wang K, Lu X, Zhou H, Gao Y, Zheng J, Tong M, Wu C, Liu C, Huang L, Jiang T et al (2019) Deep learning radiomics of shear wave elastography significantly improved diagnostic performance for assessing liver fibrosis in chronic hepatitis B: a prospective multicentre study. Gut 68(4):729–741. https://doi.org/10.1136/gutjnl-2018-316204
Aerts HJ, Velazquez ER, Leijenaar RT, Parmar C, Grossmann P, Carvalho S (2014) Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun 5:4006. https://doi.org/10.1038/ncomms5006
Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-CAM: visual explanations from deep networks via gradient-based localization. In 2017 IEEE international conference on computer vision. IEEE 2017:618–626
Chollet F (2015) keras, GitHub. https://github.com/fchollet/keras
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, 770–778. https://doi.org/10.1109/CVPR.2016.90
Deng J, Dong W, Socher R, Li LJ, Li K, Li F-F (2009) ImageNet: a large-scale hierarchical image database. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Miami, 20-25 June 2009, 2-9. https://doi.org/10.1109/CVPR.2009.5206848
Kermany DS, Goldbaum M, Cai W, Valentim CCS, Liang H, Baxter SL, McKeown A, Yang G, Wu X, Yan F et al (2018) Identifying medical diagnoses and treatable diseases by image-based deep learning. Cell 172(5):1122-1131.e9. https://doi.org/10.1016/j.cell.2018.02.010
Patterson BO, Karthikesalingam A, Hinchliffe RJ, Loftus IM, Thompson MM, Holt PJ (2011) The Glasgow aneurysm score does not predict mortality after open abdominal aortic aneurysm in the era of endovascular aneurysm repair. J Vasc Surg 54(2):353–357. https://doi.org/10.1016/j.jvs.2011.01.029
Sajid MS, Tai N, Goli G, Platts A, Baker DM, Hamilton G (2007) Applicability of Glasgow aneurysm score and Hardman index to elective endovascular abdominal aortic aneurysm repair. Asian J Surg 30(2):113–117. https://doi.org/10.1016/S1015-9584(09)60142-1
Patterson BO, Holt PJ, Hinchliffe R, Nordon IM, Loftus IM, Thompson MM (2010) Existing risk prediction methods for elective abdominal aortic aneurysm repair do not predict short-term outcome following endovascular repair. J Vasc Surg 52(1):25–30. https://doi.org/10.1016/j.jvs.2010.01.084
Eslami MH, Rybin DV, Doros G, Farber A (2017) Description of a risk predictive model of 30-day postoperative mortality after elective abdominal aortic aneurysm repair. J Vasc Surg 65(1):65-74.e2. https://doi.org/10.1016/j.jvs.2016.07.103
Eslami MH, Rybin D, Doros G, Kalish JA, Farber A (2015) Comparison of a Vascular Study Group of New England risk prediction model with established risk prediction models of in-hospital mortality after elective abdominal aortic aneurysm repair. J Vasc Surg 62(5):1125-1133.e2. https://doi.org/10.1016/j.jvs.2015.06.051
Grant SW, Grayson AD, Purkayastha D, Wilson SD, McCollum C (2011) Logistic risk model for mortality following elective abdominal aortic aneurysm repair. Br J Surg 98(5):652–658. https://doi.org/10.1002/bjs.7463
Giles KA, Schermerhorn ML, O’Malley AJ, Cotterill P, Jhaveri A, Pomposelli FB, Landon BE (2009) Risk prediction for perioperative mortality of endovascular vs open repair of abdominal aortic aneurysms using the Medicare population. J Vasc Surg 50(2):256–262. https://doi.org/10.1016/j.jvs.2009.01.044
Barnes M, Boult M, Maddern G, Fitridge R (2008) A model to predict outcomes for endovascular aneurysm repair using preoperative variables. Eur J Vasc Endovasc Surg 35(5):571–579. https://doi.org/10.1016/j.ejvs.2007.12.003
SC Beek van, Legemate DA, Vahl A, Wisselink W, Barnes M, Fitridge RA, Balm R (2014) External validation of the endovascular aneurysm repair risk assessment model in predicting survival, reinterventions, and endoleaks after endovascular aneurysm repair. J Vasc Surg 59(6):1555–1561. https://doi.org/10.1016/j.jvs.2013.12.043 (1561.e1-3)
Matsagkas M, Kouvelos G, Peroulis M, Avgos S, Arnaoutoglou E, Papa N, Papadopoulos G (2015) Standard endovascular treatment of abdominal aortic aneurysms in patients with very short proximal necks using the Endurant stent graft. J Vasc Surg 61(1):9–15. https://doi.org/10.1016/j.jvs.2014.07.002
Whaley ZL, Cassimjee I, Novak Z, Rowland D, Lapolla P, Chandrashekar A, Pearce BJ, Beck AW, Handa A, Lee R (2020) The spatial morphology of intraluminal thrombus influences type II endoleak after endovascular repair of abdominal aortic aneurysms. Ann Vasc Surg 66:77–84. https://doi.org/10.1016/j.avsg.2019.05.050
Moulakakis KG, Antonopoulos CN, Klonaris C, Kakisis J, Lazaris AM, Sfyroeras GS, Mantas G, Mylonas SN, Vasdekis SN, Brountzos EN et al (2018) Bilateral endograft limb occlusion after endovascular aortic repair: predictive factors of occurrence. Ann Vasc Surg 46:299–306. https://doi.org/10.1016/j.avsg.2017.07.019
Kaladji A, Daoudal A, Duménil A, Göksu C, Cardon A, Clochard E, Lucas A, Lalys F (2017) Predictive models of complications after endovascular aortic aneurysm repair. Ann Vasc Surg 40:19–27. https://doi.org/10.1016/j.avsg.2016.08.020
Karthikesalingam A, Attallah O, Ma X, Bahia SS, Thompson L, Vidal-Diez A, Choke EC, Bown MJ, Sayers RD, Thompson MM et al (2015) An artificial neural network stratifies the risks of reintervention and mortality after endovascular aneurysm repair; a retrospective observational study. PLoS ONE 10(7):e0129024. https://doi.org/10.1371/journal.pone.0129024
Kordzadeh A, Hanif MA, Ramirez MJ, Railton N, Prionidis I, Browne T (2021) Prediction, pattern recognition and modelling of complications post-endovascular infra renal aneurysm repair by artificial intelligence. Vascular 29(2):171–182. https://doi.org/10.1177/1708538120949658
Kotze CW, Rudd JHF, Ganeshan B, Menezes LJ, Brookes J, Agu O, Yusuf SW, Groves AM (2014) CT signal heterogeneity of abdominal aortic aneurysm as a possible predictive biomarker for expansion. Atherosclerosis 233(2):510–517. https://doi.org/10.1016/j.atherosclerosis.2014.01.001
García G, Tapia A (2014) De Blas M (2014) Computer-supported diagnosis for endotension cases in endovascular aortic aneurysm repair evolution. Comput Methods Programs Biomed 115(1):11–19. https://doi.org/10.1016/j.cmpb.2014.03.004
García G, Maiora J, Tapia A, De Blas M (2014) Evaluation of texture for classification of abdominal aortic aneurysm after endovascular repair. J Digit Imaging 25(3):369–376. https://doi.org/10.1007/s10278-011-9417-7
Charalambous S, Klontzas ME, Kontopodis N, Ioannou CV, Perisinakis K, Maris TG, Damilakis J, Karantanas A, Tsetis D (2021) Radiomics and machine learning to predict aggressive type 2 endoleaks after endovascular aneurysm repair: a proof of concept. Acta Radiol 27:2841851211032443. https://doi.org/10.1177/02841851211032443
Shi Z, Traverso A, van Soest J, Dekker A, Wee L (2019) Technical note: ontology-guided radiomics analysis workflow (O-RAW). Med Phys 46(12):5677–5684. https://doi.org/10.1002/mp.13844
Acknowledgements
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: this work was supported by the National Natural Science Foundation of China (grant number 81870342).
Funding
The authors acknowledge that the present research was sponsored by the National Natural Science Foundation of China (grant number 81870342).
Author information
Authors and Affiliations
Contributions
YW, ZS, and WF contributed to the conception and design; MZ, YD, XL, and ZZ performed the data collection and interpretation; YW and ZS performed ROI segmentation and images preprocessing; YW analyzed the datasets and wrote this article. ZS obtained the funding. All authors read and approved the final manuscript.
Corresponding authors
Ethics declarations
Conflict of Interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wang, Y., Zhou, M., Ding, Y. et al. Deep Learning Model for Predicting the Outcome of Endovascular Abdominal Aortic Aneurysm Repair. Indian J Surg 85 (Suppl 1), 288–296 (2023). https://doi.org/10.1007/s12262-022-03506-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12262-022-03506-0