Automatic Detection of Extra-Cardiac Findings in Cardiovascular Magnetic Resonance

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12722)


Cardiovascular magnetic resonance (CMR) is an established, non-invasive technique to comprehensively assess cardiovascular structure and function in a variety of acquired and inherited cardiac conditions. In addition to the heart, a typical CMR examination will also image adjacent thoracic and abdominal structures. Consequently, findings incidental to the cardiac examination may be encountered, some of which may be clinically relevant. We compare two deep learning architectures to automatically detect extra cardiac findings (ECFs) in the HASTE sequence of a CMR acquisition. The first one consists of a binary classification network that detects the presence of ECFs and the second one is a multi-label classification network that detects and classifies the type of ECF. We validated the two models on a cohort of 236 subjects, corresponding to 5610 slices, where 746 ECFs were found. Results show that the proposed methods have promising balanced accuracy and sensitivity and high specificity.


Deep learning classification Extra cardiac findings Cardiovascular magnetic resonance 



This work was supported by the EPSRC (EP/R005516/1 and EP/P001009/1) and the Wellcome EPSRC Centre for Medical Engineering at the School of Biomedical Engineering and Imaging Sciences, King’s College London (WT 203148/Z/16/Z).


  1. 1.
    Blau, N., Klang, E., Kiryati, N., Amitai, M., Portnoy, O., Mayer, A.: Fully automatic detection of renal cysts in abdominal CT scans. Int. J. Comput. Assist. Radiol. Surg. 13(7), 957–966 (2018)CrossRefGoogle Scholar
  2. 2.
    Dunet, V., Schwitter, J., Meuli, R., Beigelman-Aubry, C.: Incidental extracardiac findings on cardiac MR: systematic review and meta-analysis. J. Magn. Resonan. Imaging 43(4), 929–939 (2016)CrossRefGoogle Scholar
  3. 3.
    Greulich, S., et al.: Extra cardiac findings in cardiovascular MR: why cardiologists and radiologists should read together. Int. J. Cardiovasc. Imaging 30(3), 609–617 (2014)CrossRefGoogle Scholar
  4. 4.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)Google Scholar
  5. 5.
    Howard, A.G., et al.: MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017)
  6. 6.
    Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4700–4708 (2017)Google Scholar
  7. 7.
    Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., Keutzer, K.: SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and \(<\)0.5 MB model size. arXiv preprint arXiv:1602.07360 (2016)
  8. 8.
    Irwin, R.B., et al.: Incidental extra-cardiac findings on clinical CMR. Eur. Heart J.-Cardiovasc. Imaging 14(2), 158–166 (2013)CrossRefGoogle Scholar
  9. 9.
    Karamitsos, T.D., Francis, J.M., Myerson, S., Selvanayagam, J.B., Neubauer, S.: The role of cardiovascular magnetic resonance imaging in heart failure. J. Am. Coll. Cardiol. 54(15), 1407–1424 (2009)CrossRefGoogle Scholar
  10. 10.
    Keenan, N., et al.: UK national and regional trends in cardiovascular magnetic resonance usage-the British society of CMR survey results. Eur. Heart J. 41(Supplement\(\_\)2), ehaa946-0200 (2020)Google Scholar
  11. 11.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 25, 1097–1105 (2012)Google Scholar
  12. 12.
    Liu, X., et al.: A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis. Lancet Digit. Health 1(6), e271–e297 (2019)CrossRefGoogle Scholar
  13. 13.
    Mantini, C., et al.: Prevalence and clinical relevance of extracardiac findings in cardiovascular magnetic resonance imaging. J. Thoracic Imaging 34(1), 48–55 (2019)CrossRefGoogle Scholar
  14. 14.
    Petersen, S.E., et al.: Update of the European association of cardiovascular imaging (EACVI) core syllabus for the European cardiovascular magnetic resonance certification exam. Eur. Heart J.-Cardiovasc. Imaging 15(7), 728–729 (2014)CrossRefGoogle Scholar
  15. 15.
    Peterzan, M.A., Rider, O.J., Anderson, L.J.: The role of cardiovascular magnetic resonance imaging in heart failure. Cardiac Failure Rev. 2(2), 115 (2016)CrossRefGoogle Scholar
  16. 16.
    Rajiah, P., Desai, M.Y.: Cardiac magnetic resonance imaging-role and applications. Eur. Cardiol. 8(1), 17–22 (2012) CrossRefGoogle Scholar
  17. 17.
    Rodrigues, J.C., et al.: Extra-cardiac findings in cardiovascular magnetic resonance: what the imaging cardiologist needs to know. J. Cardiovasc. Magn. Resonan. 18(1), 1–21 (2016)CrossRefGoogle Scholar
  18. 18.
    Shenkman, Y., et al.: Automatic detection and diagnosis of sacroiliitis in CT scans as incidental findings. Med. Image Anal. 57, 165–175 (2019)CrossRefGoogle Scholar
  19. 19.
    Siegersma, K., Leiner, T., Chew, D., Appelman, Y., Hofstra, L., Verjans, J.: Artificial intelligence in cardiovascular imaging: state of the art and implications for the imaging cardiologist. Netherlands Heart J. 27(9), 403–413 (2019)CrossRefGoogle Scholar
  20. 20.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
  21. 21.
    Stacey, R.B., Hundley, W.G.: The role of cardiovascular magnetic resonance (CMR) and computed tomography (CCT) in facilitating heart failure management. Curr. Treat. Options Cardiovasc. Med. 15(4), 373–386 (2013)CrossRefGoogle Scholar
  22. 22.
    Wyttenbach, R., Médioni, N., Santini, P., Vock, P., Szucs-Farkas, Z.: Extracardiac findings detected by cardiac magnetic resonance imaging. Eur. Radiol. 22(6), 1295–1302 (2012)CrossRefGoogle Scholar
  23. 23.
    Yan, K., Wang, X., Lu, L., Summers, R.M.: DeepLesion: automated mining of large-scale lesion annotations and universal lesion detection with deep learning. J. Med. Imaging 5(3), 036501 (2018)CrossRefGoogle Scholar
  24. 24.
    Zhang, X., Zhou, X., Lin, M., Sun, J.: ShuffleNet: an extremely efficient convolutional neural network for mobile devices. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6848–6856 (2018)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2021

Authors and Affiliations

  1. 1.School of Biomedical Engineering and Imaging SciencesKing’s College LondonLondonUK
  2. 2.Guy’s and St Thomas’ HospitalLondonUK
  3. 3.Luigi Sacco University HospitalMilanItaly
  4. 4.Postgraduate School of Diagnostic and Interventional RadiologyUniversità degli Studi di MilanoMilanItaly

Personalised recommendations