Abstract
Cardiac left ventricle (LV) quantification provides a tool for diagnosing cardiac diseases. Automatic calculation of all relevant LV indices from cardiac MR images is an intricate task due to large variations among patients and deformation during the cardiac cycle. Typical methods are based on segmentation of the myocardium or direct regression from MR images. To consider cardiac motion and deformation, recurrent neural networks and spatio-temporal convolutional neural networks (CNNs) have been proposed. We study an approach combining state-of-the-art models and emphasizing transfer learning to account for the small dataset provided for the LVQuan19 challenge. We compare 2D spatial and 3D spatio-temporal CNNs for LV indices regression and cardiac phase classification. To incorporate segmentation information, we propose an architecture-independent segmentation-based regularization. To improve the robustness further, we employ a search scheme that identifies the optimal ensemble from a set of architecture variants. Evaluating on the LVQuan19 Challenge training dataset with 5-fold cross-validation, we achieve mean absolute errors of \(111 \pm 76\,\mathrm{mm}^2\), \(1.84 \pm 0.90\,\mathrm{mm}\) and \(1.22\,\pm \,0.60\,\mathrm{mm}\) for area, dimension and regional wall thickness regression, respectively. The error rate for cardiac phase classification is \({6.7\,\mathrm{\%}}\).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Avendi, M., Kheradvar, A., Jafarkhani, H.: A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI. Med. Image Anal. 30, 108–119 (2016)
Gessert, N., et al.: Skin Lesion classification using CNNs with patch-based attention and diagnosis-guided loss weighting. IEEE Trans. Biomed. Eng. (2019, early access). https://doi.org/10.1109/TBME.2019.2915839
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: CVPR, pp. 770–778 (2016)
Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: CVPR, pp. 7132–7141 (2018)
Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: CVPR, pp. 4700–4708 (2017)
Jang, Y., Kim, S., Shim, H., Chang, H.-J.: Full quantification of left ventricle using deep multitask network with combination of 2D and 3D convolution on 2D + t cine MRI. In: Pop, M., et al. (eds.) STACOM 2018. LNCS, vol. 11395, pp. 476–483. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-12029-0_51
Karamitsos, T.D., Francis, J.M., Myerson, S., Selvanayagam, J.B., Neubauer, S.: The role of cardiovascular magnetic resonance imaging in heart failure. J. Am. Coll. Cardiol. 54(15), 1407–1424 (2009)
Li, J., Hu, Z.: Left ventricle full quantification using deep layer aggregation based multitask relationship learning. In: Pop, M., et al. (eds.) STACOM 2018. LNCS, vol. 11395, pp. 381–388. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-12029-0_41
Gessert, N., et al.: Automatic plaque detection in IVOCT pullbacks using convolutional neural networks. IEEE Trans. Med. Imaging 38(2), 426–434 (2019)
Ngo, T.A., Lu, Z., Carneiro, G.: Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance. Med. Image Anal. 35, 159–171 (2017)
Shin, H.C., et al.: Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans. Med. Imaging 35(5), 1285–1298 (2016)
Suinesiaputra, A., et al.: Quantification of LV function and mass by cardiovascular magnetic resonance: multi-center variability and consensus contours. J. Cardiovasc. Magn. Reson. 17(1), 63 (2015)
Wang, W., Wanga, Y., Wu, Y., Lin, T., Li, S., Chen, B.: Quantification of full left ventricular metrics via deep regression learning with contour-guidance. IEEE Access 7, 47918–47928 (2019)
Xie, S., Girshick, R., Dollár, P., Tu, Z., He, K.: Aggregated residual transformations for deep neural networks. In: CVPR, pp. 1492–1500 (2017)
Xu, H., Schneider, J.E., Grau, V.: Calculation of anatomical and functional metrics using deep learning in cardiac MRI: comparison between direct and segmentation-based estimation. In: Pop, M., et al. (eds.) STACOM 2018. LNCS, vol. 11395, pp. 402–411. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-12029-0_43
Xue, W., Brahm, G., Pandey, S., Leung, S., Li, S.: Full left ventricle quantification via deep multitask relationships learning. Med. Image Anal. 43, 54–65 (2018)
Xue, W., Lum, A., Mercado, A., Landis, M., Warrington, J., Li, S.: Full quantification of left ventricle via deep multitask learning network respecting intra- and inter-task relatedness. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10435, pp. 276–284. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66179-7_32
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Gessert, N., Schlaefer, A. (2020). Left Ventricle Quantification Using Direct Regression with Segmentation Regularization and Ensembles of Pretrained 2D and 3D CNNs. In: Pop, M., et al. Statistical Atlases and Computational Models of the Heart. Multi-Sequence CMR Segmentation, CRT-EPiggy and LV Full Quantification Challenges. STACOM 2019. Lecture Notes in Computer Science(), vol 12009. Springer, Cham. https://doi.org/10.1007/978-3-030-39074-7_39
Download citation
DOI: https://doi.org/10.1007/978-3-030-39074-7_39
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-39073-0
Online ISBN: 978-3-030-39074-7
eBook Packages: Computer ScienceComputer Science (R0)