Abstract
Purpose
Left atrium segmentation and visualization serve as a fundamental and crucial role in clinical analysis and understanding of atrial fibrillation. However, most of the existing methods are directly transmitting information, which may cause redundant information to be passed to affect segmentation performance. Moreover, they did not further consider atrial visualization after segmentation, which leads to a lack of understanding of the essential atrial anatomy.
Methods
We propose a novel unified deep learning framework for left atrium segmentation and visualization simultaneously. At first, a novel dual-path module is used to enhance the expressiveness of cardiac image representation. Then a multi-scale context-aware module is designed to effectively handle complex appearance and shape variations of the left atrium and associated pulmonary veins. The generated multi-scale features are feed to gated bidirectional message passing module to remove irrelevant information and extract discriminative features. Finally, the features after message passing are efficiently combined via a deep supervision mechanism to produce the final segmentation result and reconstruct 3D volumes.
Results
Our approach primarily against the 2018 left atrium segmentation challenge dataset, which consists of 100 3D gadolinium-enhanced magnetic resonance images. Our method achieves an average dice of 0.936 in segmenting the left atrium via fivefold cross-validation, which outperforms state-of-the-art methods.
Conclusions
The performance demonstrates the effectiveness and advantages of our network for the left atrium segmentation and visualization. Therefore, our proposed network could potentially improve the clinical diagnosis and treatment of atrial fibrillation.
Similar content being viewed by others
References
Peng P, Lekadir K, Gooya A, Shao L, Petersen SE, Frangi AF (2016) A review of heart chamber segmentation for structural and functional analysis using cardiac magnetic resonance imaging. Magma 29(2):155–195
Christopher MG, Nazem A, Amit P, Eugene K, Patricia R, Kavitha D, Brent W, Josh C, Alexis H, Ravi R (2014) Atrial fibrillation ablation outcome is predicted by left atrial remodeling on MRI. Circ Arrhythm Electrophysiol 7(1):23
Zhao J, Butters TD, Zhang H, Pullan AJ, Legrice IJ, Sands GB, Smaill BH (2012) An image-based model of atrial muscular architecture: effects of structural anisotropy on electrical activation. Circ Arrhythm Electrophysiol 5(2):361–370
Zhuang X, Rhode KS, Razavi R, Hawkes DJ, Ourselin S (2010) A registration-based propagation framework for automatic whole heart segmentation of cardiac MRI. IEEE Trans Med Imaging 29(9):1612–1625
Zheng Y, Yang D, John M, Comaniciu D (2014) Multi-part modeling and segmentation of left atrium in C-arm CT for image-guided ablation of atrial fibrillation. IEEE Trans Med Imaging 33(2):318–331
Tobongomez C, Geers AJ, Peters J, Weese J, Pinto K, Karim R, Ammar M, Daoudi A, Margeta J, Sandoval Z (2015) Benchmark for algorithms segmenting the left atrium from 3D CT and MRI datasets. IEEE Trans Med Imaging 34(7):1460–1473
Zhu L, Gao Y, Yezzi AJ, Tannenbaum AR (2013) Automatic segmentation of the left atrium from MR images via variational region growing with a moments-based shape prior. IEEE Trans Image Process 22(12):5111–5122
Tao Q, Ipek EG, Shahzad R, Berendsen FF, Nazarian S, Der Geest RJV (2016) Fully automatic segmentation of left atrium and pulmonary veins in late gadolinium-enhanced MRI: towards objective atrial scar assessment. J Magn Reson Imaging 44(2):346–354
Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Medical image computing and computer assisted intervention. Lecture notes in computer science, vol 9351. Springer, Cham, pp 234–241
Milletari F, Navab N, Ahmadi S (2016) V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: International conference on 3D vision. pp 565–571
Tran PV (2016) A fully convolutional neural network for cardiac segmentation in short-axis MRI. arXiv:1604.00494
Yang X, Bian C, Yu L, Ni D, Heng P-A (2017) Hybrid loss guided convolutional networks for whole heart parsing. In: International workshop on statistical atlases and computational models of the heart. Springer, Cham, pp 215–223
Yang X, Wang N, Wang Y, Wang X, Nezafat R, Ni D, Heng P (2018) Combating uncertainty with novel losses for automatic left atrium segmentation. In: International workshop on statistical atlases and computational models of the heart, pp 246–254
Vesal S, Ravikumar N, Maier AK (2018) Dilated convolutions in neural networks for left atrial segmentation in 3D gadolinium enhanced-MRI. In: International workshop on statistical atlases and computational models of the heart. Springer, Cham, pp 319–328
Chen C, Bai W, Rueckert D (2018) Multi-task learning for left atrialsegmentation on GE-MRI. In: International workshop on statistical atlases and computational models of the heart. Springer, Cham, pp 292–301
Mortazi A, Karim R, Rhode KS, Burt J, Bagci U (2017) Cardiac-NET: Segmentation of left atrium and proximal pulmonary veins from MRI using multi-view CNN. In: Medical image computing and computer assisted intervention. Lecture notes in computer science, vol 10434, pp 377–385
Chen J, Yang G, Gao Z, Ni H, Angelini ED, Mohiaddin RH, Wong T, Zhang Y, Du X, Zhang H (2018) Multiview two-task recursive attention model for left atrium and atrial scars segmentation. Medical image computing and computer assisted intervention. Lecture notes in computer science, vol 11071. Springer, Cham, pp 455–463
Bian C, Yang X, Ma J, Zheng S, Liu Y, Nezafat R, Heng P, Zheng Y (2018) Pyramid network with online hard example mining for accurate left atrium segmentation. international workshop on statistical atlases and computational models of the heart. Lecture notes in computer science, vol 11395. Springer, Cham, pp 237–245
Li D, Chen X, Zhang Z, Huang K (2017) Learning deep context-aware features over body and latent parts for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 384–393
Zeng X, Ouyang W, Yang B, Yan J, Wang X (2016) Gated Bi-directional CNN for Object Detection. In: European conference on computer vision. pp 354–369
Liu T, Yuan Z, Sun J, Wang J, Zheng N, Tang X, Shum H (2011) Learning to detect a salient object. IEEE Trans Pattern Anal Mach Intell 33(2):353–367
Wang Z, Liu C, Cheng D, Wang L, Yang X, Cheng K (2018) Automated detection of clinically significant prostate cancer in mp-MRI images based on an end-to-end deep neural network. IEEE Trans Med Imaging 37(5):1127–1139
He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: surpassing human-level performance on Imagenet classification. In: International conference on computer vision. pp 1026–1034
Huttenlocher DP, Klanderman GA, Rucklidge W (1993) Comparing images using the Hausdorff distance. IEEE Trans Pattern Anal Mach Intell 15(9):850–863
Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6230–6239
Chen L, Papandreou G, Schroff F, Adam H (2017) Rethinking atrous convolution for semantic image segmentation. arXiv:1706.05587
Badrinarayanan V, Kendall A, Cipolla R (2017) SegNet: a deep convolutional encoder–decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495
Acknowledgements
We thank all the anonymous reviewers for their valuable comments and constructive suggestions, which were helpful for improving the quality of the paper. This work was supported in part by the National Science Foundation of China under Grant 61673020, the Anhui Provincial Natural Science Foundation under Grand 1708085QF143.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
All procedures performed in our study involving human participants were in accordance with the ethical standards of the institutional and/or national research committee.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Du, X., Yin, S., Tang, R. et al. Segmentation and visualization of left atrium through a unified deep learning framework. Int J CARS 15, 589–600 (2020). https://doi.org/10.1007/s11548-020-02128-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-020-02128-9