Automatic 3D liver location and segmentation via convolutional neural network and graph cut
- 1.4k Downloads
Segmentation of the liver from abdominal computed tomography (CT) images is an essential step in some computer-assisted clinical interventions, such as surgery planning for living donor liver transplant, radiotherapy and volume measurement. In this work, we develop a deep learning algorithm with graph cut refinement to automatically segment the liver in CT scans.
The proposed method consists of two main steps: (i) simultaneously liver detection and probabilistic segmentation using 3D convolutional neural network; (ii) accuracy refinement of the initial segmentation with graph cut and the previously learned probability map.
The proposed approach was validated on forty CT volumes taken from two public databases MICCAI-Sliver07 and 3Dircadb1. For the MICCAI-Sliver07 test dataset, the calculated mean ratios of volumetric overlap error (VOE), relative volume difference (RVD), average symmetric surface distance (ASD), root-mean-square symmetric surface distance (RMSD) and maximum symmetric surface distance (MSD) are 5.9, 2.7 %, 0.91, 1.88 and 18.94 mm, respectively. For the 3Dircadb1 dataset, the calculated mean ratios of VOE, RVD, ASD, RMSD and MSD are 9.36, 0.97 %, 1.89, 4.15 and 33.14 mm, respectively.
The proposed method is fully automatic without any user interaction. Quantitative results reveal that the proposed approach is efficient and accurate for hepatic volume estimation in a clinical setup. The high correlation between the automatic and manual references shows that the proposed method can be good enough to replace the time-consuming and nonreproducible manual segmentation method.
KeywordsLiver segmentation 3D convolution neural network Graph cut CT images
The authors would like to thank Dr. Jing Yuan and Dr. Jialin Peng for their valuable discussions and useful suggestions. This work was supported in part by National Natural Science Foundation of China (Grant Nos. 11271323, 91330105, 11401231) and the Zhejiang Provincial Natural Science Foundation of China (Grant No.: LZ13A010002).
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
This article does not contain any studies with human participants or animals performed by any of the authors.
Informed consent was obtained from all individual participants included in the study.
- 1.Afifi A, Nakaguchi T (2012) Liver segmentation approach using graph cuts and iteratively estimated shape and intensity constrains. Int Conf Med Image Comput Comput Assist Interv 15:395–403Google Scholar
- 3.Al-Shaikhli S, Yang M, Rosenhahn B (2015) Automatic 3D liver segmentation using sparse representation of global and local image information via level set formulation. http://arxiv.org/abs/1508.01521
- 7.Boykov Y, Jolly M (2001) Interactive graph cuts for optimal boundary and region segmentation of objects in N-D images. In: Proceedings 8th IEEE international conference on computer vision. ICCV 2001. IEEE 1, pp 105–112Google Scholar
- 11.Dan CC, Giusti A, Gambardella LM (2012) Schmidhuber: deep neural networks segment neuronal membranes in electron microscopy images. Nips 4:2843–2851Google Scholar
- 12.Erdt M, Steger S, Kirschner M, Wesarg S (2010) Fast automatic liver segmentation combining learned shape priors with observed shape deviation. In: Proceedings of the 26th IEEE international symposium on computer-based medical systems, pp 249–254Google Scholar
- 16.Heimann T, Meinzer HP, Wolf I (2007) A statistical deformable model for the segmentation of liver CT volumes. In: Miccai workshop on 3D segmentation in the clinic, pp 161–166Google Scholar
- 17.Heimann T, van Ginneken B, Styner M, Arzhaeva Y, Aurich V, Bauer C, Beck A, Becker C, Beichel R, Bekes G, Bello F, Binnig G, Bischof H, Bornik A, Cashman P, Chi Y, Cordova A, Dawant B, Fidrich M, Furst J, Furukawa D, Grenacher L, Hornegger J, Kainmuller D, Kitney R, Kobatake H, Lamecker H, Lange T, Lee J, Lennon B, Li R, Li S, Meinzer HP, Nemeth G, Raicu D, Rau AM, van Rikxoort E, Rousson M, Rusko L, Saddi K, Schmidt G, Seghers D, Shimizu A, Slagmolen P, Sorantin E, Soza G, Susomboon R, Waite J, Wimmer A, Wolf I (2009) Comparison and evaluation of methods for liver segmentation from CT datasets. IEEE Trans Med Imaging 28(8):1251–1265CrossRefPubMedGoogle Scholar
- 18.Huang C, Jia F, Li Y, Zhang X, Luo H, Fang C, Fan Y (2012) Automatic liver segmentation based on shape constrained differeomorphic demons atlas registration. In: International conference on electronics, communications and control, pp 126–129Google Scholar
- 20.Kainmüller D, Lange T, Lamecker H (2007) Shape constrained automatic segmentation of the liver based on a heuristic intensity model. In: Proceeding MICCAI workshop 3-D segmentat. Clinic: a gand challenge, pp 109–116Google Scholar
- 21.Kinda A, Saddi Rousson M, Hotel CC, Cheriet F (2007) Global to local shape matching for liver segmentation in CT imaging. In: Miccai workshop on 3D segmentation in the clinic, pp 207–214Google Scholar
- 22.Kirschner M (2013) The probabilistic active shape model: from model construction to flexible medical image segmentation. Ph.D. dissertationGoogle Scholar
- 23.Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25(2):2012Google Scholar
- 27.Linguraru MG, Richbourg WJ, Watt JM, Pamulapati V, Summers RM (2011) Liver and tumor segmentation and analysis from CT of diseased patients via a generic affine invariant shape parameterization and graph cuts. In: International conference on abdominal imaging: computational and clinical applications, pp 198–206Google Scholar
- 28.Massoptier L, Casciaro S (2007) Fully automatic liver segmentation through graph-cut technique. In: 29th annual international conference of the IEEE engineering in medicine and biology society 2007, pp 5243–5246Google Scholar
- 29.Ni K, Bresson X, Chan T, Esedoglu S (2007) Local histogram based segmentation using the wasserstein distance. In: Scale space and variational methods in computer vision, first international conference, pp 97–111Google Scholar
- 35.Prasoon A, Petersen K, Igel C, Lauze F, Dam E, Nielsen M (2013) Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network. In: International conference on medical image computing and computer-assisted intervention, pp 246–253Google Scholar
- 37.Shi C, Cheng Y, Liu F, Wang Y, Bai J, Tamura S (2015) A hierarchical local region-based sparse shape composition for liver segmentation in CT scans. Pattern Recognit 50(C):88–106Google Scholar
- 38.Szegedy C, Toshev A, Erhan D (2013) Deep neural networks for object detection. Adv Neural Inf Process Syst 1:2555–2563Google Scholar
- 41.Wang J, Cheng Y, Guo C, Wang Y, Tamura S (2016) Shape–intensity prior level set combining probabilistic atlas and probability map constrains for automatic liver segmentation from abdominal CT images. Int J Comput Assist Radiol Surg 11:817–826Google Scholar
- 43.Wimmer A, Hornegger J, Soza G (2009) Implicit active shape model employing boundary classifier. In: 19th international conference on pattern recognition, 2008. ICPR 2008, pp 1–4Google Scholar
- 44.Wimmer A, Soza G, Hornegger J (2009) A generic probabilistic active shape model for organ segmentation. Lect Notes Comput Sci 12:26–33Google Scholar
- 45.Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), pp 818–833Google Scholar