Abstract
The prior step in most of the kidney related image analysis is precise and authentic kidney segmentation. Although many semi-automated kidney segmentation techniques for 2D ultrasound images have been proposed, only a minimal number of automated techniques were explored. Low contrast and variability in the shape of kidney poses a challenge for the same. In this paper, an YSegNet based on an encoder–decoder network combined with a boundary extraction network is presented. The proposed model and its variants have been experimented using a VGG-16 encoder from scratch and a pre-trained VGG-16 encoder. A dataset of 700 images were considered for experimentation, which is further augmented to increase the size of the dataset for better precision. The proposed network is compared with basic U-Net and similar competing deep learning networks. The segmented map is promising with an accuracy of 97.26%, DICE score of 0.97, specificity of 0.97 and sensitivity of 0.98, thereby confirming that the presented deep learning segmentation network can used in automated 2D ultrasound kidney image analysis.
Similar content being viewed by others
Data Availability
The data supporting the findings of this work are available from the corresponding author on reasonable request.
References
Sharma N, Aggarwal LM (2010) Automated medical image segmentation techniques. J Med Phys/Assoc Med Phys India 35:3. https://doi.org/10.4103/0971-6203.58777
Kim T-Y, Son J, Kim K-G (2011) The recent progress in quantitative medical image analysis for computer aided diagnosis systems. Healthc Inform Res 17:143–149. https://doi.org/10.4258/hir.2011.17.3.143
Deserno TM (2011) Fundamentals of medical image processing. In: Springer handbook of medical technology. Springer, pp 1139–1165
Aggarwal P, Vig R, Bhadoria S, Dethe CG (2011) Role of segmentation in medical imaging: a comparative study. Int J Comput Appl 975:29. https://doi.org/10.5120/3525-4803
An F-P, Liu J (2020) Medical image segmentation algorithm based on optimized convolutional neural network-adaptive dropout depth calculation. Complexity 2020:1645479. https://doi.org/10.1155/2020/1645479
Ozmen CA, Akin D, Bilek SU et al (2010) Ultrasound as a diagnostic tool to differentiate acute from chronic renal failure. Clin Nephrol 74:46–52. https://doi.org/10.2379/CN106407
Selby NM, Blankestijn PJ, Boor P et al (2018) Magnetic resonance imaging biomarkers for chronic kidney disease: a position paper from the European Cooperation in Science and Technology Action PARENCHIMA. Nephrol Dial Transplant 33:ii4–ii14. https://doi.org/10.1093/ndt/gfy152
Torres HR, Queiros S, Morais P et al (2018) Kidney segmentation in ultrasound, magnetic resonance and computed tomography images: a systematic review. Comput Methods Programs Biomed 157:49–67. https://doi.org/10.1016/j.cmpb.2018.01.014
Lento PH, Primack S (2008) Advances and utility of diagnostic ultrasound in musculoskeletal medicine. Curr Rev Musculoskelet Med 1:24–31. https://doi.org/10.1007/s12178-007-9002-3
Cerrolaza JJ, Safdar N, Biggs E et al (2016) Renal segmentation from 3D ultrasound via fuzzy appearance models and patient-specific alpha shapes. IEEE Trans Med Imaging 35:2393–2402. https://doi.org/10.1109/TMI.2016.2572641
Yang F, Qin W, Xie Y et al (2012) A shape-optimized framework for kidney segmentation in ultrasound images using NLTV denoising and DRLSE. Biomed Eng OnLine 11:82. https://doi.org/10.1186/1475-925X-11-82
Wang H, Pulido JE, Song Y et al (2014) Segmentation of renal parenchymal area from ultrasoundl images using level set evolution. In: 2014 36th annual international conference of the IEEE engineering in medicine and biology society. pp 4703–4706
Song Y, Wang H, Liu Y et al (2015) An improved level set method for segmentation of renal parenchymal area from ultrasound images. J Med Imaging Health Inform 5:1533–1536. https://doi.org/10.1166/jmihi.2015.1566
Selvathi D, Bama S (2017) Phase based distance regularized level set for the segmentation of ultrasound kidney images. Pattern Recognit Lett 86:9–17. https://doi.org/10.1016/j.patrec.2016.12.002
Li C, Xu C, Gui C, Fox MD (2010) Distance regularized level set evolution and its application to image segmentation. IEEE Trans Image Process 19:3243–3254. https://doi.org/10.1109/TIP.2010.2069690
Mendoza CS, Kang X, Safdar N et al (2013) Kidney segmentation in ultrasound via genetic initialization and active shape models with rotation correction. In: 2013 IEEE 10th international symposium on biomedical imaging. IEEE, pp 69–72
Mendoza CS, Kang X, Safdar N, et al (2013) Automatic analysis of pediatric renal ultrasound using shape, anatomical and image acquisition priors. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 259–266
Zheng Q, Warner S, Tasian G, Fan Y (2018) A dynamic graph cuts method with integrated multiple feature maps for segmenting kidneys in 2D ultrasound images. Acad Radiol 25:1136–1145. https://doi.org/10.1016/j.acra.2018.01.004
Ravishankar H, Annangi P, Washburn M, Lanning J (2016) Automated kidney morphology measurements from ultrasound images using texture and edge analysis. In: Medical imaging 2016: ultrasonic imaging and tomography. International Society for Optics and Photonics, p 97901A
Ravishankar H, Venkataramani R, Thiruvenkadam S et al (2017) Learning and incorporating shape models for semantic segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 203–211
Yin S, Peng Q, Li H et al (2020) Automatic kidney segmentation in ultrasound images using subsequent boundary distance regression and pixelwise classification networks. Med Image Anal 60:101602. https://doi.org/10.1016/j.media.2019.101602
Hesamian MH, Jia W, He X, Kennedy P (2019) Deep learning techniques for medical image segmentation: achievements and challenges. J Digit Imaging 32:582–596. https://doi.org/10.1007/s10278-019-00227-x
Albawi S, Mohammed TA, Al-Zawi S (2017) Understanding of a convolutional neural network. In: 2017 international conference on engineering and technology (ICET). IEEE, pp 1–6
Kattenborn T, Leitloff J, Schiefer F, Hinz S (2021) Review on Convolutional Neural Networks (CNN) in vegetation remote sensing. ISPRS J Photogramm Remote Sens 173:24–49
Liu Y, Pu H, Sun D-W (2021) Efficient extraction of deep image features using convolutional neural network (CNN) for applications in detecting and analysing complex food matrices. Trends Food Sci Technol 113:193–204
Commandeur F, Goeller M, Betancur J et al (2018) Deep learning for quantification of epicardial and thoracic adipose tissue from non-contrast CT. IEEE Trans Med Imaging 37:1835–1846. https://doi.org/10.1109/TMI.2018.2804799
Yamashita R, Nishio M, Do RKG, Togashi K (2018) Convolutional neural networks: an overview and application in radiology. Insights Imaging 9:611–629. https://doi.org/10.1007/s13244-018-0639-9
Bass V, Mateos J, Rosado-Mendez IM, Márquez J (2021) Ultrasound image segmentation methods: a review. AIP Publishing LLC, p 050018
Shelhamer E, Long J, Darrell T (2017) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39:640–651. https://doi.org/10.1109/TPAMI.2016.2572683
Wang J, Song L, Li Z et al (2021) End-to-end object detection with fully convolutional network, pp 15849–15858
Harms J, Lei Y, Tian S et al (2021) Automatic delineation of cardiac substructures using a region-based fully convolutional network. Med Phys 48:2867–2876
Batur Dinler Ö, Aydin N (2020) An optimal feature parameter set based on gated recurrent unit recurrent neural networks for speech segment detection. Appl Sci 10:1273
Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: JMLR workshop and conference proceedings, pp 249–256
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9:1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
Liu H, Chen M, Zhao T, Liao W (2021) Besov function approximation and binary classification on low-dimensional manifolds using convolutional residual networks. PMLR, pp 6770–6780
Shehab LH, Fahmy OM, Gasser SM, El-Mahallawy MS (2021) An efficient brain tumor image segmentation based on deep residual networks (ResNets). J King Saud Univ-Eng Sci 33:404–412
Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 234–241
Xu F, Ma H, Sun J et al (2019) LSTM multi-modal UNet for brain tumor segmentation. IEEE, pp 236–240
Xiao Z, Liu B, Geng L et al (2020) Segmentation of lung nodules using improved 3D-UNet neural network. Symmetry 12:1787
Razzak MI, Naz S, Zaib A (2018) Deep learning for medical image processing: overview, challenges and the future. In: Classification in BioApps. Springer, pp 323–350
Hochreiter S (1998) The vanishing gradient problem during learning recurrent neural nets and problem solutions. Int J Uncertain Fuzziness Knowl-Based Syst 6:107–116. https://doi.org/10.1142/S0218488598000094
Liu L, Cheng J, Quan Q et al (2020) A survey on U-shaped networks in medical image segmentations. Neurocomputing 409:244–258. https://doi.org/10.1016/j.neucom.2020.05.070
Alex DM, Chandy DA (2020) Investigations on performances of pre-trained U-Net models for 2D ultrasound kidney image segmentation. In: International conference for emerging technologies in computing. Springer, pp 185–195
Yin S, Zhang Z, Li H et al (2019) Fully-automatic segmentation of kidneys in clinical ultrasound images using a boundary distance regression network. In: 2019 IEEE 16th international symposium on biomedical imaging (ISBI 2019). IEEE, pp 1741–1744
Deng J, Dong W, Socher R et al (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. IEEE, pp 248–255
Yu F, Koltun V (2016) Multi-scale context aggregation by dilated convolutions. CoRR abs/1511.07122. https://arxiv.org/abs/1511.07122v3
Drozdzal M, Vorontsov E, Chartrand G et al (2016) The importance of skip connections in biomedical image segmentation. In: Deep learning and data labeling for medical applications. Springer, pp 179–187
Tong T, Li G, Liu X, Gao Q (2017) Image super-resolution using dense skip connections. In: Proceedings of the IEEE international conference on computer vision, pp 4799–4807
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708
Mikołajczyk A, Grochowski M (2018) Data augmentation for improving deep learning in image classification problem. In: 2018 international interdisciplinary PhD workshop (IIPhDW). IEEE, pp 117–122
Kumar SN, Fred AL, Kumar HA, Varghese PS (2018) Performance metric evaluation of segmentation algorithms for gold standard medical images. In: Recent findings in intelligent computing techniques. Springer, pp 457–469
Csurka G, Larlus D, Perronnin F, Meylan F (2013) What is a good evaluation measure for semantic segmentation? In: BMVC, p 2013
Sokolova M, Japkowicz N, Szpakowicz S (2006) Beyond accuracy, F-score and ROC: a family of discriminant measures for performance evaluation. In: Australasian joint conference on artificial intelligence. Springer, pp 1015–1021
Thanh DN, Prasath VS, Hien NN (2019) Melanoma skin cancer detection method based on adaptive principal curvature, colour normalisation and feature extraction with the ABCD Rule. J Digit Imaging. https://doi.org/10.1007/s10278-019-00316-x
Thanh DN, Sergey D, Surya Prasath VB, Hai NH (2019) Blood vessels segmentation method for retinal fundus images based on adaptive principal curvature and image derivative operators. Int Arch Photogramm Remote Sens Spat Inf Sci. https://doi.org/10.5194/isprs-archives-XLII-2-W12-211-2019
Thanh DNH, Erkan U, Prasath VS et al (2019) A skin lesion segmentation method for dermoscopic images based on adaptive thresholding with normalization of color models. In: 2019 6th international conference on electrical and electronics engineering (ICEEE). IEEE, pp 116–120
Taha AA, Hanbury A (2015) Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool. BMC Med Imaging 15:29. https://doi.org/10.1186/s12880-015-0068-x
Zhou Z, Siddiquee MMR, Tajbakhsh N, Liang J (2018) Unet++: a nested u-net architecture for medical image segmentation. In: Deep learning in medical image analysis and multimodal learning for clinical decision support. Springer, pp 3–11
Jha D, Riegler MA, Johansen D et al (2020) DoubleU-Net: a deep convolutional neural network for medical image segmentation. In: 2020 IEEE 33rd international symposium on computer-based medical systems (CBMS), pp 558–564
Funding
The authors did not receive support from any organization for the submitted work.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
All authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Ethics approval
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Alex, D.M., Abraham Chandy, D., Hepzibah Christinal, A. et al. YSegNet: a novel deep learning network for kidney segmentation in 2D ultrasound images. Neural Comput & Applic 34, 22405–22416 (2022). https://doi.org/10.1007/s00521-022-07624-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-022-07624-4