Skip to main content
Log in

YSegNet: a novel deep learning network for kidney segmentation in 2D ultrasound images

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

The prior step in most of the kidney related image analysis is precise and authentic kidney segmentation. Although many semi-automated kidney segmentation techniques for 2D ultrasound images have been proposed, only a minimal number of automated techniques were explored. Low contrast and variability in the shape of kidney poses a challenge for the same. In this paper, an YSegNet based on an encoder–decoder network combined with a boundary extraction network is presented. The proposed model and its variants have been experimented using a VGG-16 encoder from scratch and a pre-trained VGG-16 encoder. A dataset of 700 images were considered for experimentation, which is further augmented to increase the size of the dataset for better precision. The proposed network is compared with basic U-Net and similar competing deep learning networks. The segmented map is promising with an accuracy of 97.26%, DICE score of 0.97, specificity of 0.97 and sensitivity of 0.98, thereby confirming that the presented deep learning segmentation network can used in automated 2D ultrasound kidney image analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data Availability

The data supporting the findings of this work are available from the corresponding author on reasonable request.

References

  1. Sharma N, Aggarwal LM (2010) Automated medical image segmentation techniques. J Med Phys/Assoc Med Phys India 35:3. https://doi.org/10.4103/0971-6203.58777

    Article  Google Scholar 

  2. Kim T-Y, Son J, Kim K-G (2011) The recent progress in quantitative medical image analysis for computer aided diagnosis systems. Healthc Inform Res 17:143–149. https://doi.org/10.4258/hir.2011.17.3.143

    Article  Google Scholar 

  3. Deserno TM (2011) Fundamentals of medical image processing. In: Springer handbook of medical technology. Springer, pp 1139–1165

  4. Aggarwal P, Vig R, Bhadoria S, Dethe CG (2011) Role of segmentation in medical imaging: a comparative study. Int J Comput Appl 975:29. https://doi.org/10.5120/3525-4803

    Article  Google Scholar 

  5. An F-P, Liu J (2020) Medical image segmentation algorithm based on optimized convolutional neural network-adaptive dropout depth calculation. Complexity 2020:1645479. https://doi.org/10.1155/2020/1645479

    Article  Google Scholar 

  6. Ozmen CA, Akin D, Bilek SU et al (2010) Ultrasound as a diagnostic tool to differentiate acute from chronic renal failure. Clin Nephrol 74:46–52. https://doi.org/10.2379/CN106407

    Article  Google Scholar 

  7. Selby NM, Blankestijn PJ, Boor P et al (2018) Magnetic resonance imaging biomarkers for chronic kidney disease: a position paper from the European Cooperation in Science and Technology Action PARENCHIMA. Nephrol Dial Transplant 33:ii4–ii14. https://doi.org/10.1093/ndt/gfy152

    Article  Google Scholar 

  8. Torres HR, Queiros S, Morais P et al (2018) Kidney segmentation in ultrasound, magnetic resonance and computed tomography images: a systematic review. Comput Methods Programs Biomed 157:49–67. https://doi.org/10.1016/j.cmpb.2018.01.014

    Article  Google Scholar 

  9. Lento PH, Primack S (2008) Advances and utility of diagnostic ultrasound in musculoskeletal medicine. Curr Rev Musculoskelet Med 1:24–31. https://doi.org/10.1007/s12178-007-9002-3

    Article  Google Scholar 

  10. Cerrolaza JJ, Safdar N, Biggs E et al (2016) Renal segmentation from 3D ultrasound via fuzzy appearance models and patient-specific alpha shapes. IEEE Trans Med Imaging 35:2393–2402. https://doi.org/10.1109/TMI.2016.2572641

    Article  Google Scholar 

  11. Yang F, Qin W, Xie Y et al (2012) A shape-optimized framework for kidney segmentation in ultrasound images using NLTV denoising and DRLSE. Biomed Eng OnLine 11:82. https://doi.org/10.1186/1475-925X-11-82

    Article  Google Scholar 

  12. Wang H, Pulido JE, Song Y et al (2014) Segmentation of renal parenchymal area from ultrasoundl images using level set evolution. In: 2014 36th annual international conference of the IEEE engineering in medicine and biology society. pp 4703–4706

  13. Song Y, Wang H, Liu Y et al (2015) An improved level set method for segmentation of renal parenchymal area from ultrasound images. J Med Imaging Health Inform 5:1533–1536. https://doi.org/10.1166/jmihi.2015.1566

    Article  Google Scholar 

  14. Selvathi D, Bama S (2017) Phase based distance regularized level set for the segmentation of ultrasound kidney images. Pattern Recognit Lett 86:9–17. https://doi.org/10.1016/j.patrec.2016.12.002

    Article  Google Scholar 

  15. Li C, Xu C, Gui C, Fox MD (2010) Distance regularized level set evolution and its application to image segmentation. IEEE Trans Image Process 19:3243–3254. https://doi.org/10.1109/TIP.2010.2069690

    Article  MathSciNet  MATH  Google Scholar 

  16. Mendoza CS, Kang X, Safdar N et al (2013) Kidney segmentation in ultrasound via genetic initialization and active shape models with rotation correction. In: 2013 IEEE 10th international symposium on biomedical imaging. IEEE, pp 69–72

  17. Mendoza CS, Kang X, Safdar N, et al (2013) Automatic analysis of pediatric renal ultrasound using shape, anatomical and image acquisition priors. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 259–266

  18. Zheng Q, Warner S, Tasian G, Fan Y (2018) A dynamic graph cuts method with integrated multiple feature maps for segmenting kidneys in 2D ultrasound images. Acad Radiol 25:1136–1145. https://doi.org/10.1016/j.acra.2018.01.004

    Article  Google Scholar 

  19. Ravishankar H, Annangi P, Washburn M, Lanning J (2016) Automated kidney morphology measurements from ultrasound images using texture and edge analysis. In: Medical imaging 2016: ultrasonic imaging and tomography. International Society for Optics and Photonics, p 97901A

  20. Ravishankar H, Venkataramani R, Thiruvenkadam S et al (2017) Learning and incorporating shape models for semantic segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 203–211

  21. Yin S, Peng Q, Li H et al (2020) Automatic kidney segmentation in ultrasound images using subsequent boundary distance regression and pixelwise classification networks. Med Image Anal 60:101602. https://doi.org/10.1016/j.media.2019.101602

    Article  Google Scholar 

  22. Hesamian MH, Jia W, He X, Kennedy P (2019) Deep learning techniques for medical image segmentation: achievements and challenges. J Digit Imaging 32:582–596. https://doi.org/10.1007/s10278-019-00227-x

    Article  Google Scholar 

  23. Albawi S, Mohammed TA, Al-Zawi S (2017) Understanding of a convolutional neural network. In: 2017 international conference on engineering and technology (ICET). IEEE, pp 1–6

  24. Kattenborn T, Leitloff J, Schiefer F, Hinz S (2021) Review on Convolutional Neural Networks (CNN) in vegetation remote sensing. ISPRS J Photogramm Remote Sens 173:24–49

    Article  Google Scholar 

  25. Liu Y, Pu H, Sun D-W (2021) Efficient extraction of deep image features using convolutional neural network (CNN) for applications in detecting and analysing complex food matrices. Trends Food Sci Technol 113:193–204

    Article  Google Scholar 

  26. Commandeur F, Goeller M, Betancur J et al (2018) Deep learning for quantification of epicardial and thoracic adipose tissue from non-contrast CT. IEEE Trans Med Imaging 37:1835–1846. https://doi.org/10.1109/TMI.2018.2804799

    Article  Google Scholar 

  27. Yamashita R, Nishio M, Do RKG, Togashi K (2018) Convolutional neural networks: an overview and application in radiology. Insights Imaging 9:611–629. https://doi.org/10.1007/s13244-018-0639-9

    Article  Google Scholar 

  28. Bass V, Mateos J, Rosado-Mendez IM, Márquez J (2021) Ultrasound image segmentation methods: a review. AIP Publishing LLC, p 050018

  29. Shelhamer E, Long J, Darrell T (2017) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39:640–651. https://doi.org/10.1109/TPAMI.2016.2572683

    Article  Google Scholar 

  30. Wang J, Song L, Li Z et al (2021) End-to-end object detection with fully convolutional network, pp 15849–15858

  31. Harms J, Lei Y, Tian S et al (2021) Automatic delineation of cardiac substructures using a region-based fully convolutional network. Med Phys 48:2867–2876

    Article  Google Scholar 

  32. Batur Dinler Ö, Aydin N (2020) An optimal feature parameter set based on gated recurrent unit recurrent neural networks for speech segment detection. Appl Sci 10:1273

    Article  Google Scholar 

  33. Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: JMLR workshop and conference proceedings, pp 249–256

  34. Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9:1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735

    Article  Google Scholar 

  35. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  36. Liu H, Chen M, Zhao T, Liao W (2021) Besov function approximation and binary classification on low-dimensional manifolds using convolutional residual networks. PMLR, pp 6770–6780

  37. Shehab LH, Fahmy OM, Gasser SM, El-Mahallawy MS (2021) An efficient brain tumor image segmentation based on deep residual networks (ResNets). J King Saud Univ-Eng Sci 33:404–412

    Google Scholar 

  38. Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 234–241

  39. Xu F, Ma H, Sun J et al (2019) LSTM multi-modal UNet for brain tumor segmentation. IEEE, pp 236–240

  40. Xiao Z, Liu B, Geng L et al (2020) Segmentation of lung nodules using improved 3D-UNet neural network. Symmetry 12:1787

    Article  Google Scholar 

  41. Razzak MI, Naz S, Zaib A (2018) Deep learning for medical image processing: overview, challenges and the future. In: Classification in BioApps. Springer, pp 323–350

  42. Hochreiter S (1998) The vanishing gradient problem during learning recurrent neural nets and problem solutions. Int J Uncertain Fuzziness Knowl-Based Syst 6:107–116. https://doi.org/10.1142/S0218488598000094

    Article  MATH  Google Scholar 

  43. Liu L, Cheng J, Quan Q et al (2020) A survey on U-shaped networks in medical image segmentations. Neurocomputing 409:244–258. https://doi.org/10.1016/j.neucom.2020.05.070

    Article  Google Scholar 

  44. Alex DM, Chandy DA (2020) Investigations on performances of pre-trained U-Net models for 2D ultrasound kidney image segmentation. In: International conference for emerging technologies in computing. Springer, pp 185–195

  45. Yin S, Zhang Z, Li H et al (2019) Fully-automatic segmentation of kidneys in clinical ultrasound images using a boundary distance regression network. In: 2019 IEEE 16th international symposium on biomedical imaging (ISBI 2019). IEEE, pp 1741–1744

  46. Deng J, Dong W, Socher R et al (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. IEEE, pp 248–255

  47. Yu F, Koltun V (2016) Multi-scale context aggregation by dilated convolutions. CoRR abs/1511.07122. https://arxiv.org/abs/1511.07122v3

  48. Drozdzal M, Vorontsov E, Chartrand G et al (2016) The importance of skip connections in biomedical image segmentation. In: Deep learning and data labeling for medical applications. Springer, pp 179–187

  49. Tong T, Li G, Liu X, Gao Q (2017) Image super-resolution using dense skip connections. In: Proceedings of the IEEE international conference on computer vision, pp 4799–4807

  50. Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708

  51. Mikołajczyk A, Grochowski M (2018) Data augmentation for improving deep learning in image classification problem. In: 2018 international interdisciplinary PhD workshop (IIPhDW). IEEE, pp 117–122

  52. Kumar SN, Fred AL, Kumar HA, Varghese PS (2018) Performance metric evaluation of segmentation algorithms for gold standard medical images. In: Recent findings in intelligent computing techniques. Springer, pp 457–469

  53. Csurka G, Larlus D, Perronnin F, Meylan F (2013) What is a good evaluation measure for semantic segmentation? In: BMVC, p 2013

  54. Sokolova M, Japkowicz N, Szpakowicz S (2006) Beyond accuracy, F-score and ROC: a family of discriminant measures for performance evaluation. In: Australasian joint conference on artificial intelligence. Springer, pp 1015–1021

  55. Thanh DN, Prasath VS, Hien NN (2019) Melanoma skin cancer detection method based on adaptive principal curvature, colour normalisation and feature extraction with the ABCD Rule. J Digit Imaging. https://doi.org/10.1007/s10278-019-00316-x

    Article  Google Scholar 

  56. Thanh DN, Sergey D, Surya Prasath VB, Hai NH (2019) Blood vessels segmentation method for retinal fundus images based on adaptive principal curvature and image derivative operators. Int Arch Photogramm Remote Sens Spat Inf Sci. https://doi.org/10.5194/isprs-archives-XLII-2-W12-211-2019

    Article  Google Scholar 

  57. Thanh DNH, Erkan U, Prasath VS et al (2019) A skin lesion segmentation method for dermoscopic images based on adaptive thresholding with normalization of color models. In: 2019 6th international conference on electrical and electronics engineering (ICEEE). IEEE, pp 116–120

  58. Taha AA, Hanbury A (2015) Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool. BMC Med Imaging 15:29. https://doi.org/10.1186/s12880-015-0068-x

    Article  Google Scholar 

  59. Zhou Z, Siddiquee MMR, Tajbakhsh N, Liang J (2018) Unet++: a nested u-net architecture for medical image segmentation. In: Deep learning in medical image analysis and multimodal learning for clinical decision support. Springer, pp 3–11

  60. Jha D, Riegler MA, Johansen D et al (2020) DoubleU-Net: a deep convolutional neural network for medical image segmentation. In: 2020 IEEE 33rd international symposium on computer-based medical systems (CBMS), pp 558–564

Download references

Funding

The authors did not receive support from any organization for the submitted work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to D. Abraham Chandy.

Ethics declarations

Conflicts of interest

All authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Ethics approval

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alex, D.M., Abraham Chandy, D., Hepzibah Christinal, A. et al. YSegNet: a novel deep learning network for kidney segmentation in 2D ultrasound images. Neural Comput & Applic 34, 22405–22416 (2022). https://doi.org/10.1007/s00521-022-07624-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07624-4

Keywords

Navigation