Skip to main content
SpringerLink
Log in

Multi-Scale and Spatial Information Extraction for Kidney Tumor Segmentation: A Contextual Deformable Attention and Edge-Enhanced U-Net

  • Published:
Journal of Imaging Informatics in Medicine Aims and scope Submit manuscript

Abstract

Kidney tumor segmentation is a difficult task because of the complex spatial and volumetric information present in medical images. Recent advances in deep convolutional neural networks (DCNNs) have improved tumor segmentation accuracy. However, the practical usability of current CNN-based networks is constrained by their high computational complexity. Additionally, these techniques often struggle to make adaptive modifications based on the structure of the tumors, which can lead to blurred edges in segmentation results. A lightweight architecture called the contextual deformable attention and edge-enhanced U-Net (CDA2E-Net) for high-accuracy pixel-level kidney tumor segmentation is proposed to address these challenges. Rather than using complex deep encoders, the approach includes a lightweight depthwise dilated ShuffleNetV2 (LDS-Net) encoder integrated into the CDA2E-Net framework. The proposed method also contains a multiscale attention feature pyramid pooling (MAF2P) module that improves the ability of multiscale features to adapt to various tumor shapes. Finally, an edge-enhanced loss function is introduced to guide the CDA2E-Net to concentrate on tumor edge information. The CDA2E-Net is evaluated on the KiTS19 and KiTS21 datasets, and the results demonstrate its superiority over existing approaches in terms of Hausdorff distance (HD), intersection over union (IoU), and dice coefficient (DSC) metrics.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Miller KD, Fidler‐Benaoudia M, Keegan TH, Hipp HS, Jemal A, Siegel RL: Cancer statistics for adolescents and young adults, 2020. CA: a cancer journal for clinicians, 70(6):443–459 (2020)

  2. American Cancer Society. Key statistics for kidney cancer. https://www.cancer.org/cancer/kidney-cancer/about/key-statistics.html. Accessed February 23, (2023)

  3. Qayyum A, Lalande A, Meriaudeau F: Automatic segmentation of tumors and affected organs in the abdomen using a 3D hybrid model for computed tomography imaging. Computers in Biology and Medicine, 127:104097 (2020)

    Article  PubMed  Google Scholar 

  4. Yin S, Peng Q, Li H, Zhang Z, You X, Fischer K, Fan Y: Automatic kidney segmentation in ultrasound images using subsequent boundary distance regression and pixelwise classification networks. Medical image analysis, 60:101602 (2020)

    Article  PubMed  Google Scholar 

  5. Sharma K, Rupprecht C, Caroli A, Aparicio MC, Remuzzi A, Baust M, Navab N: Automatic segmentation of kidneys using deep learning for total kidney volume quantification in autosomal dominant polycystic kidney disease. Scientific reports, 7(1):2049 (2017)

    Article  ADS  PubMed  PubMed Central  Google Scholar 

  6. Jin C, Shi F, Xiang D, Jiang X, Zhang B, Wang X, Chen X: 3D fast automatic segmentation of kidney based on modified AAM and random forest. IEEE transactions on medical imaging, 35(6):1395–1407 (2016)

    Article  PubMed  Google Scholar 

  7. Heller N, Isensee F, Maier-Hein KH, Hou X, Xie C, Li F, Weight C: The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: Results of the KiTS19 challenge. Medical image analysis, 67:101821 (2021)

    Article  PubMed  Google Scholar 

  8. Marie F, Corbat L,Chaussy Y, Delavelle T, Henriet J, Lapayre JC: Segmentation of deformed kidneys and nephroblastoma using case-based reasoning and convolutional neural network. Expert Systems with Applications, 127:282–294 (2019)

    Article  Google Scholar 

  9. Das A, Sabut SK: Kernelized fuzzy C-means clustering with adaptive thresholding for segmenting liver tumors. Procedia Computer Science, 92:389–395 (2016)

    Article  Google Scholar 

  10. Skalski A, Jakubowski J, Drewniak T: Kidney tumor segmentation and detection on computed tomography data. In 2016 IEEE International Conference on Imaging Systems and Techniques (IST) (pp. 238–242). IEEE (2016)

  11. Fu Y, Lei Y, Wang T, Curran WJ, Liu T, Yang X: A review of deep learning based methods for medical image multi-organ segmentation. PhysicaMedica, 85:107–122 (2021)

    Google Scholar 

  12. Guo Z, Li X, Huang H, Guo N, Li Q: Deep learning-based image segmentation on multimodal medical imaging. IEEE Transactions on Radiation and Plasma Medical Sciences, 3(2):162–169 (2019)

    Article  PubMed  PubMed Central  Google Scholar 

  13. Song LI, Geoffrey KF, Kaijian HE: Bottleneck feature supervised U-Net for pixel-wise liver and tumor segmentation. Expert Systems with Applications, 145:113131 (2020)

    Article  Google Scholar 

  14. Chen X, Pan L: A survey of graph cuts/graph search based medical image segmentation. IEEE reviews in biomedical engineering, 11:112–124 (2018)

    Article  PubMed  Google Scholar 

  15. Valanarasu JMJ, Oza P, Hacihaliloglu I, Patel VM: Medical transformer: Gated axial-attention for medical image segmentation. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part I 24 (pp. 36–46). Springer International Publishing (2021)

  16. Ronneberger O, Fischer P, Brox T: U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5–9, 2015, Proceedings, Part III 18 (pp. 234–241). Springer International Publishing (2015)

  17. Milletari F, Navab N, Ahmadi SA: V-net: Fully convolutional neural networks for volumetric medical image segmentation. In 2016 fourth international conference on 3D vision (3DV) (pp. 565–571). Ieee (2016)

  18. Çiçek Ö, Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O: 3D U-Net: learning dense volumetric segmentation from sparse annotation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2016: 19th International Conference, Athens, Greece, October 17–21, 2016, Proceedings, Part II 19 (pp. 424–432). Springer International Publishing (2016)

  19. Alex DM, Abraham Chandy D: Investigations on performances of pre-trained U-Net models for 2D ultrasound kidney image segmentation. In Emerging Technologies in Computing: Third EAI International Conference, iCETiC 2020, London, UK, August 19–20, 2020, Proceedings 3 (pp. 185–195). Springer International Publishing (2020)

  20. Zhao W, Jiang D, Queralta JP, Westerlund T: MSS U-Net: 3D segmentation of kidneys and tumors from CT images with a multi-scale supervised U-Net. Informatics in Medicine Unlocked, 19:100357 (2020)

    Article  Google Scholar 

  21. Lin Z, Cui Y, Liu J, Sun Z, Ma S, Zhang X, Wang X: Automated segmentation of kidney and renal mass and automated detection of renal mass in CT urography using 3D U-Net-based deep convolutional neural network. European Radiology. 31:5021–31 (2021)

    Article  PubMed  Google Scholar 

  22. Lin C, Fu R, Zheng S: Kidney and kidney tumor segmentation using a two-stage cascade framework. InKidney and Kidney Tumor Segmentation: MICCAI 2021 Challenge, KiTS 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, September 27, 2021, Proceedings (pp. 59–70). Cham: Springer International Publishing (2022)

  23. Isensee F, Petersen J, Klein A, Zimmerer D, Jaeger PF, Kohl S, Wasserthal J, Koehler G, Norajitra T, Wirkert S, Maier-Hein KH: nnu-net: Self-adapting framework for u-net-based medical image segmentation. arXiv preprint arXiv:1809.10486 (2018)

  24. Zhao W, Jiang D, Queralta JP, Westerlund T: MSS U-Net: 3D segmentation of kidneys and tumors from CT images with a multi-scale supervised U-Net. Informatics in Medicine Unlocked. 19:100357 (2020)

    Article  Google Scholar 

  25. ShamijaSherryl RMR, Jaya T: Semantic Multiclass Segmentation and Classification of Kidney Lesions. Neural Processing Letters. 55(2):1975–92 (2023)

    Article  Google Scholar 

  26. Xuan P, Cui H, Zhang H, Zhang T, Wang L, Nakaguchi T, Duh HB: Dynamic graph convolutional autoencoder with node-attribute-wise attention for kidney and tumor segmentation from CT volumes. Knowledge-Based Systems. 236:107360 (2022)

    Article  Google Scholar 

  27. Shen Z, Yang H, Zhang Z, Zheng S: Automated kidney tumor segmentation with convolution and transformer network. InKidney and Kidney Tumor Segmentation: MICCAI 2021 Challenge, KiTS 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, September 27, 2021, Proceedings (pp. 1–12). Cham: Springer International Publishing (2022)

  28. Li J, Wang W, Chen C, Zhang T, Zha S, Wang J, Yu H: TransBTSV2: Towards Better and More Efficient Volumetric Segmentation of Medical Images. arXiv preprint arXiv:2201.12785 (2022)

  29. Ruan Y, Li D, Marshall H, Miao T, Cossetto T, Chan I, Daher O, Accorsi F, Goela A, Li S: MB-FSGAN: Joint segmentation and quantification of kidney tumor on CT by the multi-branch feature sharing generative adversarial network. Medical image analysis. 64:101721 (2020)

    Article  PubMed  Google Scholar 

  30. Ma N, Zhang X, Zheng HT, Sun J: Shufflenet v2: Practical guidelines for efficient cnn architecture design. InProceedings of the European conference on computer vision (ECCV) (pp. 116–131) (2018)

  31. Mehta S, Rastegari M, Shapiro L, Hajishirzi H: Espnetv2: A light-weight, power efficient, and general purpose convolutional neural network. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition. (pp. 9190–9200) (2019)

  32. KiTS19 dataset: https://kits19.grand-challenge.org/

  33. KiTS21 dataset: https://kits21.kits-challenge.org/

  34. Li D, Chen Z, Hassan H, Xie W, Huang B: A Cascaded 3D Segmentation Model for Renal Enhanced CT Images. InInternational Challenge on Kidney and Kidney Tumor Segmentation (pp. 123–128). Cham: Springer International Publishing (2021)

  35. George Y: A coarse-to-fine 3D U-Net network for semantic segmentation of kidney CT scans. InInternational Challenge on Kidney and Kidney Tumor Segmentation (pp. 137–142). Cham: Springer International Publishing (2021)

  36. Guo J, Zeng W, Yu S, Xiao J: RAU-Net: U-Net model based on residual and attention for kidney and kidney tumor segmentation. In2021 IEEE international conference on consumer electronics and computer engineering (ICCECE) (pp. 353–356). IEEE (2021)

  37. Türk F, Lüy M, Barışçı N: Kidney and renal tumor segmentation using a hybrid V-Net-Based model. Mathematics. 8(10):1772 (2020)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electronics & Communication Engineering, Ponjesly College of Engineering, Nagercoil, Tamil Nadu, India

    Shamija Sherryl R. M. R.

  2. Department of Electronics & Communication Engineering, Saveetha Engineering College, Thandalam, India

    Jaya T.

Authors
  1. Shamija Sherryl R. M. R.
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jaya T.
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shamija Sherryl R. M. R..

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

R., S.S.R.M., T., J. Multi-Scale and Spatial Information Extraction for Kidney Tumor Segmentation: A Contextual Deformable Attention and Edge-Enhanced U-Net. J Digit Imaging. Inform. med. 37, 151–166 (2024). https://doi.org/10.1007/s10278-023-00900-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10278-023-00900-2

Keywords

Search

Navigation