Skip to main content
SpringerLink
Log in

A novel prostate segmentation method: triple fusion model with hybrid loss

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Early and rapid diagnosis of prostate cancer, the horsehead disease among men, has become increasingly important. Nowadays, many methods are used in the early diagnosis of prostate cancer. Compared to other imaging methods, magnetic resonance imaging (MRI) based on prostate gland imaging is preferred because angular imaging (axial, sagittal, and coronal) provides precise information. But diagnosing the disease from these MR images is time-consuming. For example, imaging differences between MR devices for prostate segmentation and inhomogeneous and inconsistent prostate appearance are significant challenges. Because of these segmentation difficulties, manual segmentation of prostate images is challenging. In recent years, computer-aided intelligent architectures (deep learning-based architecture) have been used to overcome the manual segmentation of prostate images. These architectures can now perform manual prostate segmentation in seconds that used to take days thanks to their end-to-end automatic deep convolutional neural networks (DCNN). Inspired by the studies mentioned above, this study proposes a novel DCNN approach for prostate segmentation by combining ResUnet 2D with residual blocks and Edge Attention Vnet 3D architectures. In addition, the weighted foal Twersky loss function, which was proposed for the first time, significantly increased the architecture's performance. Evaluation experiments were performed on the MICCAI 2012 Prostate Segmentation Challenge Dataset (PROMISE12) and the NCI-ISBI 2013(NCI_ISBI-13) Prostate Segmentation Challenge Dataset. As a result of the tests performed, Dice scores of 91.92 and 91.15% in the whole prostate volume were obtained in the Promise 12 and NCI_ISBI 13 datasets, respectively. Comparative analyses show that the advantages and robustness of our method are superior to the state-of-the-art approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Abbreviations

MRI:

Magnetic Resonance Imaging

DCNN:

Deep Convolutional Neural Network

ET-Vnet:

Edge Attention Volumetric Convolutional Neural Network

Promise 12:

MICCAI 2012 Prostate Segmentation Challenge Dataset

WFTL:

Weighted Focal Twersky Loss Function

ResUnet:

Residual Unet

ABD:

Average Boundary Distance

95% HD:

95% Hausdorff Distance

DSC:

Dice Coefficient

RVD:

Relative Volume Difference

References

  1. Siegel RL, Miller KD, Jemal A (2021) Cancer statistics. CA Cancer J Clin 2021(69):7–33. https://doi.org/10.3322/caac.21654

    Article  Google Scholar 

  2. Sharp G, Fritscher KD, Pekar V, Peroni M, Shusharina N, Veeraraghavan H, Yang J (2014) Vision 20/20: perspectives on automated image segmentation for radiotherapy. Med Phys. 41(5):050902. https://doi.org/10.1118/1.4871620

    Article  Google Scholar 

  3. Lemaitre G, Marti R, Rastgoo M, Meriaudeau F (2017) Computer-aided detection for prostate cancer detection based on multi-parametric magnetic resonance imaging. Annu Int Conf IEEE Eng Med Biol Soc 2017:3138–3141. https://doi.org/10.1109/EMBC.2017.8037522

    Article  Google Scholar 

  4. Shen D, Zhan Y, Davatzikos C (2003) Segmentation of prostate boundaries from ultrasound images using statistical shape model. IEEE Transactions on Medical Imaging 22(4):539–551. https://doi.org/10.1109/TMI.2003.809057

    Article  Google Scholar 

  5. Guo Y, Gao Y, Shen D (2016) Deformable mr prostate segmentation via deep feature learning and sparse patch matching. IEEE Trans Med Imaging. 35(4):1077–89. https://doi.org/10.1109/TMI.2015.2508280

    Article  Google Scholar 

  6. Ghose S, Oliver A, Martí R, Lladó X, Vilanova JC, Freixenet J, Mitra J, Sidibé D, Meriaudeau F (2012) A survey of prostate segmentation methodologies in ultrasound, magnetic resonance and computed tomography images. Comput Methods Programs Biomed 108(1):262–87. https://doi.org/10.1016/j.cmpb.2012.04.006

    Article  Google Scholar 

  7. Litjens G, Toth R, van de Ven W, Hoeks C, Kerkstra S, van Ginneken B et al (2014) Evaluation of prostate segmentation algorithms for MRI: the PROMISE12 challenge. Med Image Anal. 18(2):359–73. https://doi.org/10.1016/j.media.2013.12.002

    Article  Google Scholar 

  8. Skrobek D, Krzywanski J, Sosnowski M, Kulakowska A, Zylka A, Grabowska K, Ciesielska K, Nowak W (2020) Prediction of sorption processes using the deep learning methods (long short-term memory). Energies 13:6601. https://doi.org/10.3390/en13246601

    Article  Google Scholar 

  9. Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 1997(9):1735–1780

    Article  Google Scholar 

  10. Daldal N, Şengür A, Polat K, Cömert Z (2020) A novel demodulation system for baseband digital modulation signals based on the deep long short-term memory model. Appl Acoust 166:107346. https://doi.org/10.1016/j.apacoust.2020.107346

    Article  Google Scholar 

  11. Yu L, Yang X, Chen H, Qin J, Heng PA (2017) Volumetric ConvNets with mixed residual connections for automated prostate segmentation from 3D MR images. In: Thirty-First AAAI Conference on Artificial Intelligence (AAAI). 2017; pp.66–72

  12. Brosch T, Peters J, Groth A, Stehle T, Weese J (2018) Deep learning-based boundary detection for model-based segmentation with application to MR prostate segmentation. In: Medical Image Computing and Computer-Assisted Intervention (MICCAI). pp.515–522. https://doi.org/10.1007/978-3-030-00937-3_59

  13. Zhang Y, Wu J, Chen W, Chen Y, Tang, X (2019) Prostate segmentation using Z-Net. In: 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019). pp. 11–14. doi: https://doi.org/10.1109/ISBI.2019.8759554

  14. Liu X, Xie L, Wang Y, Zou J, Xıong J, Ying Z et al (2021) Privacy and security issues in deep learning: a survey. IEEE Access 9:4566–4593

    Article  Google Scholar 

  15. Oseni A, Moustafa N, Janicke H, Liu P, Tari Z, Vasilakos A (2021) Security and privacy for artificial intelligence: opportunities and challenges. arXiv:2102.04661v1 [cs.CR] 9 Feb 2021

  16. Zhou W, Tao X, Wei Z, Lin L (2020) Automatic segmentation of 3D prostate MR images with iterative localization refinement. Digital Signal Process. https://doi.org/10.1016/j.dsp.2019.102649

    Article  Google Scholar 

  17. Mun J, Jang W, Sung DJ, Kim C (2017) Comparison of objective functions in CNN-based prostate magnetic resonance image segmentation. In: 2017 IEEE International Conference on Image Processing (ICIP).pp. 3859–3863. doi: https://doi.org/10.1109/ICIP.2017.8297005

  18. He B, Xiao D, Hu Q, Jia F (2018) Automatic magnetic resonance image prostate segmentation based on adaptive feature learning probability boosting tree initialization and CNN-ASM refinement. IEEE Access 6:2005–2015. https://doi.org/10.1109/ACCESS.2017.2781278

    Article  Google Scholar 

  19. Tang Z, Wang M, Song Z (2018) Rotationally resliced 3D prostate segmentation of MR images using Bhattacharyya similarity and active band theory. Phys Med 54:56–65. https://doi.org/10.1016/j.ejmp.2018.09.005

    Article  Google Scholar 

  20. Meyer A, Mehrtash A, Rak M, Schindele D, Schostak M, Tempany C et al. (2018) Automatic high resolution segmentation of the prostate from multi-planar MRI. In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018). 2018; pp. 177–181, doi: https://doi.org/10.1109/ISBI.2018.8363549

  21. Jin Y, Yang G, Fang Y, Li R, Xu X, Liu Y, Lai X (2021) 3D PBV-Net: AN automated prostate MRI data segmentation method. Comput Biol Med 128:2021. https://doi.org/10.1016/j.compbiomed.2020.104160

    Article  Google Scholar 

  22. Ocal H, Barisci N (2019) Prostate segmentation via fusing the nested-V-net3d and V-net2d. In: 2019 1st International Informatics and Software Engineering Conference (UBMYK), 2019; pp. 1–4, doi: https://doi.org/10.1109/UBMYK48245.2019.8965456

  23. Ocal H, Barisci N (2022) Prostate segmentation via dynamic fusion model. Arab J Sci Eng. https://doi.org/10.1007/s13369-021-06502-w

    Article  Google Scholar 

  24. Bloch N, Rusu M, Huisman H, Futterer J (2013) NCI-ISBI 2013 challenge: automated segmentation of prostate structures, In: International Symposium on Biomedical Imaging (ISBI), 2013; http://dx.doi.org/https://doi.org/10.7937/K9/TCIA.2015.zF0vlOPv

  25. Zhang Z, Fu H, Dai H, Shen J, Pang Y, Shao L (2019) ET-Net: a generic edge-aTtention guidance network for medical image segmentation. MICCAI 2019

  26. Jungiang ET-Vnet 3D model. https://github.com/junqiangchen/VNetFamily/blob/master/assests/ETVNet.PNG.Accessed 11 September 2021

  27. Glorot X, Bengio Y (2012) Understanding the difficulty of training deep feedforward neural networks. Aistats 9(2010):249–256

    Google Scholar 

  28. Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. In: International Conference on Learning Representations (ICLR). 2015; pp.1–11

  29. Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. 2015. arXiv preprint https://arxiv.org/abs/1502.03167

  30. Ba JL, Kiros JR, Hinton GE (2016) Layer normalization. arXiv preprint https://arxiv.org/abs/1607.06450

  31. Ulyanov D, Vedaldi A, Lempitsky V(2016) Instance normalization: the missing ingredient for fast stylization. arXiv preprint https://arxiv.org/abs/1607.08022

  32. Zhu Q, Du B, Yan P (2019) Boundary-weighted domain adaptive neural network for prostate MR image segmentation. IEEE Trans Med Imaging (TMI) 2019:1–11

    Google Scholar 

  33. Yu L, Yang X, Chen H, Qin J, Heng PA (2017) Volumetric ConvNetswith mixed residual connections for automated prostate segmentation from 3D MR images. In: Thirty-First AAAI Conference on Artificial Intelligence (AAAI). pp.66–72.

  34. Lin T, Goyal P, Girshick R, He K, Dollár P (2020) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell 42(2):318–327. https://doi.org/10.1109/TPAMI.2018.2858826

    Article  Google Scholar 

  35. Wang P, Chung ACS (2018) Focal dice loss and image dilation for brain tumor segmentation. in: International Workshop on Deep Learning in Medical Image Analysis. pp.119–127

  36. Abraham N, Khan NM (2019) A novel focal Tversky loss function with improved attention U-net for lesion segmentation. In: 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019), IEEE, pp. 683–687

  37. Jiang H, Shi T, Bai Z, Huang L (2019) AHCNet: an application of attention mechanism and hybrid connection for liver tumor segmentation in CT volumes. IEEE Access 7:24898–24909. https://doi.org/10.1109/ACCESS.2019.2899608

    Article  Google Scholar 

  38. Milletari F, Navab N, Ahmadi SA (2016) V-net: fully convolutional neural networks for volumetric medical image segmentation. In: International Conference on 3D Vision (3DV). pp.565–571

  39. Drozdzal M, Chartrand G, Vorontsov E, Shakeri M, Jorio LD, Tang A, Romero A, Bengio Y, Pal C, Kadoury S (2018) Learning normalized inputs for iterative estimation in medical image segmentation. Med Image Anal 44(2018):1–13

    Article  Google Scholar 

  40. Zhu Q, Du B, Wu J, Yan P (2018) A deep learning health data analysis approach: automatic 3D prostate MR segmentation with densely-connected volumetric ConvNets. In: 2018 International Joint Conference on Neural Networks (IJCNN), 2018, pp. 1-6. doi: https://doi.org/10.1109/IJCNN.2018.8489136

  41. Jia H, Song Y, Huang H, Cai W, Xia Y (2019) HD-Net: hybrid discriminative network for prostate segmentation in MR images. In: Shen D et al (eds) Medical image computing and computer-assisted intervention – MICCAI 2019. MICCAI 2019. Lecture notes in computer science. Springer, Cham

    Google Scholar 

  42. Peng C, Zhang X, Yu G, Luo G, Sun J (2017) Large kernel matters – improve semantic segmentation by global convolutional network. IEEE Conf Comput Vis Pattern Recognit (CVPR) 2017:1743–1751

    Google Scholar 

  43. Cicek O, Abdulkadir A, Lienkamp S, Brox T, Ronneberger O (2016) 3D U-net: learning dense volumet-ric segmentation from sparse annotation. Med Image Comput Comput Assist Interv MICCAI. https://doi.org/10.1007/978-3-319-46723-8_49

    Article  Google Scholar 

  44. Chen H, Dou Q, Yu L, Qin H, Heng PA (2018) VoxResNet: deep voxelwise residual networks for brain segmentation from 3D MR images. Neuroimage 170(2018):446–455. https://doi.org/10.1016/j.neuroimage.2017.04.041

    Article  Google Scholar 

  45. Jia H, Xia Y, Song Y, Zhang D, Huang H, Zhang Y, Cai W (2020) 3D APA-Net: 3D adversarial pyramid anisotropic convolutional network for prostate segmentation in MR images. IEEE Transactions on Medical Imaging. 39(2):447–457. https://doi.org/10.1109/TMI.2019.2928056

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Engineering/School of Natural and Applied Sciences, Gazi University, Ankara, Turkey

    Hakan Ocal

  2. Computer Engineering/Technology Faculty, Gazi University, Ankara, Turkey

    Necaattin Barisci

Authors
  1. Hakan Ocal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Necaattin Barisci
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

HO and NB were involved in conceptualization, validation, and writing—review and editing. HO was involved in methodology, software, data curation, and writing—original draft preparation. NB was involved in supervision, visualization, and investigation. All authors have read and agreed to the published version of the manuscript.

Corresponding author

Correspondence to Hakan Ocal.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ocal, H., Barisci, N. A novel prostate segmentation method: triple fusion model with hybrid loss. Neural Comput & Applic 34, 13559–13574 (2022). https://doi.org/10.1007/s00521-022-07188-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07188-3

Keywords

Search

Navigation