Skip to main content
SpringerLink
Log in

IRDNU-Net: Inception residual dense nested u-net for brain tumor segmentation

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Accurate segmentation of brain tumors is an essential stage in treatment planning. Fully convolutional neural networks, specifically the encoder-decoder architectures such as U-net, have proven successful in medical image segmentation. However, segmenting brain tumors with complex structure requires building a deeper and wider model which increases the computational complexity and may also cause the gradient vanishing problem. Therefore, in this work, we propose a novel encoder-decoder architecture, called Inception Residual Dense Nested U-Net (IRDNU-Net). In this model carefully designed Residual and Inception modules are used in place of standard U-Net convolutional layers to increase the width of the model without increasing the computational complexity. Additionally, in the proposed architecture, the encoder and decoder are connected via a sequence of Inception-Residual densely nested paths to extract more information and increase the depth of the network while reducing the number of network parameters. The proposed segmentation architecture was evaluated on two large brain tumor segmentation benchmark datasets; the BraTS’2019 and BraTS’2020. It achieved a mean Dice similarity coefficient of 0.888 for the whole tumor region, 0.876 for the core region, and 0.819 for the enhancement region. Experimental results illuminate that IRDNU-Net outperforms U-Net by 1.8%, 11.4%, and 11.7% in the whole tumor, core tumor, and enhancing tumor, respectively. Moreover, the IRDNU-Net enables a great improvement on the accuracy compared to comparative approaches, and its ability in the face of challenging problems, such as small tumor regions, with fewer parameters.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. https://ipp.cbica.upenn.edu

  2. https://www.cbica.upenn.edu/BraTS19/lboardTraining.html

  3. https://www.cbica.upenn.edu/BraTS19/lboardValidation.html

References

  1. Aboelenein NM, Songhao P, Koubaa A, Noor A, Afifi A (2020) HTTU-Net: hybrid two track U-Net for automatic brain tumor segmentation. IEEE Access 8:101406–101415

    Article  Google Scholar 

  2. Ahmad P, Qamar S, Hashemi S R, Shen L (2019) Hybrid labels for brain tumor segmentation. In: International MICCAI brainlesion workshop, pp 158–166

  3. Bakas S, Reyes M, Jakab A, Bauer S, Rempfler M, Crimi A, Eaton-Rosen Z (2018) Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment, and overall survival prediction in the BRATS challenge. arXiv preprint arXiv:1811.02629

  4. Bauer S, Wiest R, Nolte L P, Reyes M (2013) A survey of MRI-based medical image analysis for brain tumor studies. Physics in Medicine and Biology, 58

  5. Cahall DE, Rasool G, Bouaynaya N C, Fathallah-Shaykh HM (2019) Inception modules enhance brain tumor segmentation. Front Comput Neurosci 13:44

    Article  Google Scholar 

  6. Chandra S, Vakalopoulou M, Fidon L, Battistella E, Estienne T, Sun R, Paragios N (2018) Context aware 3D CNNs for brain tumor segmentation. In: International MICCAI brainlesion workshop. Springer, Berlin, pp 299–310

  7. Cheng X, Jiang Z, Sun Q, Zhang J (2019) Memory-efficient cascade 3D U-Net for brain tumor segmentation. In: International MICCAI brainlesion workshop. Springer, Berlin, pp 242–253

  8. Chen W, Liu B, Peng S, Sun J, Qiao X (2018) S3D-UNet: Separable 3D U-Net for brain tumor segmentation. In: International MICCAI brainlesion workshop. Springer, Berlin, pp 358–368

  9. Da K (2014) A method for stochastic optimization. arXiv preprint arXiv:1412.6980

  10. Dargan S, Kumar M, Ayyagari MR, Kumar G (2019) A survey of deep learning and its applications: A new paradigm to machine learning. Archives of Computational Methods in Engineering,, pp 1–22

  11. Dataset:CBICA. https://www.med.upenn.edu/cbica/brats2019/data.html

  12. Dolz J, Gopinath K, Yuan J, Lombaert H, Desrosiers C, Ayed I B (2018) HyperDense-Net: A hyper-densely connected CNN for multi-modal image segmentation. IEEE Trans Med Imaging 38(5):1116–1126

    Article  Google Scholar 

  13. Dong H, Yang G, Liu F, Mo Y, Guo Y (2017) Automatic brain tumor detection and segmentation using u-net based fully convolutional networks. In: Annual conference on medical image understanding and analysis. Springer, Berlin, pp 506–517

  14. Drozdzal M, Vorontsov E, Chartrand G, Kadoury S, Pal C (2016) The importance of skip connections in biomedical image segmentation. In: Deep learning and data labeling for medical applications. Springer, Berlin, pp 179–187

  15. Goodfellow I, Bengio Y, Courville A, Bengio Y (2016) Deep learning 1-2. MIT press, Cambridge

    MATH  Google Scholar 

  16. Havaei M, Davy A, Warde-Farley D, Biard A, Courville A, Bengio Y, Larochelle H (2017) Brain tumor segmentation with deep neural networks. Med Image Anal 35:18–31

    Article  Google Scholar 

  17. He H, Zhang C, Chen J, Geng R, Chen L, Liang Y, Xu Y (2021) A hybrid-attention nested UNet for Nuclear segmentation in histopathological images. Front Mol Biosci 8:6

    Google Scholar 

  18. Hu K, Gan Q, Zhang Y, Deng S, Xiao F, Huang W, Gao X (2019) Brain tumor segmentation using multi-cascaded convolutional neural networks and conditional random field. IEEE Access 7:92615–92629

    Article  Google Scholar 

  19. Hu Y, Xia Y (2017) 3D deep neural network-based brain tumor segmentation using multimodality magnetic resonance sequences. In: International MICCAI brainlesion workshop. Springer, Berlin, pp 423–434

  20. Ibtehaz N, Rahman M S (2020) MultiResUNet: Rethinking the U-Net architecture for multimodal biomedical image segmentation. Neural Netw 121:74–87

    Article  Google Scholar 

  21. Işın A, Direkoǧlu C, Şah M (2016) Review of MRI-based brain tumor image segmentation using deep learning methods. Procedia Comput Sci 102:317–324

    Article  Google Scholar 

  22. Ioffe S, Szegedy C (2015) Batch normalization: Accelerating deep network training by reducing internal covariate shift. In: International conference on machine learning. PMLR, pp 448–456

  23. Ker J, Wang L, Rao J, Lim T (2017) Deep learning applications in medical image analysis. Ieee Access 6:9375–9389

    Article  Google Scholar 

  24. Kermi A, Mahmoudi I, Khadir MT (2018) Deep convolutional neural networks using U-Net for automatic brain tumor segmentation in multimodal MRI volumes. In: International MICCAI brainlesion workshop. Springer, Berlin, pp 37–48

  25. Kumar M, Gupta S, Kumar K, Sachdeva M (2020) Spreading of COVID-19 in India, Italy, Japan, Spain, UK, US: A prediction using ARIMA and LSTM model. Digit Gov: Res Prac 1(4):1–9

    Article  Google Scholar 

  26. Li H, Li A, Wang M (2019) A novel end-to-end brain tumor segmentation method using improved fully convolutional networks. Comput Biol Med 108:150–160

    Article  Google Scholar 

  27. Lin F, Wu Q, Liu J, Wang D, Kong X (2020) Path aggregation U-Net model for brain tumor segmentation. Multimedia Tools and Applications, pp 1–14

  28. Lou A, Guan S, Loew M H (2021) DC-UNet: Rethinking the U-Net architecture with dual channel efficient CNN for medical image segmentation. In: Medical imaging 2021: image processing 11596: 115962T, international society for optics and photonics

  29. Menze BH, Jakab A, Bauer S, Kalpathy-Cramer J, Farahani K, Kirby J, Van Leemput K (2014) The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans Med Imaging 34(10):1993–2024

    Article  Google Scholar 

  30. Miranda-Filho A, Piñeros M, Soerjomataram I, Deltour I, Bray F (2017) Cancers of the brain and CNS: global patterns and trends in incidence. Neuro-oncology 19(2):270–280

    Google Scholar 

  31. Olabarriaga SD, Smeulders AW (2001) Interaction in the segmentation of medical images: a survey. Med Image Anal 5(2):127–142

    Article  Google Scholar 

  32. Pereira S, Pinto A, Alves V, Silva C A (2016) Brain tumor segmentation using convolutional neural networks in MRI images. IEEE Trans Med Imaging 35(5):1240–1251

    Article  Google Scholar 

  33. Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 234–241

  34. Saouli R, Akil M, Kachouri R (2018) Fully automatic brain tumor segmentation using end-to-end incremental deep neural networks in MRI images. Comput Methods Prog Biomed 166:39–49

    Article  Google Scholar 

  35. Sudre C H, Li W, Vercauteren T, Ourselin S, Cardoso M J (2017) Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations. In: Deep learning in medical image analysis and multimodal learning for clinical decision support. Springer, Berlin, pp 240–248

  36. Szegedy C, Ioffe S, Vanhoucke V, Alemi A (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: Proceedings of the AAAI conference on artificial intelligence, vol 31, p 1

  37. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9

  38. Zhang J, Jiang Z, Dong J, Hou Y, Liu B (2020) Attention Gate ResU-Net for automatic MRI brain tumor segmentation. IEEE Access 8:58533–58545

    Article  Google Scholar 

  39. Zhao X, Wu Y, Song G, Li Z, Zhang Y, Fan Y (2018) A deep learning model integrating FCNNs and CRFs for brain tumor segmentation. Med Image Anal 43:98–111

    Article  Google Scholar 

  40. Zhou C, Ding C, Wang X, Lu Z, Tao D (2020) One-pass multi-task networks with cross-task guided attention for brain tumor segmentation. IEEE Trans Image Process 29:4516–4529

    Article  Google Scholar 

  41. Zhou Z, Siddiquee M M R, Tajbakhsh N, Liang J (2018) Unet++: A nested u-net architecture for medical image segmentation. In: Deep learning in medical image analysis and multimodal learning for clinical decision support. Springer, Berlin, pp 3–11

Download references

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Harbin Institute of Technology, Harbin, 150001, China

    Nagwa M. AboElenein & Piao Songhao

  2. Faculty of Computers and Information, Menoufia University, Menoufia, 32511, Egypt

    Nagwa M. AboElenein & Ahmed Afifi

  3. Department of Computer Science, College of Computer Science and Information Technology, King Faisal University, P.O. Box 400, Al-Ahsa, 31982, Saudi Arabia

    Ahmed Afifi

Authors
  1. Nagwa M. AboElenein
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Piao Songhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ahmed Afifi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Piao Songhao.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

AboElenein, N.M., Songhao, P. & Afifi, A. IRDNU-Net: Inception residual dense nested u-net for brain tumor segmentation. Multimed Tools Appl 81, 24041–24057 (2022). https://doi.org/10.1007/s11042-022-12586-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12586-9

Keywords

Search

Navigation