Skip to main content

Fuzzy volumetric delineation of brain tumor and survival prediction

Abstract

A novel three-dimensional detailed delineation algorithm is introduced for Glioblastoma multiforme tumors in MRI. It efficiently delineates the whole tumor, enhancing core, edema and necrosis volumes using fuzzy connectivity and multi-thresholding, based on a single seed voxel. While the whole tumor volume delineation uses FLAIR and T2 MRI channels, the outlining of the enhancing core, necrosis and edema volumes employs the T1C channel. Discrete curve evolution is initially applied for multi-thresholding, to determine intervals around significant (visually critical) points, and a threshold is determined in each interval using bi-level Otsu’s method or Li and Lee’s entropy. This is followed by an interactive whole tumor volume delineation using FLAIR and T2 MRI sequences, requiring a single user-defined seed. An efficient and robust whole tumor extraction is executed using fuzzy connectedness and dynamic thresholding. Finally, the segmented whole tumor volume in T1C MRI channel is again subjected to multi-level segmentation, to delineate its sub-parts, encompassing enhancing core, necrosis and edema. This was followed by survival prediction of patients using the concept of habitats. Qualitative and quantitative evaluation, on FLAIR, T2 and T1C MR sequences of 29 GBM patients, establish its superiority over related methods, visually as well as in terms of Dice scores, Sensitivity and Hausdorff distance.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

References

  • Ahmed MN, Yamany S, Mohamed N, Farag A, Moriarty T (2002) A modified fuzzy C-mean algorithm for bias field estimation and segmentation of MRI data. IEEE Trans Med Imaging 21:193–199

    Google Scholar 

  • Ananthi VP, Balasubramaniam P, Kalaiselvi T (2016) A new fuzzy clustering algorithm for the segmentation of brain tumor. Soft Comput 20(12):4859–4879

    Google Scholar 

  • Bakas S, Akbari H, Sotiras A, Bilello M, Rozycki M, Kirby J, Freymann J, Farahani K, Davatzikos C (2017) Advancing the cancer genome atlas glioma MRI collections with expert segmentation labels and radiomic features. Nat Sci Data. https://doi.org/10.1038/sdata.2017.117

    Article  Google Scholar 

  • Bakas S, Banerjee S, Mitra S et al (2018) Identifying the best machine learning algorithms for brain tumor segmentation, progression assessment, and overall survival prediction in the BraTS challenge. arXiv preprint arXiv:1811.02629

  • Bakhshali MA (2017) Segmentation and enhancement of brain MR images using fuzzy clustering based on information theory. Soft Comput 21:6633–6640

    Google Scholar 

  • Banerjee S, Mitra S, Uma Shankar B (2016a) Single seed delineation of brain tumor using multi-thresholding. Inf Sci 330:88–103

    Google Scholar 

  • Banerjee S, Mitra S, Uma Shankar B, Hayashi Y (2016b) A novel GBM saliency detection model using multi-channel MRI. PLoS ONE 11(1):e0146388

    Google Scholar 

  • Banerjee S, Mitra S, Uma Shankar B (2017a) ROI segmentation from brain MR images with a fast multilevel thresholding. In: Proceedings of international conference on computer vision and image processing. Springer, pp 249–259

  • Banerjee S, Mitra S, Uma Shankar B (2017b) Synergetic neuro-fuzzy feature selection and classification of brain tumors. In: Proceedings of IEEE international conference on fuzzy systems (FUZZ-IEEE), pp 1–6

  • Banerjee S, Mitra S, Masulli F, Rovetta S (2018a) Brain tumor detection and classification from multi-sequence MRI: study using convnets. In: International MICCAI Brainlesion workshop. Springer, pp 170–179

  • Banerjee S, Mitra S, Uma Shankar B (2018b) Automated 3D segmentation of brain tumor using visual saliency. Inf Sci 424:337–353

    MathSciNet  Google Scholar 

  • Banerjee S, Mitra S, Uma Shankar B (2018c) Multi-planar spatial-ConvNet for segmentation and survival prediction in brain cancer. In: International MICCAI brainlesion workshop. Springer, pp 94–104

  • Boykov YY, Jolly MP (2001) Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images. In: Proceedings Eighth IEEE international conference on computer vision vol 1, pp 105–112

  • Chen Z, Qi Z, Meng F, Cui L, Shi Y (2015) Image segmentation via improving clustering algorithms with density and distance. Procedia Comput Sci 55:1015–1022

    Google Scholar 

  • Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M et al (2013) The cancer imaging archive (TCIA): maintaining and operating a public information repository. J Digit Imaging 26(6):1045–1057

    Google Scholar 

  • Fang L (2019) An image segmentation technique using nonsubsampled contourlet transform and active contours. Soft Comput 23(6):1823–1832

    Google Scholar 

  • Fedorov A, Beichel R, Kalpathy-Cramer J, Finet J, Fillion-Robin JC, Pujol S, Bauer C, Jennings D, Fennessy F, Sonka M, Buatti J, Aylward S, Miller J, Pieper S, Kikinis R (2012) 3D slicer as an image computing platform for the quantitative imaging network. Magn Reson Imaging 30:1323–41

    Google Scholar 

  • Gatenby R, Grove O, Gillies R (2013) Quantitative imaging in cancer evolution and ecology. Radiology 269:8–14

    Google Scholar 

  • Hamamci A, Kucuk N, Karaman K, Engin K, Unal G (2012) Tumor-cut: Segmentation of brain tumors on contrast enhanced MR images for radiosurgery applications. IEEE Trans Med Imaging 31(3):790–804

    Google Scholar 

  • Huang T, Yang G, Tang G (1979) A fast two-dimensional median filtering algorithm. IEEE Trans Signal Process 27(1):13–18

    Google Scholar 

  • Huttenlocher DP, Klanderman GA, Rucklidge WJ (1993) Comparing images using the Hausdorff distance. IEEE Trans Pattern Anal Mach Intell 15:850–863

    Google Scholar 

  • Li C, Lee C (1993) Minimum cross entropy thresholding. Pattern Recognit 26(4):617–625

    Google Scholar 

  • Menze B, Jakab A et al (2015) The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans Med Imaging 34(10):1993–2024

    Google Scholar 

  • Mitra S, Uma Shankar B (2015) Medical image analysis for cancer management in natural computing framework. Inf Sci 306:111–131

    Google Scholar 

  • Mitra S, Banerjee S, Hayashi Y (2017) Volumetric brain tumour detection from MRI using visual saliency. PLoS ONE 12:1–14

    Google Scholar 

  • Ng H, Ong S, Foong K, Goh PS, Nowinski W (2006) Medical image segmentation using K-means clustering and improved watershed algorithm. In: Proceedings of the IEEE Southwest symposium on image analysis and interpretation, pp 61 – 65

  • Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybernet 9(1):62–66

    Google Scholar 

  • Pedano N, Flanders A, Scarpace L, et al. (2016) Radiology data from the cancer genome atlas low grade glioma [TCGA-LGG] collection. The Cancer Imaging Archive https://wiki.cancerimagingarchive.net/display/Public/TCGA-LGG

  • Pham DL, Xu C, Prince J (2000) A survey of current methods in medical image segmentation. Annu Rev Biomed Eng 2:315–337

    Google Scholar 

  • Ray S, Turi RH (1999) Determination of number of clusters in K-means clustering and application in colour image segmentation. In: Proceedings of the 4th international conference on advances in pattern recognition and digital techniques (ICAPRDT’99), vol 1, pp 137–143

  • Rodrguez-Mndez IA, Urea R, Herrera-Viedma E (2019) Fuzzy clustering approach for brain tumor tissue segmentation in magnetic resonance images. Soft Comput 23(20):10105–10117

    Google Scholar 

  • Saha PK, Udupa JK (2001) Fuzzy connected object delineation. Comput Vis Image Underst 83(3):275–295

    MATH  Google Scholar 

  • Scarpace L, Mikkelsen T, Cha S, Rao S, Tekchandani S, Gutman D, Saltz J, Erickson B, Pedano N, Flanders A, et al. (2016) Radiology data from the cancer genome atlas glioblastoma multiforme [TCGA-GBM] collection. The Cancer Imaging Archive. https://wiki.cancerimagingarchive.net/display/Public/TCGA-GBM

  • Selvakumar J, Lakshmi A, Arivoli T (2012) Brain tumor segmentation and its area calculation in brain MR images using K-mean clustering and fuzzy C-mean algorithm. In: IEEE-international conference on advances in engineering, science and management (ICAESM-2012), pp 186–190

  • Udupa JK, Samarasekera S (1996) Fuzzy connectedness and object definition: theory, algorithms, and applications in image segmentation. Graph Models Image Process 58(3):246–261. https://doi.org/10.1006/gmip.1996.0021

    Article  Google Scholar 

  • Vezhnevets V, Konouchine V (2005) Growcut–Interactive multi-label N-D image segmentation by cellular automata. In: Proceedings of Graphicon, vol 1. http://www.graphicon.ru/oldgr/en/publications/text/gc2005vk.pdf. Accessed 30 Jan 2017

  • Wirjadi O (2007) Survey of 3D image segmentation methods. Technical Report 123, Fraunhofer (ITWM). http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:hbz:386-kluedo-15457. Accessed 30 Jan 2017

  • Yang Y, Huang S (2007) Image segmentation by fuzzy C-means clustering algorithm with a novel penalty term. Comput Artif Intell 26(1):17–31

    MATH  Google Scholar 

  • Yushkevich PA, Piven J, Hazlett HC, Smith RG, Ho S, Gee JC, Gerig G (2006) User-guided 3D zctive contour segmentation of anatomical structures: significantly improved efficiency and reliability. NeuroImage 31:1116–1128

    Google Scholar 

  • Zhou M, Hall L, Goldgof D, Russo R, Balagurunathan Y, Gillies R, Gatenby R (2014) Radiologically defined ecological dynamics and clinical outcomes in glioblastoma multiforme: preliminary results. Transl Oncol 7:5–13

    Google Scholar 

  • Zhou M, Chaudhury B, Hall LO, Goldgof D, Gillies R, Gatenby R (2016) Identifying spatial imaging biomarkers of glioblastoma multiforme for survival group prediction. J Magn Reson Imaging 46(1):115–123

    Google Scholar 

Download references

Acknowledgements

We gratefully acknowledge the support of Intel Corporation for providing access to the Intel AI DevCloud platform used in this work. Subhashis Banerjee acknowledges the support provided to him by the Intel Corporation, through the Intel AI Student Ambassador Program. This publication is an outcome of the R&D work undertaken project under the Visvesvaraya PhD Scheme of Ministry of Electronics & Information Technology, Government of India, being implemented by Digital India Corporation. Sushmita Mitra acknowledges the support provided to her by the Indian National Academy of Engineering, through the INAE Chair Professorship.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Saumya Bhadani.

Ethics declarations

Conflict of interest

Saumya Bhadani declares that she has no conflict of interest. Sushmita Mitra declares that she has no conflict of interest. Subhashis Banerjee declares that he has no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Communicated by V. Loia.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Bhadani, S., Mitra, S. & Banerjee, S. Fuzzy volumetric delineation of brain tumor and survival prediction. Soft Comput 24, 13115–13134 (2020). https://doi.org/10.1007/s00500-020-04728-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-020-04728-8

Keywords

  • Multi-thresholding
  • MRI
  • Glioblastoma multiforme
  • Fuzzy connectedness
  • 3D segmentation
  • Survival prediction