Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features
- 1.2k Downloads
Detection and segmentation of a brain tumor such as glioblastoma multiforme (GBM) in magnetic resonance (MR) images are often challenging due to its intrinsically heterogeneous signal characteristics. A robust segmentation method for brain tumor MRI scans was developed and tested.
Simple thresholds and statistical methods are unable to adequately segment the various elements of the GBM, such as local contrast enhancement, necrosis, and edema. Most voxel-based methods cannot achieve satisfactory results in larger data sets, and the methods based on generative or discriminative models have intrinsic limitations during application, such as small sample set learning and transfer. A new method was developed to overcome these challenges. Multimodal MR images are segmented into superpixels using algorithms to alleviate the sampling issue and to improve the sample representativeness. Next, features were extracted from the superpixels using multi-level Gabor wavelet filters. Based on the features, a support vector machine (SVM) model and an affinity metric model for tumors were trained to overcome the limitations of previous generative models. Based on the output of the SVM and spatial affinity models, conditional random fields theory was applied to segment the tumor in a maximum a posteriori fashion given the smoothness prior defined by our affinity model. Finally, labeling noise was removed using “structural knowledge” such as the symmetrical and continuous characteristics of the tumor in spatial domain.
The system was evaluated with 20 GBM cases and the BraTS challenge data set. Dice coefficients were computed, and the results were highly consistent with those reported by Zikic et al. (MICCAI 2012, Lecture notes in computer science. vol 7512, pp 369–376, 2012).
A brain tumor segmentation method using model-aware affinity demonstrates comparable performance with other state-of-the art algorithms.
KeywordsBrain tumor segmentation Model-aware affinity SVM CRF Superpixels
This work was partially supported by the Chinese National Science Foundation (61273241) and the NSF CAREER grant IIS-0845282. Conflict of Interest The authors have declared that no conflict of interest exists.
- 1.Liu J, Udupa JK, Odhner D, Hackney D, Moonis G (2005) A system for brain tumor volume estimation via MR imaging and fuzzy connectedness. Comput Med Imaging Graphics 29(1):21–34Google Scholar
- 5.Patel MR, Tse V (2004) Diagnosis and staging of brain tumors. Semin Roentgenol 39(3):347–360Google Scholar
- 16.Zhou J, Chan K, Chong V, Krishnan S (2006) Extraction of brain tumor from MR images using one-class support vector machine. In: 27th annual international conference of the engineering in medicine and biology society, 2005. IEEE-EMBS 2005. pp 6411–6414Google Scholar
- 17.Xuan X, Liao Q (2008) Automated MRI brain rumor segmentation based on feature extraction. Comput Eng 9:070Google Scholar
- 18.Corso J, Yuille A, Sicotte N, Toga A (2007) Detection and segmentation of pathological structures by the extended graph-shifts algorithm. In: Medical Image Computing and Computer-Assisted Intervention—MICCAI. pp 985–993Google Scholar
- 22.Zikic D, Glocker B, Konukoglu E, Criminisi A, Demiralp C, Shotton J, Thomas O, Das T, Jena R, Price S (2012) Decision forests for tissue-specific segmentation of high-grade gliomas in multi-channel MR. In: Medical Image Computing and Computer-Assisted Intervention—MICCAI. Lecture notes in computer science, vol 7512. pp 369–376Google Scholar
- 24.Fernández A, García S, Herrera F (2011) Addressing the classification with imbalanced data: open problems and new challenges on class distribution. In: Hybrid artificial intelligent systems. Lecture notes in computer science, vol 6678. pp 1–10Google Scholar
- 27.Lee CH, Schmidt M, Murtha A, Bistritz A, Sander J, Greiner R (2005) Segmenting brain tumors with conditional random fields and support vector machines. In: Computer vision for biomedical, image applications. Lecture notes in computer science, vol 3765. pp 469–478Google Scholar
- 29.Xu C, Corso JJ (2002) Evaluation of super-voxel methods for early video processing. In: IEEE conference on computer vision and pattern recognition (CVPR) 2012, pp 1202–1209Google Scholar
- 30.Bauer S, Nolte L-P, Reyes M (2011) Fully automatic segmentation of brain tumor images using support vector machine classification in combination with hierarchical conditional random field regularization. In: Medical Image Computing and Computer-Assisted Intervention—MICCAI 2011. Springer, pp 354–361Google Scholar
- 31.Platt J (1999) Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Adv Large Margin Class 10(3):61–74Google Scholar
- 32.Ren X, Malik J (2003) Learning a classification model for segmentation. In: Proceedings of the ninth IEEE international conference on computer vision, 2003. pp 10–17Google Scholar
- 33.Manjunath BS, Ma WY (1996) Texture features for browsing and retrieval of image data. IEEE Trans Pattern Anal Mach Intell 18(8):837–842Google Scholar
- 34.Lee TS (1996) Image representation using 2D Gabor wavelets. IEEE Trans Pattern Anal Mach Intell 18(10):959–971 Google Scholar
- 35.Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. IEEE Trans Pattern Anal Mach Intell 23(11):1222–1239Google Scholar
- 38.Zabih RD, Veksler O, Boykov Y (2004) System and method for fast approximate energy minimization via graph cuts. U. S. Patent 6,744, 923 [p]. 1 June 2004Google Scholar
- 41.Zikic D, Glocker B, Konukoglu E, Shotton J, Criminisi A, Ye DH, Demiralp C, Thomas OM, Das T, Jena R, Price SJ (2012) Context-sensitive classification forests for segmentation of brain tumor tissues. In: Proceedings of MICCAI-BRATS (2012)Google Scholar