3D Segmentation in CT Imagery with Conditional Random Fields and Histograms of Oriented Gradients
In this paper we focus on the problem of 3D segmention in volumetric computed tomography imagery to identify organs in the abdomen. We propose and evaluate different models and modeling strategies for 3D segmentation based on traditional Markov Random Fields (MRFs) and their discriminative counterparts known as Conditional Random Fields (CRFs). We also evaluate the utility of features based on histograms of oriented gradients or HOG features. CRFs and HOG features have independently produced state of the art performance in many other problem domains and we believe our work is the first to combine them and use them for medical image segmentation. We construct 3D lattice MRFs and CRFs, use variational message passing (VMP) for learning and max-product (MP) inference for prediction in the models. These inference and learning approaches allow us to learn pairwise terms in random fields that are non-submodular and are thus very flexible. We focus our experiments on abdominal organ and region segmentation, but our general approach should be useful in other settings. We evaluate our approach on a larger set of anatomical structures found within a publicly available liver database and we provide these labels for the dataset to the community for future research.
KeywordsMRF CRF generative discriminative 3D segmentation HOG
Unable to display preview. Download preview PDF.
- 2.Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 (2001)Google Scholar
- 3.Criminisi, A., Shotton, J., Robertson, D.P., Konukoglu, E.: Regression forests for efficient anatomy detection and localization in CT studies. In: MCV, pp. 106–117 (2010)Google Scholar
- 4.Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE CVPR, pp. 886–893. IEEE Computer Society, Washington, DC, USA (2005)Google Scholar
- 5.Graf, F., Kriegel, H.P., Schubert, M., Strukelj, M., Cavallaro, A.: Fully automatic detection of the vertebrae in 2d ct images. In: SPIE Medical Imaging, vol. 7962 (2011)Google Scholar
- 6.Kumar, S., Hebert, M.: Discriminative random fields: A discriminative framework for contextual interaction in classification. In: ICCV, pp. 1150–1157 (2003)Google Scholar
- 7.Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: Probabilistic models for segmenting and labeling sequence data (2001)Google Scholar
- 9.Ling, H., et al.: Hierarchical, learning-based automatic liver segmentation. In: IEEE CVPR (2008)Google Scholar
- 10.Lowe, D.G.: Distinctive image features from scale-invariant keypoints. IJCV 60(2) (2004)Google Scholar
- 11.Motwani, K., Adluru, N., Hinrichs, C., Alexander, A.L., Singh, V.: Epitome driven 3-d diffusion tensor image segmentation: on extracting specific structures. In: NIPS (2010)Google Scholar
- 12.Seifert, S., et al.: Hier. parsing and semantic nav. of full body CT data. In: Proc. SPIE (2009)Google Scholar
- 13.Tsechpenakis, G., Wang, J., Mayer, B., Metaxas, D.: Coupling CRFs and deformable models for 3D medical image segmentation, pp. 1–8 (2007)Google Scholar
- 14.Varshney, L.: Abdominal organ segmentation in ct scan images: A survey (2002)Google Scholar