Abstract
The segmentation of masses from mammogram is a challenging problem because of their variability in terms of shape, appearance and size, and the low signal-to-noise ratio of their appearance. We address this problem with structured output prediction models that use potential functions based on deep convolution neural network (CNN) and deep belief network (DBN). The two types of structured output prediction models that we study in this work are the conditional random field (CRF) and structured support vector machines (SSVM). The label inference for CRF is based on tree re-weighted belief propagation (TRW) and training is achieved with the truncated fitting algorithm; whilst for the SSVM model, inference is based upon graph cuts and training depends on a max-margin optimization. We compare the results produced by our proposed models using the publicly available mammogram datasets DDSM-BCRP and INbreast, where the main conclusion is that both models produce results of similar accuracy, but the CRF model shows faster training and inference. Finally, when compared to the current state of the art in both datasets, the proposed CRF and SSVM models show superior segmentation accuracy.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Jemal A, Siegel R, Ward E, Hao Y, Xu J, Murray T, Thun MJ (2008) Cancer statistics, 2008. CA Cancer J Clin 58(2):71–96
Yuan Y, Giger ML, Li H, Suzuki K, Sennett C (2007) A dual-stage method for lesion segmentation on digital mammograms. Med Phys 34:4180
Rahmati P, Adler A, Hamarneh G (2012) Mammography segmentation with maximum likelihood active contours. Med Image Anal 16(6):1167–1186
Beller M, Stotzka R, Müller TO, Gemmeke H (2005) An example-based system to support the segmentation of stellate lesions. In: Bildverarbeitung für die Medizin 2005. Springer, Berlin, pp 475–479
Elmore JG, Jackson SL, Abraham L, Miglioretti DL, Carney PA, Geller BM, Yankaskas BC, Kerlikowske K, Onega T, Rosenberg RD et al (2009) Variability in interpretive performance at screening mammography and radiologists characteristics associated with accuracy1. Radiology 253(3):641–651
Moreira IC, Amaral I, Domingues I, Cardoso A, Cardoso MJ, Cardoso JS (2012) Inbreast: toward a full-field digital mammographic database. Acad Radiol 19(2):236–248
Heath M, Bowyer K, Kopans D, Moore R, Kegelmeyer P (2000) The digital database for screening mammography. In: Proceedings of the 5th international workshop on digital mammography. pp 212–218
Fenton JJ, Taplin SH, Carney PA, Abraham L, Sickles EA, D’Orsi C, Berns EA, Cutter G, Hendrick RE, Barlow WE et al (2007) Influence of computer-aided detection on performance of screening mammography. N Engl J Med 356(14):1399–1409
Dhungel N, Carneiro G, Bradley AP (2015) Deep structured learning for mass segmentation from mammograms. In: 2015 IEEE international conference on image processing (ICIP). pp 2950–2954
Dhungel N, Carneiro G, Bradley AP (2015) Tree re-weighted belief propagation using deep learning potentials for mass segmentation from mammograms. In: 2015 IEEE 12th international symposium on biomedical imaging (ISBI). pp 760–763
Carneiro G, Georgescu B, Good S, Comaniciu D (2008) Detection and measurement of fetal anatomies from ultrasound images using a constrained probabilistic boosting tree. IEEE Trans Med Imaging 27(9):1342–1355
Domke J (2013) Learning graphical model parameters with approximate marginal inference. arXiv preprint arXiv:1301.3193
Tsochantaridis I, Joachims T, Hofmann T, Altun Y (2005) Large margin methods for structured and interdependent output variables. J Mach Learn Res 1453–1484
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: NIPS, vol 1. p 4
LeCun Y, Bengio Y (1995) Convolutional networks for images, speech, and time series. In: The handbook of brain theory and neural networks, vol 3361
Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507
Wang C, Komodakis N, Paragios N (2013) Markov random field modeling, inference and learning in computer vision and image understanding: A survey. Comput Vis Image Underst 117(11):1610–1627
Wainwright MJ, Jaakkola TS, Willsky AS (2003) Tree-reweighted belief propagation algorithms and approximate ml estimation by pseudo-moment matching. In: Workshop on artificial intelligence and statistics. Society for artificial intelligence and statistics Np, vol 21. p. 97
Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. IEEE Trans Pattern Anal Mach Intell 23(11):1222–1239
Szummer M, Kohli P, Hoiem D (2008) Learning CRFS using graph cuts. In: Computer vision–ECCV 2008. Springer, Berlin, pp 582–595
Catarious DM Jr, Baydush AH, Floyd CE Jr (2004) Incorporation of an iterative, linear segmentation routine into a mammographic mass cad system. Med Phys 31(6):1512–1520
Song E, Jiang L, Jin R, Zhang L, Yuan Y, Li Q (2009) Breast mass segmentation in mammography using plane fitting and dynamic programming. Acad Radiol 16(7):826–835
Timp S, Karssemeijer N (2004) A new 2d segmentation method based on dynamic programming applied to computer aided detection in mammography. Med Phys 31(5):958–971
DomÃnguez AR, Nandi AK (2009) Toward breast cancer diagnosis based on automated segmentation of masses in mammograms. Pattern Recognit 42(6):1138–1148
Yu M, Huang Q, Jin R, Song E, Liu H, Hung C-C (2012) A novel segmentation method for convex lesions based on dynamic programming with local intra-class variance. In: Proceedings of the 27th annual ACM symposium on applied computing. ACM, New York, pp 39–44
Xu S, Liu H, Song E (2011) Marker-controlled watershed for lesion segmentation in mammograms. J Digital Imaging 24(5):754–763
Ball J, Bruce L (2007) Digital mammographic computer aided diagnosis (CAD) using adaptive level set segmentation. In: 29th annual international conference of the IEEE engineering in medicine and biology society, 2007. EMBS 2007. IEEE, New York, pp 4973–4978
te Brake GM, Karssemeijer N, Hendriks JH (2000) An automatic method to discriminate malignant masses from normal tissue in digital mammograms. Phys Med Biol 45(10):2843
Sahiner B, Chan H-P, Petrick N, Helvie MA, Hadjiiski LM (2001) Improvement of mammographic mass characterization using spiculation measures and morphological features. Med Phys 28(7):1455–1465
Sethian JA (1999) Level set methods and fast marching methods: evolving interfaces in computational geometry, fluid mechanics, computer vision, and materials science, vol 3. Cambridge University Press, Cambridge
Shi J, Sahiner B, Chan H-P, Ge J, Hadjiiski L, Helvie MA, Nees A, Wu Y-T, Wei J, Zhou C et al (2007) Characterization of mammographic masses based on level set segmentation with new image features and patient information. Med Phys 35(1):280–290
Nowozin S, Lampert CH (2011) Structured learning and prediction in computer vision. Found Trends® Comput Graph Vis 6(3–4):185–365
Meltzer T, Globerson A, Weiss Y (2009) Convergent message passing algorithms: a unifying view. In: Proceedings of the twenty-fifth conference on uncertainty in artificial intelligence, AUAI Press, pp 393–401
Dempster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the EM algorithm. J R Stat Soc Ser B (Methodol), 1–38
Cardoso JS, Domingues I, Oliveira HP (2014) Closed shortest path in the original coordinates with an application to breast cancer. Int J Pattern Recognit Artif Intell
Acknowledgements
This work was partially supported by the Australian Research Council’s Discovery Projects funding scheme (project DP140102794). Prof. Bradley is the recipient of an Australian Research Council Future Fellowship(FT110100623).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Dhungel, N., Carneiro, G., Bradley, A.P. (2017). Combining Deep Learning and Structured Prediction for Segmenting Masses in Mammograms. In: Lu, L., Zheng, Y., Carneiro, G., Yang, L. (eds) Deep Learning and Convolutional Neural Networks for Medical Image Computing. Advances in Computer Vision and Pattern Recognition. Springer, Cham. https://doi.org/10.1007/978-3-319-42999-1_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-42999-1_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-42998-4
Online ISBN: 978-3-319-42999-1
eBook Packages: Computer ScienceComputer Science (R0)