Automated Multimodal Breast CAD Based on Registration of MRI and Two View Mammography

  • T. Hopp
  • P. Cotic Smole
  • N. V. Ruiter
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10553)


Computer aided diagnosis (CAD) of breast cancer is mainly focused on monomodal applications. Here we present a fully automated multimodal CAD, which uses patient-specific image registration of MRI and two-view X-ray mammography. The image registration estimates the spatial correspondence between each voxel in the MRI and each pixel in cranio-caudal and mediolateral-oblique mammograms. Thereby we can combine features from both modalities. As a proof of concept we classify fixed regions of interest (ROI) into normal and suspect tissue. We investigate the classification performance of the multimodal classification in several setups against a classification with MRI features only. The average sensitivity of detecting suspect ROIs improves by approximately 2% when combining MRI with both mammographic views compared to MRI-only detection, while the specificity stays at a constant level. We conclude that automatically combining MRI and X-ray can enhance the result of a breast CAD system.


Computer aided diagnosis Multimodal image registration X-ray mammography MRI 


  1. 1.
    Cheng, H., Shi, X., Min, R., Hu, L., Cai, X., Du, H.: Approaches for automated detection and classification of masses in mammograms. Pattern Recogn. 39(4), 646–668 (2006)CrossRefGoogle Scholar
  2. 2.
    Dorrius, M., van der Weide, M., van Ooijen, P., Pijnappel, R., Oudkerk, M.: Computer-aided detection in breast MRI: a systematic review and meta-analysis. Eur. Radiol. 21(8), 1600–1608 (2011)Google Scholar
  3. 3.
    Cheng, H., Shan, J., Ju, W., Guo, Y., Zhang, L.: Automated breast cancer detection and classification using ultrasound images: a survey. Pattern Recogn. 43(1), 299–317 (2010)CrossRefMATHGoogle Scholar
  4. 4.
    Lord, S., Lei, W., Craft, P., Cawson, J., Morris, I., Walleser, S., Griffiths, A., Parker, S., Houssami, N.: A systematic review of the effectiveness of magnetic resonance imaging (MRI) as an addition to mammography and ultrasound in screening young women at high risk of breast cancer. Eur. J. Cancer 43(13), 1905–1917 (2007)CrossRefGoogle Scholar
  5. 5.
    Yuan, Y., Giger, M.L., Li, H., Bhooshan, N., Sennett, C.A.: Multimodality computer-aided breast cancer diagnosis with FFDM and DCE-MRI. Acad. Radiol. 17(9), 1158–1167 (2010)CrossRefGoogle Scholar
  6. 6.
    Hopp, T., Dietzel, M., Baltzer, P., Kreisel, P., Kaiser, W., Gemmeke, H., Ruiter, N.: Automatic multimodal 2D/3D breast image registration using biomechanical FEM models and intensity-based optimization. Med. Image Anal. 17(2), 209–218 (2013)CrossRefGoogle Scholar
  7. 7.
    Hopp, T., Neupane, B., Ruiter, N.V.: Automated multimodal computer aided detection based on a 3d–2d image registration. In: Proceedings of 13th International Workshop on Breast Imaging, IWDM 2016, Malmö, Sweden, pp. 400–407 (2016)Google Scholar
  8. 8.
    Wu, S., Weinstein, S., Keller, B.M., Conant, E.F., Kontos, D.: Fully-automated fibroglandular tissue segmentation in breast MRI. In: Maidment, A.D.A., Bakic, P.R., Gavenonis, S. (eds.) IWDM 2012. LNCS, vol. 7361, pp. 244–251. Springer, Heidelberg (2012). doi: 10.1007/978-3-642-31271-7_32 CrossRefGoogle Scholar
  9. 9.
    Hopp, T., de Barros Rupp Simioni, W., Perez, J.E., Ruiter, N.: Comparison of biomechanical models for MRI to X-ray mammography registration. In: Proceedings 3rd MICCAI Workshop on Breast Image Analysis, pp. 81–88 (2015)Google Scholar
  10. 10.
    Chen, W., Giger, M.L., Li, H., Bick, U., Newstead, G.M.: Volumetric texture analysis of breast lesions on contrast-enhanced magnetic resonance images. Magn. Reson. Med. 58(3), 562–571 (2007)CrossRefGoogle Scholar
  11. 11.
    Degani, H., Gusis, V., Weinstein, D., Fields, S., Strano, S.: Mapping pathophysiological features of breast tumors by MRI at high spatial resolution. Nat. Med. 3(7), 780–782 (1997)CrossRefGoogle Scholar
  12. 12.
    Haralick, R.M., Shanmugam, K., Dinstein, I.: Textural features for image classification. IEEE Trans. Syst. Man Cybern. SMC-3(6), 610–621 (1973)Google Scholar
  13. 13.
    Galloway, M.M.: Texture analysis using gray level run lengths. Comput. Graph. Image Process. 4(2), 172–179 (1975)CrossRefGoogle Scholar
  14. 14.
    Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1),62–66 (1979)Google Scholar
  15. 15.
    Li, H., Wang, Y.J., Liu, K.J.R., Lo, S.C.B., Freedman, M.T.: Computerized radiographic mass detection - part i: lesion site selection by morphological enhancement and contextual segmentation. IEEE Trans. Med. Imag. 20, 289–301 (2001)CrossRefGoogle Scholar
  16. 16.
    Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The WEKA data mining software: an update. SIGKDD Expl. 11(1), 10–18 (2009)CrossRefGoogle Scholar
  17. 17.
    Hall, M.A.: Correlation-based feature subset selection for machine learning. Ph.D. thesis, The University of Waikato, Hamilton, New Zealand (1999)Google Scholar
  18. 18.
    Hopp, T., Ruiter, N.V.: 2D/3D registration for localization of mammographically depicted lesions in breast MRI. In: Maidment, A.D.A., Bakic, P.R., Gavenonis, S. (eds.) IWDM 2012. LNCS, vol. 7361, pp. 627–634. Springer, Heidelberg (2012). doi: 10.1007/978-3-642-31271-7_81 CrossRefGoogle Scholar
  19. 19.
    Mertzanidou, T., Hipwell, J., Johnsen, S., Han, L., Eiben, B., Taylor, Z., Ourselin, S., Huisman, H., Mann, R., Bick, U., Karssemeijer, N., Hawkes, D.: MRI to x-ray mammography intensity-based registration with simultaneous optimisation of pose and biomechanical transformation parameters. Med. Image Anal. 18(4), 674–683 (2014)CrossRefGoogle Scholar
  20. 20.
    Lee, A., Rajagopal, V., Gamage, T.P.B., Doyle, A.J., Nielsen, P., Nash, M.: Breast lesion co-localisation between X-ray and MR images using finite element modelling. Med. Image Anal. 17(8), 1256–1264 (2013)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Institute for Data Processing and ElectronicsKarlsruhe Institute of TechnologyKarlsruheGermany

Personalised recommendations