Integrate Domain Knowledge in Training CNN for Ultrasonography Breast Cancer Diagnosis

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11071)


Breast cancer is the most common cancer in women, and ultrasound imaging is one of the most widely used approach for diagnosis. In this paper, we proposed to adopt Convolutional Neural Network (CNN) to classify ultrasound images and predict tumor malignancy. CNN is a successful algorithm for image recognition tasks and has achieved human-level performance in real applications. To improve the performance of CNN in breast cancer diagnosis, we integrated domain knowledge and conducted multi-task learning in the training process. After training, a radiologist visually inspected the class activation map of the last convolutional layer of trained network to evaluate the result. Our result showed that CNN classifier can not only give reasonable performance in predicting breast cancer, but also propose potential lesion regions which can be integrated into the breast ultrasound system in the future.


Breast cancer Ultrasound BI-RADS assessments Convolutional neural network Multi-task learning 



The work received supports from Shenzhen Municipal Government under the grants JCYJ20170413161913429 and KQTD2016112809330877.


  1. 1.
    Fitzmaurice, C., et al.: The global burden of cancer 2013. JAMA Oncol. 1(4), 505 (2015)CrossRefGoogle Scholar
  2. 2.
    Kolb, T.M., Lichy, J., Newhouse, J.H.: Comparison of the performance of screening mammography, physical examination, and breast US and evaluation of factors that influence them: an analysis of 27,825 patient evaluations. Radiology 225(1), 165 (2002)CrossRefGoogle Scholar
  3. 3.
    Jesneck, J.L., Lo, J.Y., Baker, J.A.: Breast mass lesions: computer-aided diagnosis models with mammographic and sonographic descriptors. Radiology 244(2), 390 (2007)CrossRefGoogle Scholar
  4. 4.
    Berg, W.A., et al.: Shear-wave elastography improves the specificity of breast US: the BE1 multinational study of 939 masses. Int. J. Med. Radiol. 262(2), 435 (2012)Google Scholar
  5. 5.
    Mendelson, E., et al.: Breast imaging reporting and data system, BI-RADS: ultrasound (2003)Google Scholar
  6. 6.
    D’Orsi, C., et al.: ACR BI-RADS® Atlas, Breast Imaging Reporting and Data System (2013)Google Scholar
  7. 7.
    Simonyan, K., Zisserman, A.: Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv:1409.1556 (2014)
  8. 8.
    Prevedello, L.M., et al.: Automated critical test findings identification and online notification system using artificial intelligence in imaging. Radiology 285(3), 162664 (2017)CrossRefGoogle Scholar
  9. 9.
    Gulshan, V., et al.: Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316(22), 2402 (2016)CrossRefGoogle Scholar
  10. 10.
    Esteva, A., et al.: Corrigendum: dermatologist-level classification of skin cancer with deep neural networks. Nature 542(7639), 115 (2017)CrossRefGoogle Scholar
  11. 11.
    Sun, W., et al.: Enhancing deep convolutional neural network scheme for breast cancer diagnosis with unlabeled data. Comput. Med. Imaging Graph. 57, 4–9 (2017)CrossRefGoogle Scholar
  12. 12.
    Su, H., et al.: Region segmentation in histopathological breast cancer images using deep convolutional neural network. In: IEEE 12th International Symposium on Biomedical Imaging (ISBI), pp. 55–58 (2015)Google Scholar
  13. 13.
    Kotikalapudi, Raghavendra and contributors: (2017)

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Shenzhen Second People’s HospitalShenzhenChina
  2. 2.Anhui Medical UniversityHeifeiChina
  3. 3.Shenzhen Keya Medical Technology CorporationShenzhenChina
  4. 4.The Third People’s Hospital of ShenzhenShenzhenChina

Personalised recommendations