Dynamic Routing on Deep Neural Network for Thoracic Disease Classification and Sensitive Area Localization

  • Yan ShenEmail author
  • Mingchen Gao
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11046)


We present and evaluate a new deep neural network architecture for automatic thoracic disease detection on chest X-rays. Deep neural networks has shown great success in a plethora of vision recognition tasks such as image classification and object detection by stacking multiple layers of convolutional neural networks (CNN) in a feed forward manner. However the performance gain by going deeper has reached bottlenecks as a result of the trade-off between model complexity and discrimination power. We address this problem by utilizing recently developed routing-by agreement mechanism in our architecture. A novel characteristic of our network structure is that it extends routing to two types of layer connections (1) connection between feature maps in dense layers, (2) connection between primary capsules and prediction capsules in final classification layer. We show that our networks achieves comparable results with much fewer layers in the measurement of AUC score. We further show the combined benefits of model interpretability by generating Gradient-weighted Class Activation Mapping (Grad-CAM) for localization. We demonstrate our results on the NIH chestX-ray14 dataset that consists of 112,120 images on 30,805 unique patients including 14 kinds of lung diseases.


  1. 1.
    Afshar, P., Mohammadi, A., Plataniotis, K.N.: Brain tumor type classification via capsule networks. arXiv preprint arXiv:1802.10200 (2018)
  2. 2.
    Bengio, Y., Louradour, J., Collobert, R., Weston, J.: Curriculum learning. In ICML, pp. 41–48. ACM (2009)Google Scholar
  3. 3.
    Guan, Q., Huang, Y., Zhong, Z., Zheng, Z., Zheng, L., Yang, Y., et al.: Diagnose like a radiologist: Attention guided convolutional neural network for thorax disease classification. arXiv preprint arXiv:1801.09927 (2018)
  4. 4.
    Huang, G., Liu, Z., van der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: CVPR (2017)Google Scholar
  5. 5.
    LaLonde, R., Bagci, U.: Capsules for object segmentation. arXiv preprint arXiv:1804.04241 (2018)
  6. 6.
    Li, Z., et al.: Thoracic disease identification and localization with limited supervision. In: CVPR (2017)Google Scholar
  7. 7.
    Litjens, G., et al.: A survey on deep learning in medical image analysis. Med. Image Anal. 42, 60–88 (2017)CrossRefGoogle Scholar
  8. 8.
    Rajpurkar, P., et al.: Chexnet: radiologist-level pneumonia detection on chest x-rays with deep learning. arXiv preprint arXiv:1711.05225 (2017)
  9. 9.
    Sabour, S., Frosst, N., Hinton, G.E.: Dynamic routing between capsules. In: NIPS, pp. 3859–3869 (2017)Google Scholar
  10. 10.
    Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D., et al.: Grad-cam: visual explanations from deep networks via gradient-based localization. In: CVPR, pp. 618–626 (2017)Google Scholar
  11. 11.
    Shin, H.-C., et al.: Deep convolutional neural networks for computer-aided detection: Cnn architectures, dataset characteristics and transfer learning. TMI 35(5), 1285–1298 (2016)CrossRefGoogle Scholar
  12. 12.
    Wang, D., Liu, Q.: An optimization view on dynamic routing between capsules. In: ICLR workshop (2018)Google Scholar
  13. 13.
    Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., Summers, R.M., et al.: Chestx-ray8: hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In: CVPR, pp. 3462–3471. IEEE (2017)Google Scholar
  14. 14.
    Yao, L., Poblenz, E., Dagunts, D., Covington, B., Bernard, D., Lyman, K., et al.: Learning to diagnose from scratch by exploiting dependencies among labels. arXiv preprint arXiv:1710.10501 (2017)
  15. 15.
    Yao, L., Prosky, J., Poblenz, E., Covington, B., Lyman, K.: Weakly supervised medical diagnosis and localization from multiple resolutions. arXiv preprint arXiv:1803.07703 (2018)
  16. 16.
    Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., Torralba, A.: Learning deep features for discriminative localization. In: CVPR, pp. 2921–2929. IEEE (2016)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringUniversity at BuffaloAmherstUSA

Personalised recommendations