Deep Active Self-paced Learning for Accurate Pulmonary Nodule Segmentation

  • Wenzhe Wang
  • Yifei Lu
  • Bian Wu
  • Tingting Chen
  • Danny Z. Chen
  • Jian WuEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11071)


Automatic and accurate pulmonary nodule segmentation in lung Computed Tomography (CT) volumes plays an important role in computer-aided diagnosis of lung cancer. However, this task is challenging due to target/background voxel imbalance and the lack of voxel-level annotation. In this paper, we propose a novel deep region-based network, called Nodule R-CNN, for efficiently detecting pulmonary nodules in 3D CT images while simultaneously generating a segmentation mask for each instance. Also, we propose a novel Deep Active Self-paced Learning (DASL) strategy to reduce annotation effort and also make use of unannotated samples, based on a combination of Active Learning and Self-Paced Learning (SPL) schemes. Experimental results on the public LIDC-IDRI dataset show our Nodule R-CNN achieves state-of-the-art results on pulmonary nodule segmentation, and Nodule R-CNN trained with the DASL strategy performs much better than Nodule R-CNN trained without DASL using the same amount of annotated samples.



The research of D.Z. Chen was supported in part by NSF Grant CCF-1617735.


  1. 1.
    Gonçalves, L., Novo, J.: Hessian based approaches for 3D lung nodule segmentation. Expert Syst. Appl. 61, 1–15 (2016)CrossRefGoogle Scholar
  2. 2.
    Messay, T., Hardie, R.C.: Segmentation of pulmonary nodules in computed tomography using a regression neural network approach and its application to the lung image database consortium and image database resource initiative dataset. Med. Image Anal. 22(1), 48–62 (2015)CrossRefGoogle Scholar
  3. 3.
    Feng, X., Yang, J., et al.: Discriminative localization in CNNs for weakly-supervised segmentation of pulmonary nodules. In: MICCAI, pp. 568–576 (2017)Google Scholar
  4. 4.
    Yang, L., Zhang, Y., et al.: Suggestive annotation: a deep active learning framework for biomedical image segmentation. In: MICCAI, pp. 399–407 (2017)Google Scholar
  5. 5.
    Li, X., Zhong, A., et al.: Self-paced convolutional neural network for computer aided detection in medical imaging analysis. In: International Workshop on Machine Learning in Medical Imaging, pp. 212–219 (2017)CrossRefGoogle Scholar
  6. 6.
    Armato, S.G., McLennan, G.: The lung image database consortium (LIDC) and image database resource initiative (IDRI): a completed reference database of lung nodules on CT scans. Med. Phy. 38(2), 915–931 (2011)CrossRefGoogle Scholar
  7. 7.
    Çiçek, Ö., Abdulkadir, A., Lienkamp, S.S., Brox, T., Ronneberger, O.: 3D U-Net: learning dense volumetric segmentation from sparse annotation. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 424–432. Springer, Cham (2016). Scholar
  8. 8.
    Milletari, F., Navab, N., et al.: V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: 4th IEEE International Conference on 3D Vision, pp. 565–571 (2016)Google Scholar
  9. 9.
    Yu, L., et al.: Automatic 3D cardiovascular MR segmentation with densely-connected volumetric convnets. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10434, pp. 287–295. Springer, Cham (2017). Scholar
  10. 10.
    He, K., Gkioxari, G., et al.: Mask R-CNN. In: ICCV, pp. 2980–2988 (2017)Google Scholar
  11. 11.
    Settles, B.: Active learning literature survey. Computer Sciences Technical Report 1648, University of Wisconsin - Madison (2009)Google Scholar
  12. 12.
    Kumar, M.P., Packer, B., et al.: Self-paced learning for latent variable models. In: NIPS, pp. 1189–1197 (2010)Google Scholar
  13. 13.
    Lin, L., Wang, K., et al.: Active self-paced learning for cost-effective and progressive face identification. IEEE TPAMI 40(1), 7–19 (2018)CrossRefGoogle Scholar
  14. 14.
    Ren, S., He, K., et al.: Faster R-CNN: towards real-time object detection with region proposal networks. In: NIPS, pp. 91–99 (2015)Google Scholar
  15. 15.
    Lin, T.Y., Dollár, P., et al.: Feature pyramid networks for object detection. In: CVPR, vol. 1, p. 4 (2017)Google Scholar
  16. 16.
    Huang, G., Liu, Z., et al.: Densely connected convolutional networks. In: CVPR, vol. 1, p. 3 (2017)Google Scholar
  17. 17.
    Girshick, R.: Fast R-CNN. In: ICCV, pp. 1440–1448 (2015)Google Scholar
  18. 18.
    Drozdzal, M., Vorontsov, E., et al.: The importance of skip connections in biomedical image segmentation. In: Deep Learning and Data Labeling for Medical Applications, pp. 179–187 (2016)Google Scholar
  19. 19.
    Jiang, L., Meng, D.: Self-paced curriculum learning. In: AAAI, vol. 2, p. 6 (2015)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Wenzhe Wang
    • 1
  • Yifei Lu
    • 1
  • Bian Wu
    • 2
  • Tingting Chen
    • 1
  • Danny Z. Chen
    • 3
  • Jian Wu
    • 1
    Email author
  1. 1.College of Computer Science and TechnologyZhejiang UniversityHangzhouChina
  2. 2.Data Science and AI LabWeDoctor Group LimitedHangzhouChina
  3. 3.Department of Computer Science and EngineeringUniversity of Notre DameNotre DameUSA

Personalised recommendations