Training Deep Convolutional Neural Networks with Active Learning for Exudate Classification in Eye Fundus Images

  • Sebastian Otálora
  • Oscar Perdomo
  • Fabio González
  • Henning Müller
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10552)


Training deep convolutional neural network for classification in medical tasks is often difficult due to the lack of annotated data samples. Deep convolutional networks (CNN) has been successfully used as an automatic detection tool to support the grading of diabetic retinopathy and macular edema. Nevertheless, the manual annotation of exudates in eye fundus images used to classify the grade of the DR is very time consuming and repetitive for clinical personnel. Active learning algorithms seek to reduce the labeling effort in training machine learning models. This work presents a label-efficient CNN model using the expected gradient length, an active learning algorithm to select the most informative patches and images, converging earlier and to a better local optimum than the usual SGD (Stochastic Gradient Descent) strategy. Our method also generates useful masks for prediction and segments regions of interest.



This work was supported by the Administrative Department of Science, Technology and Innovation of Colombia (Colciencias) through the grant Jóvenes Investigadores 2014 in call 645 and by Nvidia with a TitanX GPU.


  1. 1.
    Decencière, E., Cazuguel, G., Zhang, X., Thibault, G., Klein, J.C., Meyer, F., Marcotegui, B., Quellec, G., Lamard, M., Danno, R., et al.: Teleophta: machine learning and image processing methods for teleophthalmology. IRBM 34(2), 196–203 (2013)CrossRefGoogle Scholar
  2. 2.
    Freytag, A., Rodner, E., Denzler, J.: Selecting influential examples: active learning with expected model output changes. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8692, pp. 562–577. Springer, Cham (2014). doi: 10.1007/978-3-319-10593-2_37 Google Scholar
  3. 3.
    Greenspan, H., van Ginneken, B., Summers, R.M.: Guest editorial deep learning in medical imaging: overview and future promise of an exciting new technique. IEEE Trans. Med. Imaging 35(5), 1153–1159 (2016)CrossRefGoogle Scholar
  4. 4.
    Gulshan, V., Peng, L., Coram, M., Stumpe, M.C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al.: Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316(22), 2402–2410 (2016)CrossRefGoogle Scholar
  5. 5.
    Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T.: Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the 22nd ACM International Conference on Multimedia, pp. 675–678. ACM (2014)Google Scholar
  6. 6.
    Kauppi, T., et al.: Eye fundus image analysis for automatic detection of diabetic retinopathy. Lappeenranta University of Technology (2010)Google Scholar
  7. 7.
    LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRefGoogle Scholar
  8. 8.
    Perdomo, O., Otalora, S., Rodríguez, F., Arevalo, J., González, F.A.: A novel machine learning model based on exudate localization to detect diabetic macular edema. In: Ophthalmic Medical Image Analysis Third International Workshop (OMIA 2016), pp. 137–144. University of Iowa (2016)Google Scholar
  9. 9.
    Sánchez, C.I., Niemeijer, M., Abràmoff, M.D., van Ginneken, B.: Active learning for an efficient training strategy of computer-aided diagnosis systems: application to diabetic retinopathy screening. In: Jiang, T., Navab, N., Pluim, J.P.W., Viergever, M.A. (eds.) MICCAI 2010. LNCS, vol. 6363, pp. 603–610. Springer, Heidelberg (2010). doi: 10.1007/978-3-642-15711-0_75 CrossRefGoogle Scholar
  10. 10.
    Settles, B.: Active learning literature survey. Univ. Wis. Madison 52(55–66), 11 (2010)Google Scholar
  11. 11.
    Settles, B., Craven, M., Ray, S.: Multiple-instance active learning. In: Advances in Neural Information Processing Systems, pp. 1289–1296 (2008)Google Scholar
  12. 12.
    Stitt, A.W., Lois, N., Medina, R.J., Adamson, P., Curtis, T.M.: Advances in our understanding of diabetic retinopathy. Clin. Sci. 125(1), 1–17 (2013)CrossRefGoogle Scholar
  13. 13.
    Yu, F., Seff, A., Zhang, Y., Song, S., Funkhouser, T., Xiao, J.: LSUN: construction of a large-scale image dataset using deep learning with humans in the loop. arXiv preprint arXiv:1506.03365 (2015)
  14. 14.
    Zhou, S., Chen, Q., Wang, X.: Active semi-supervised learning method with hybrid deep belief networks. PLoS ONE 9(9), e107122 (2014)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Sebastian Otálora
    • 2
  • Oscar Perdomo
    • 1
  • Fabio González
    • 1
  • Henning Müller
    • 2
  1. 1.Universidad Nacional de ColombiaBogotáColombia
  2. 2.University of Applied Sciences Western Switzerland (HES-SO)SierreSwitzerland

Personalised recommendations