Advertisement

A Noise Robust Batch Mode Semi-supervised and Active Learning Framework for Image Classification

  • Chaoqun HouEmail author
  • Chenhui Yang
  • Fujia Ren
  • Rongjie Lin
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11901)

Abstract

Supervised learning with convolutional neural networks has made a great contribution to computer vision largely due to massive labeled samples. However, it is far from adequate available labeled samples for training in many applications. Realistically, annotation is a tedious, time consuming, and costly task while a strong need for specialty-oriented knowledge and skillful expert. Therefore, in order to take full advantage of limited resources to observably reduce the cost of annotation, we propose a noise robust batch mode semi-supervised and active learning framework which named NRMSL-BMAL. When querying labels in an iteration, firstly, a convolutional autoencoder cluster based batch mode active learning strategy is used for querying worthy samples from annotation experts with a cost. Then, a noise robust memorized self-learning is successively used for extending training samples without any annotation cost. Finally, these labeled samples are added to the training set for improving the performance of the target model. We perform a thorough experimental evaluation in image classification tasks, using datasets from different domains, including medical image, natural image, and a real-world application. Our experimental evaluation shows that NRMSL-BMAL is capable to observably reduce the annotation cost range from 44% to 95% while maintaining or even improving the performance of the target model.

Keywords

Active learning Semi-supervised learning Convolutional autoencoder cluster Continuously fine-tuning Image classification 

References

  1. 1.
    Campbell, C., Cristianini, N., Smola, A., et al.: Query learning with large margin classifiers. In: Proceedings of International Conference on Machine Learning, pp. 111–118 (2000)Google Scholar
  2. 2.
    Cardoso, T.N.C., Silva, R.M., Canuto, S., Moro, M.M., Gonçalves, M.A.: Ranked batch-mode active learning. Inf. Sci. 379, 313–337 (2017)CrossRefGoogle Scholar
  3. 3.
    Chiu, S.C., Jin, Z., Gu, Y.: Active learning combining uncertainty and diversity for multi-class image classification. IET Comput. Vis. 9(3), 400–407 (2015)CrossRefGoogle Scholar
  4. 4.
    Ding, Y., Wang, L., Fan, D., Gong, B.: A semi-supervised two-stage approach to learning from noisy labels. arXiv preprint arXiv:1802.02679 (2018)
  5. 5.
    Freund, Y., Seung, H.S., Shamir, E., Tishby, N.: Selective sampling using the query by committee algorithm. Mach. Learn. 28(2–3), 133–168 (1997)CrossRefGoogle Scholar
  6. 6.
    Gu, N., Fan, M., Meng, D.: Robust semi-supervised classification for noisy labels based on self-paced learning. IEEE Sig. Process. Lett. 23(12), 1806–1810 (2016)CrossRefGoogle Scholar
  7. 7.
    Guo, X., Gao, L., Liu, X., Yin, J.: Improved deep embedded clustering with local structure preservation. In: International Joint Conference on Artificial Intelligence, pp. 1753–1759 (2017)Google Scholar
  8. 8.
    Guo, X., Liu, X., Zhu, E., Yin, J.: Deep clustering with convolutional autoencoders. In: Liu, D., Xie, S., Li, Y., Zhao, D., El-Alfy, E.S. (eds.) Neural Information Processing. ICONIP 2017, vol. 10635, pp. 373–382. Springer, Cham (2017).  https://doi.org/10.1007/978-3-319-70096-0_39CrossRefGoogle Scholar
  9. 9.
    Guo, Y., Schuurmans, D.: Discriminative batch mode active learning. In: Proceedings of the International Conference on Neural Information Processing Systems, NIPS 2007, pp. 593–600. Curran Associates Inc., USA (2007)Google Scholar
  10. 10.
    Han, W., et al.: Semi-supervised active learning for sound classification in hybrid learning environments. PLoS ONE 11(9), e0162075 (2016)CrossRefGoogle Scholar
  11. 11.
    Hon, M., Khan, N.M.: Towards alzheimer’s disease classification through transfer learning. In: International Conference on Bioinformatics and Biomedicine, pp. 1166–1169 (2017)Google Scholar
  12. 12.
    Jindal, I., Nokleby, M., Chen, X.: Learning deep networks from noisy labels with dropout regularization. In: IEEE International Conference on Data Mining, pp. 967–972. IEEE (2016)Google Scholar
  13. 13.
    Joshi, A.J., Porikli, F., Papanikolopoulos, N.: Multi-class active learning for image classification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2372–2379 (2009)Google Scholar
  14. 14.
    Krizhevsky, A., Hinton, G.: Learning multiple layers of features from tiny images. Technical Report (2009)Google Scholar
  15. 15.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Proceedings of the International Conference on Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
  16. 16.
    LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRefGoogle Scholar
  17. 17.
    Li, X., Guo, Y.: Adaptive active learning for image classification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 859–866 (2013)Google Scholar
  18. 18.
    Liu, X., Li, S., Kan, M., Shan, S., Chen, X.: Self-error-correcting convolutional neural network for learning with noisy labels. In: IEEE International Conference on Automatic Face & Gesture Recognition, pp. 111–117 (2017)Google Scholar
  19. 19.
    McCallumzy, A.K., Nigamy, K.: Employing EM and pool-based active learning for text classification. In: Proceedings of International Conference on Machine Learning, pp. 359–367 (1998)Google Scholar
  20. 20.
    Patra, S., Bruzzone, L.: A batch-mode active learning technique based on multiple uncertainty for SVM classifier. IEEE Geosc. Remote Sens. Lett. 9(3), 497–501 (2012)CrossRefGoogle Scholar
  21. 21.
    Patra, S., Bruzzone, L.: A cluster-assumption based batch mode active learning technique. Pattern Recogn. Lett. 33(9), 1042–1048 (2012)CrossRefGoogle Scholar
  22. 22.
    Patrini, G., Rozza, A., Menon, A.K., Nock, R., Qu, L.: Making deep neural networks robust to label noise: a loss correction approach. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2233–2241 (2017)Google Scholar
  23. 23.
    Rong, C., Cao, Y.F., Hong, S.: Multi-class image classification with active learning and semi-supervised learning. Acta Automatica Sinica 37(8), 954–962 (2011)zbMATHGoogle Scholar
  24. 24.
    Russakovsky, O., et al.: Imagenet large scale visual recognition challenge. Int. J. Comput. Vis. 115(3), 211–252 (2015)MathSciNetCrossRefGoogle Scholar
  25. 25.
    Settles, B.: Active learning. Synth. Lect. Artif. Intell. Mach. Learn. 6(1), 1–114 (2012)MathSciNetCrossRefGoogle Scholar
  26. 26.
    Xie, J., Girshick, R., Farhadi, A.: Unsupervised deep embedding for clustering analysis. In: Proceedings of International Conference on Machine Learning, pp. 478–487 (2016)Google Scholar
  27. 27.
    Xiong, S., Azimi, J., Fern, X.Z.: Active learning of constraints for semi-supervised clustering. IEEE Trans. Knowl. Data Eng. 26(1), 43–54 (2014)CrossRefGoogle Scholar
  28. 28.
    Yarowsky, D.: Unsupervised word sense disambiguation rivaling supervised methods. In: Proceedings of Annual Meeting of the Association for Computational Linguistics, pp. 189–196 (1995)Google Scholar
  29. 29.
    Zhou, Z., Shin, J., Zhang, L., Gurudu, S., Gotway, M., Liang, J.: Fine-tuning convolutional neural networks for biomedical image analysis: Actively and incrementally. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4761–4772 (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Chaoqun Hou
    • 1
    Email author
  • Chenhui Yang
    • 1
  • Fujia Ren
    • 1
  • Rongjie Lin
    • 1
  1. 1.Fujian Key Laboratory of Sensing and Computing for Smart Cities, School of Information Science and EngineeringXiamen UniversityXiamenChina

Personalised recommendations