A Novel Semi-Supervised Convolutional Neural Network Method for Synthetic Aperture Radar Image Recognition

Abstract

Synthetic aperture radar (SAR) automatic target recognition (ATR) technology is one of the research hotspots in the field of image cognitive learning. Inspired by the human cognitive process, experts have designed convolutional neural network (CNN)-based SAR ATR methods. However, the performance of CNN significantly deteriorates when the labeled samples are insufficient. To effectively utilize the unlabeled samples, we present a novel semi-supervised CNN method. In the training process of our method, the information contained in the unlabeled samples is integrated into the loss function of CNN. Specifically, we first utilize CNN to obtain the class probabilities of the unlabeled samples. Thresholding processing is performed to optimize the class probabilities so that the reliability of the unlabeled samples is improved. Afterward, the optimized class probabilities are used to calculate the scatter matrices of the linear discriminant analysis (LDA) method. Finally, the loss function of CNN is modified by the scatter matrices. We choose ten types of targets from the Moving and Stationary Target Acquisition and Recognition (MSTAR) dataset. The experimental results show that the recognition accuracy of our method is significantly higher than other semi-supervised methods. It has been proved that our method can effectively improve the SAR ATR accuracy when labeled samples are insufficient.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

References

  1. 1.

    Gao F,Yang Y, Wang J, Sun J, Yang E, Zhou H. A Deep Convolutional Generative Adversarial Networks (DCGANs)-Based Semi-Supervised Method for Object Recognition in Synthetic Aperture Radar (SAR) Images. Remote Sens. 2018;10(6):846.

  2. 2.

    Wang G, Tan S, Guan C, Wang N, Liu Z. Multiple model particle filter track-before-detect for range ambiguous radar. Chin J Aeronaut. 2013;26:1477–87.

    Article  Google Scholar 

  3. 3.

    Ma F, Gao F, Sun J, Zhou H, Hussain A. Weakly Supervised Segmentation of SAR Imagery Using Superpixel and Hierarchically Adversarial CRF. Remote Sens. 2019;11(5):512.

  4. 4.

    Chen H, Zhang F, Tang B, Yin Q, Sun X. Slim and efficient neural network design for resource-constrained SAR target recognition. Remote Sens. 2018;10(10):1–15.

    Google Scholar 

  5. 5.

    Zhang F, Yao X, Tang H,Yin Q, Hu Y, Lei B. Multiple Mode SAR Raw Data Simulation and Parallel Acceleration for Gaofen-3 Mission. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 2018:1-12.

  6. 6.

    Garagnani M, Wennekers T, Pulvermüller F. Recruitment and consolidation of cell assemblies for words by way of hebbian learning and competition in a multi-layer neural network. Cogn Comput. 2009;1(2):160–76.

    Article  Google Scholar 

  7. 7.

    Zhang S, He B, Rui N, Wang J, Han B, Lendasse A. Fast image recognition based on independent component analysis and extreme learning machine. Cogn Comput. 2014;6(3):405–22.

    Article  Google Scholar 

  8. 8.

    Gao F, Ma F, Wang J, Sun J, Yang E, Zhou H. Visual saliency modeling for river detection in high-resolution SAR imagery. IEEE Access. 2018; 6:1000-14.

  9. 9.

    Gao F, Ma F, Zhang Y, Wang J, Sun J, Yang E, et al. Biologically inspired progressive enhancement target detection from heavy cluttered SAR images. Cogn Comput. 2016;8(5):955–66.

  10. 10.

    Spratling M. A hierarchical predictive coding model of object recognition in natural images. Cogn Comput. 2017;9(2):151–67.

    CAS  Article  Google Scholar 

  11. 11.

    Ren P, Sun W, Luo C, Hussain A. Clustering-oriented multiple convolutional neural networks for single image super-resolution. Cogn Comput. 2018;10(1):165–78.

    Article  Google Scholar 

  12. 12.

    Chen Y, Jiang H, Li C, Jia X, Ghamisi P. Deep feature extraction and classification of hyperspectral images based on convolutional neural networks. IEEE Trans Geosci Remote Sens. 2016;54(10):6232–51.

    Article  Google Scholar 

  13. 13.

    Amrani M, Jiang F. Deep feature extraction and combination for synthetic aperture radar target classification. J Appl Remote Sens. 2017;11(4):1.

    Article  Google Scholar 

  14. 14.

    Zhao J, Guo W, Cui S, Zhang Z, Yu W. Convolutional neural network for SAR image classification at patch level. Geoscience and Remote Sensing Symposium IEEE. 2016:945–8.

  15. 15.

    Chen S, Wang H. SAR target recognition based on deep learning. International Conference on Data Science and Advanced Analytics IEEE 2015; pp 541–7

  16. 16.

    Gao F, Huang T, Sun J, Wang J, Hussain A, Yang E. A new algorithm of SAR image target recognition based on improved deep convolutional neural network. Cogn Comput. 2018:1–16.

  17. 17.

    Liu B, Yu X, Zhang P, Tan X, Yu A, Xue Z. A semi-supervised convolutional neural network for hyperspectral image classification. Remote Sens Lett. 2017;8(9):839–48.

    Article  Google Scholar 

  18. 18.

    Fu Z, Zhang F, Yin Q, Li R, Hu W, Li W. Small sample learning optimization for ResNet based SAR target recognition. International Geoscience and Remote Sensing Symposium IEEE. 2018:2330–3.

  19. 19.

    Zhu X, Rogers T, Qian R, Kalish C. Humans perform semi-supervised classification too. National Conference on artificial intelligence AAAI Press 2007;864–9.

  20. 20.

    Haeusser P, Mordvintsev A, Cremers D. Learning by association—a versatile semi-supervised training method for neural networks. In Proceedings of IEEE conference on computer vision and pattern recognition 2017; pp. 626–35.

  21. 21.

    Gibson B, Rogers T, Zhu X. Human semi-supervised learning. Top Cogn Sci. 2013;5(1):132–72.

    PubMed  Article  Google Scholar 

  22. 22.

    Hänsch R, Hellwich O. Semi-supervised learning for classification of polarimetric SAR-data. Geoscience and Remote Sensing Symposium IEEE. 2010:987–90.

  23. 23.

    Uhlmann S, Kiranyaz S, Gabbouj M. Semi-supervised learning for ill-posed polarimetric SAR classification. Remote Sens. 2014;6(6):4801–30.

    Article  Google Scholar 

  24. 24.

    Basu S. Semi-supervised learning. Pacific-Asia conference on advances in knowledge discovery and data mining 2010;588–95.

  25. 25.

    Leng Y, Xu X, Qi G. Combining active learning and semi-supervised learning to construct SVM classifier. Knowl-Based Syst. 2013;44:121–31.

    Article  Google Scholar 

  26. 26.

    Zhang X, Song Q, Liu R, Wang W, Jiao L. Modified co-training with spectral and spatial views for semisupervised hyperspectral image classification. IEEE J Sel Top Appl Earth Observ Remote Sens. 2014;7(6):2044–55.

    Article  Google Scholar 

  27. 27.

    Lv L, Zhao D, Deng Q. A semi-supervised predictive sparse decomposition based on task-driven dictionary learning. Cogn Comput. 2016;9(1):1–10.

    CAS  Google Scholar 

  28. 28.

    Ding S, Xi X, Liu Z, Qiao H, Zhang B. A novel manifold regularized online semi-supervised learning model. Cogn Comput. 2018;10(1):49–61.

    Article  Google Scholar 

  29. 29.

    Rasmus A, Valpola H, Honkala M, Berglund M, Raiko T. Semi-supervised learning with ladder networks. Comput Sci. 2015;9(Suppl 1):1–9.

    Google Scholar 

  30. 30.

    Laine S, Aila T. Temporal ensembling for semi-supervised learning. International conference on learning representations 2017.

  31. 31.

    Le T, Kim S. A hybrid selection method of helpful unlabeled data applicable for semi-supervised learning algorithms. The IEEE International Symposium on Consumer Electronics. 2014:1–2.

  32. 32.

    Li Y, Zhou Z. Towards making unlabeled data never hurt. IEEE Trans Pattern Anal Mach Intell. 2015;37(1):175–88.

    CAS  PubMed  Article  Google Scholar 

  33. 33.

    Huang Y, Wang S, Ren S. Pinning exponential synchronization and passivity of coupled delayed reaction-diffusion neural networks with and without parametric uncertainties. Int. J. Control. 2017:1-35.

  34. 34.

    Huang Y, Qiu S, Ren S. Finite-time synchronization and passivity of coupled memristive neural networks. Int. J. Control. 2019.

  35. 35.

    Moskowitz L. The LDA—an integrated diagnostics tool. IEEE Aerosp Electron Syst Mag. 1986;1(7):22–6.

    Article  Google Scholar 

  36. 36.

    Huan R, Liang R, Pan Y. SAR target recognition with the fusion of LDA and ICA. International Conference on Information Engineering and Computer Science IEEE. 2009:1–5.

Download references

Funding

This research was funded by the National Natural Science Foundation of China (No. 61771027, No. 61071139, No. 61471019, No. 61501011, and No. 61171122). E. Yang is supported in part under the RSE-NNSFC Joint Project (2017–2019) (No. 6161101383) with China University of Petroleum (Huadong). H. Zhou was supported by UK EPSRC under Grant EP/N011074/1, Royal Society-Newton Advanced Fellowship under Grant NA160342, and European Union’s Horizon 2020 research and innovation program under the Marie-Sklodowska-Curie grant agreement No 720325.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Fei Gao.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Ethical Approval

This article does not contain any studies with human participants performed by any of the authors.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Yue, Z., Gao, F., Xiong, Q. et al. A Novel Semi-Supervised Convolutional Neural Network Method for Synthetic Aperture Radar Image Recognition. Cogn Comput (2019). https://doi.org/10.1007/s12559-019-09639-x

Download citation

Keywords

  • Synthetic aperture radar
  • Image recognition
  • Convolutional neural network
  • Semi-supervised learning
  • Linear discriminant analysis