Skip to main content
SpringerLink
Log in

A Deep Lightweight Convolutional Neural Network Method for Real-Time Small Object Detection in Optical Remote Sensing Images

  • Original Paper
  • Published:
Sensing and Imaging Aims and scope Submit manuscript

Abstract

The existing object detection algorithms mainly detect large objects. There are few kinds of researches on small objects. And the small object detection accuracy is low, which is difficult to satisfy the real-time requirement. Therefore, this paper proposes a deep lightweight convolutional neural network method for real-time small object detection in optical remote sensing images. Firstly, we build a data set with small objects. The object occupies a very small proportion in the image. There are some interferences such as truncation and occlusion in this data set, which can better evaluate the advantages and disadvantages of the detection method of small objects. Secondly, combining with the region proposal network, we propose a method for generating high-quality candidate boxes of small objects to improve the detection accuracy and speed. Meanwhile, two new learning rate strategies are proposed to improve the performance of the model and further improve the detection accuracy. Experimental results show that the proposed method is an effective small object detection algorithm and achieves real-time detection effect compared with other state-of-the-art object detection methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Yin, S., Zhang, Ye., & Karim, S. (2018). Large scale remote sensing image segmentation based on fuzzy region competition and gaussian mixture model. IEEE Access., 6, 26069–26080.

    Article  Google Scholar 

  2. Yin, S., Zhang, Y., & Karim, S. (2019). Region search based on hybrid convolutional neural network in optical remote sensing images. International Journal of Distributed Sensor Networks, 15(5). https://doi.org/10.1177/1550147719852036.

  3. Zhang, Q., Bai, C., Chen, Z., et al. (2019). Deep learning models for diagnosing spleen and stomach diseases in smart Chinese medicine with cloud computing. Concurrency and Computation: Practice and Experience. https://doi.org/10.1002/cpe.5252

    Article  Google Scholar 

  4. Peng, L., Chen, Z., Yang, L. T., et al. (2018). Deep convolutional computation model for feature learning on big data in internet of things. IEEE Transactions on Industrial Informatics, 14(2), 790–798.

    Article  Google Scholar 

  5. Ren, S., He, K., Girshick, R., et al. (2015). Object detection networks on convolutional feature maps. IEEE Transactions on Pattern Analysis & Machine Intelligence, 39(7), 1476–1481.

  6. Pham, P., Nguyen, D., Do, T., et al. (2017). Evaluation of deep models for real-time small object detection. In International conference on neural information processing (pp. 516–526). Springer, Cham.

  7. Chen, C., Liu, M. Y., Tuzel, O., et al. (2016). R-CNN for small object detection. ACCV 2016. Lecture Notes in Computer Science, vol. 10115. Springer, Cham, pp. 214–230. https://doi.org/10.1007/978-3-319-54193-8_14.

  8. Teng, L., Li, H., & Karim, S. (2019). DMCNN: A deep multiscale convolutional neural network model for medical image segmentation. Journal of Healthcare Engineering.

  9. Yu, J., & Li, H. (2019). Modified immune evolutionary algorithm for IoT big data clustering and feature extraction under cloud computing environment. Journal of Healthcare Engineering.

  10. Cheng, P., Liu, W., Zhang, Y., et al. (2018). LOCO: Local context based faster R-CNN for small traffic sign detection. In International conference on multimedia modeling. Springer, Cham.

  11. Zhang, L., Lin, L., Liang, X., et al. (2016). Is Faster R-CNN doing well for pedestrian detection?. In ECCV 2016. ECCV 2016. Lecture Notes in Computer Science, vol 9906. Springer, Cham, pp. 443–457. https://doi.org/10.1007/978-3-319-46475-6_28.

  12. Chen, Y., Li, W., Sakaridis, C., Dai , D. & Van Gool L. (2018). Domain adaptive faster R-CNN for object detection in the wild. In 2018 IEEE/CVF conference on computer vision and pattern recognition, Salt Lake City, UT, pp. 3339–3348. https://doi.org/10.1109/CVPR.2018.00352.

  13. Zhu, Z., Liang, D., Zhang, S., Huang, X., Li, B., & Hu, S. (2016). Traffic-sign detection and classification in the wild. In 2016 IEEE conference on computer vision and pattern recognition (CVPR), Las Vegas, NV, pp. 2110–2118. https://doi.org/10.1109/CVPR.2016.232.

  14. Yun, R., Changren, Z., & Shunping, X. (2018). Small object detection in optical remote sensing images via modified faster R-CNN. Applied Sciences, 8(5), 813.

    Article  Google Scholar 

  15. Rabbi, J., Ray, N., Schubert, M., et al. (2020). Small-object detection in remote sensing images with end-to-end edge-enhanced GAN and object detector network. Remote Sensing, 12(9), 1432.

    Article  Google Scholar 

  16. Kim K H, Hong S, Roh B, et al. PVANET: Deep but Lightweight Neural Networks for Real-time Object Detection[C]\\Thirtieth Annual Conference on Neural Information Processing Systems (NIPS), 2016. arXiv:1608.08021

  17. Deepak, K., Yang, C., & Kyungnam, K. (2014). A neuromorphic system for video object recognition. Frontiers in Computational Neuroscience, 8.

  18. Pham, P., Nguyen, D., Do, T., et al. (2017). Evaluation of deep models for real-time small object detection. ICONIP 2017: Neural Information Processing (pp. 516–526).

  19. Duan, B., Wen, P., & Li, P. (2020). Real-time small object detection method based on improved pvanet [J]. Application Research of Computers., 37(2), 279–283. https://doi.org/10.19734/j.issn.1001-3695.2018.06.0577

    Article  Google Scholar 

  20. Ren, S., He, K., Girshick, R., & Sun, J. (2017). Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(6), 1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031.

  21. Smith, L. N. (2017). Cyclical learning rates for training neural networks. 2017 IEEE winter conference on applications of computer vision (WACV), 464–472. https://doi.org/10.1109/WACV.2017.58

  22. Steno, P., Alsadoon, A., Prasad, P., et al. (2020). A novel enhanced region proposal network and modified loss function: threat object detection in secure screening using deep learning. The Journal of Supercomputing, 8, 1–30.

    Google Scholar 

  23. Chen, C., Yang, X., Huang, R., et al. (2020). Region proposal network with graph prior and IoU-balance loss for landmark detection in 3D ultrasound. IEEE ISBI, 2020. IEEE.

  24. Zhu, J., Zhang, G., Zhou, S., et al. (2021). Relation-aware Siamese region proposal network for visual object tracking. Multimedia Tools and Applications, 9.

  25. Guo, P., Xie, G., Li, R. (2019). Object detection using multiview CCA-based graph spectral learning. Journal of Circuits, Systems and Computers, 4.

  26. Zhai, X., Cheng, Z., Wei, Y., et al. (2019). Compressive sensing ghost imaging object detection using generative adversarial networks. Optical Engineering, 58(1), 1.

    Article  Google Scholar 

  27. Gao, M., Yujie, Du., Yang, Y., et al. (2019). Adaptive anchor box mechanism to improve the accuracy in the object detection system. Multimedia Tools and Applications, 78, 27383–27402.

    Article  Google Scholar 

  28. Long, Y., Gong, Y., Xiao, Z., & Liu, Q. (2017). Accurate object localization in remote sensing images based on convolutional neural networks. IEEE Transactions on Geoscience and Remote Sensing, 55(5), 2486–2498.

    Article  Google Scholar 

  29. Dong, R., Xu, D., Zhao, J., Jiao, L., & An, J. (2019). Sig-NMS-based faster R-CNN combining transfer learning for small target detection in VHR optical remote sensing imagery. IEEE Transactions on Geoscience and Remote Sensing, 57(11), 8534–8545. https://doi.org/10.1109/TGRS.2019.2921396

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Mechanical Engineering, Zhengzhou University of Science and Technology, Zhengzhou, China

    Yanyong Han

  2. School of Electrical Engineering, Zhengzhou University of Science and Technology, Zhengzhou, China

    Yandong Han

Authors
  1. Yanyong Han
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yandong Han
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yanyong Han.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Han, Y., Han, Y. A Deep Lightweight Convolutional Neural Network Method for Real-Time Small Object Detection in Optical Remote Sensing Images. Sens Imaging 22, 24 (2021). https://doi.org/10.1007/s11220-021-00348-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11220-021-00348-0

Keywords

Search

Navigation