Skip to main content
SpringerLink
Log in

EMO-YOLO: a lightweight ship detection model for SAR images based on YOLOv5s

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Enhancing maritime alert capabilities relies on effective Synthetic Aperture Radar (SAR) ship detection, often achieved through deep learning techniques. However, existing SAR ship detection models face challenges due to their large sizes, rendering them impractical for deployment on resource-constrained devices. Moreover, the complexity of ship backgrounds and the small size of ship targets contribute to decreased detection accuracy. In response, this paper proposes a lightweight ship detection model based on YOLOv5s. Our approach involves restructuring the original model, with a focus on an Efficient Model as the backbone. We achieve model lightweighting by employing a simple stacked Inverted Residual Mobile Block. Additionally, we introduce an enhancement feature extraction module, SCConv_C3, which utilizes Spatial and Channel Reconstruction Convolution (SCConv) to eliminate channel and spatial redundancies in the image while enhancing feature representation capabilities. Furthermore, we integrate Triplet Attention after feature fusion to enhance detection capabilities for small ship targets. Experimental evaluations were conducted on four public datasets. The results demonstrate that our proposed lightweight model maintains high detection accuracy even in challenging scenarios, including complex backgrounds and small ship targets. Notably, on the SSDD dataset, the AP\(_{50}\) value reaches 97.8%, surpassing other advanced detection models such as YOLOv5s.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Data availability

The data that support the findings of this study are available from the authors.

References

  1. Shao, Z., Zhang, T., Ke, X.: A dual-polarization information-guided network for SAR ship classification. Remote Sens. 15(8), 2138 (2023)

    Article  Google Scholar 

  2. Zhang, T., Zhang, X.: Squeeze-and-excitation Laplacian pyramid network with dual-polarization feature fusion for ship classification in SAR images. IEEE Geosci. Remote Sens. Lett. 19, 1–5 (2021)

    Google Scholar 

  3. Shao, Z., Zhang, X., Zhang, T., Xu, X., Zeng, T.: Rbfa-net: a rotated balanced feature-aligned network for rotated SAR ship detection and classification. Remote Sens. 14(14), 3345 (2022)

    Article  Google Scholar 

  4. Zhang, T., Zhang, X., Liu, C., Shi, J., Wei, S., Ahmad, I., Zhan, X., Zhou, Y., Pan, D., Li, J.: Balance learning for ship detection from synthetic aperture radar remote sensing imagery. ISPRS J. Photogramm. Remote. Sens. 182, 190–207 (2021)

    Article  Google Scholar 

  5. Zhang, T., Zhang, X., Shi, J., Wei, S., Wang, J., Li, J., Su, H., Zhou, Y.: Balance scene learning mechanism for offshore and inshore ship detection in SAR images. IEEE Geosci. Remote Sens. Lett. 19, 1–5 (2020)

    Google Scholar 

  6. Li, S., Fu, X., Dong, J.: Improved ship detection algorithm based on Yolox for SAR outline enhancement image. Remote Sens. 14(16), 4070 (2022)

    Article  Google Scholar 

  7. Zhao, K., Lu, R., Wang, S., Yang, X., Li, Q., Fan, J.: St-yoloa: a swin-transformer-based yolo model with an attention mechanism for SAR ship detection under complex background. Front. Neurorobot. 17, 1170163 (2023)

    Article  Google Scholar 

  8. Chen, S.-W., Cui, X.-C., Wang, X.-S., Xiao, S.-P.: Speckle-free SAR image ship detection. IEEE Trans. Image Process. 30, 5969–5983 (2021)

    Article  Google Scholar 

  9. Kakoolvand, A., Imani, M., Ghassemian, H.: Unsupervised change detection in SAR images based on generalized likelihood ratio test and a two-stage morphological filter. Int. J. Remote Sens. 43(12), 4630–4662 (2022)

    Article  Google Scholar 

  10. Wang, Z., Wang, R., Fu, X., Xia, K.: Unsupervised ship detection for single-channel SAR images based on multiscale saliency and complex signal kurtosis. IEEE Geosci. Remote Sens. Lett. 19, 1–5 (2021)

    Google Scholar 

  11. Yuan, Z., Li, Y., Liu, Y., Liang, J., Zhang, Y.: Unsupervised ship detection in SAR imagery based on energy density-induced clustering. Int. J. Netw. Dyn. Intell. 2, 100006–100006 (2023)

    Google Scholar 

  12. Yang, X., Zhang, X., Wang, N., Gao, X.: A robust one-stage detector for multiscale ship detection with complex background in massive SAR images. IEEE Trans. Geosci. Remote Sens. 60, 1–12 (2021)

    Google Scholar 

  13. Chen, Z., Liu, C., Filaretov, V.F., Yukhimets, D.A.: Multi-scale ship detection algorithm based on yolov7 for complex scene SAR images. Remote Sens. 15(8), 2071 (2023)

    Article  Google Scholar 

  14. Tang, G., Zhao, H., Claramunt, C., Zhu, W., Wang, S., Wang, Y., Ding, Y.: Ppa-net: pyramid pooling attention network for multi-scale ship detection in SAR images. Remote Sens. 15(11), 2855 (2023)

    Article  Google Scholar 

  15. Bai, L., Yao, C., Ye, Z., Xue, D., Lin, X., Hui, M.: Feature enhancement pyramid and shallow feature reconstruction network for SAR ship detection. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 16, 1042–1056 (2023)

    Article  Google Scholar 

  16. Zhang, T., Zhang, X.: A mask attention interaction and scale enhancement network for SAR ship instance segmentation. IEEE Geosci. Remote Sens. Lett. 19, 1–5 (2022)

    Google Scholar 

  17. Zhang, T., Zhang, X.: A full-level context squeeze-and-excitation ROI extractor for SAR ship instance segmentation. IEEE Geosci. Remote Sens. Lett. 19, 1–5 (2022)

    Google Scholar 

  18. Zhang, T., Zhang, X.: A polarization fusion network with geometric feature embedding for SAR ship classification. Pattern Recogn. 123, 108365 (2022)

    Article  Google Scholar 

  19. Tan, M., Pang, R., Le, Q.V.: Efficientdet: scalable and efficient object detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 10781–10790 (2020)

  20. Yang, Y., Ju, Y., Zhou, Z.: A super lightweight and efficient SAR image ship detector. IEEE Geosci. Remote Sens. Lett. 20, 4006805 (2023)

    Google Scholar 

  21. Huang, R., Pedoeem, J., Chen, C.: Yolo-lite: a real-time object detection algorithm optimized for non-gpu computers. In: 2018 IEEE International Conference on Big Data (big Data), pp. 2503–2510. IEEE (2018)

  22. Zhang, T., Zhang, X.: High-speed ship detection in SAR images based on a grid convolutional neural network. Remote Sens. 11(10), 1206 (2019)

    Article  Google Scholar 

  23. Zhou, L., Yu, H., Wang, Y., Xu, S., Gong, S., Xing, M.: Lasdnet: a lightweight anchor-free ship detection network for sar images. In: IGARSS 2022-2022 IEEE International Geoscience and Remote Sensing Symposium, pp. 2630–2633. IEEE (2022)

  24. Zhang, T., Zhang, X., Shi, J., Wei, S.: Depthwise separable convolution neural network for high-speed SAR ship detection. Remote Sens. 11(21), 2483 (2019)

    Article  Google Scholar 

  25. Miao, T., Zeng, H., Yang, W., Chu, B., Zou, F., Ren, W., Chen, J.: An improved lightweight retinanet for ship detection in SAR images. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 15, 4667–4679 (2022)

    Article  Google Scholar 

  26. Li, Y., Zhang, S., Wang, W.-Q.: A lightweight faster r-cnn for ship detection in SAR images. IEEE Geosci. Remote Sens. Lett. 19, 1–5 (2020)

    Google Scholar 

  27. Zhang, T., Zhang, X.: Shipdenet-20: an only 20 convolution layers and< 1-mb lightweight sar ship detector. IEEE Geosci. Remote Sens. Lett. 18(7), 1234–1238 (2020)

    Article  Google Scholar 

  28. Zhang, T., Zhang, X., Shi, J., Wei, S.: Hyperli-net: a hyper-light deep learning network for high-accurate and high-speed ship detection from synthetic aperture radar imagery. ISPRS J. Photogramm. Remote Sens. 167, 123–153 (2020)

    Article  Google Scholar 

  29. Guo, H., Yang, X., Wang, N., Gao, X.: A centernet++ model for ship detection in SAR images. Pattern Recogn. 112, 107787 (2021)

    Article  Google Scholar 

  30. Zhu, M., Hu, G., Zhou, H., Wang, S., Feng, Z., Yue, S.: A ship detection method via redesigned FCOS in large-scale SAR images. Remote Sens. 14(5), 1153 (2022)

    Article  Google Scholar 

  31. Xu, X., Zhang, X., Zhang, T.: Lite-yolov5: a lightweight deep learning detector for on-board ship detection in large-scene sentinel-1 SAR images. Remote Sens. 14(4), 1018 (2022)

    Article  Google Scholar 

  32. Xiong, B., Sun, Z., Wang, J., Leng, X., Ji, K.: A lightweight model for ship detection and recognition in complex-scene SAR images. Remote Sens. 14(23), 6053 (2022)

    Article  Google Scholar 

  33. Pang, L., Li, B., Zhang, F., Meng, X., Zhang, L.: A lightweight yolov5-MNE algorithm for SAR ship detection. Sensors 22(18), 7088 (2022)

    Article  Google Scholar 

  34. Ren, X., Bai, Y., Liu, G., Zhang, P.: Yolo-lite: an efficient lightweight network for SAR ship detection. Remote Sens. 15(15), 3771 (2023)

    Article  Google Scholar 

  35. Zhang, J., Li, X., Li, J., Liu, L., Xue, Z., Zhang, B., Jiang, Z., Huang, T., Wang, Y., Wang, C.: Rethinking mobile block for efficient neural models. arXiv preprint arXiv:2301.01146 (2023)

  36. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I.: Attention is all you need. Adv. Neural Inf. Process. Syst. 30 (2017)

  37. Jocher, G., Chaurasia, A., Stoken, A., Borovec, J., Kwon, Y., Michael, K., Fang, J., Yifu, Z., Wong, C., Montes, D., et al.: Ultralytics/yolov5: v7. 0-yolov5 sota realtime instance segmentation. Zenodo (2022)

  38. Li, J., Wen, Y., He, L.: Scconv: spatial and channel reconstruction convolution for feature redundancy. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6153–6162 (2023)

  39. Misra, D., Nalamada, T., Arasanipalai, A.U., Hou, Q.: Rotate to attend: convolutional triplet attention module. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 3139–3148 (2021)

  40. Wang, Y., Wang, C., Zhang, H., Dong, Y., Wei, S.: A SAR dataset of ship detection for deep learning under complex backgrounds. Remote Sens. 11(7), 765 (2019)

    Article  Google Scholar 

  41. Wei, S., Zeng, X., Qu, Q., Wang, M., Su, H., Shi, J.: Hrsid: a high-resolution SAR images dataset for ship detection and instance segmentation. IEEE Access 8, 120234–120254 (2020)

    Article  Google Scholar 

  42. Li, J., Qu, C., Shao, J.: Ship detection in SAR images based on an improved faster r-cnn. In: 2017 SAR in Big Data Era: Models, Methods and Applications (BIGSARDATA), pp. 1–6. IEEE (2017)

  43. Zhang, T., Zhang, X., Ke, X., Zhan, X., Shi, J., Wei, S., Pan, D., Li, J., Su, H., Zhou, Y.: Ls-ssdd-v1. 0: a deep learning dataset dedicated to small ship detection from large-scale sentinel-1 sar images. Remote Sens 12(18), 2997 (2020)

Download references

Funding

Not applicable.

Author information

Authors and Affiliations

  1. School of Information and Electronic Engineering, Shandong Technology and Business University, Yantai, 264003, China

    Hao Pan, Shaopeng Guan & Wanhai Jia

Authors
  1. Hao Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shaopeng Guan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wanhai Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

The research for this paper was done collaboratively by all authors. Hao Pan and Shaopeng Guan participated in the conceptualization of the study and wrote the manuscript; Wanhai Jia assisted with the analysis and constructive discussions. All authors read, revised and approved the final manuscript.

Corresponding author

Correspondence to Shaopeng Guan.

Ethics declarations

Conflict of interest

The authors declare that there are no conflict of interest regarding the publication of this paper.

Ethics approval

Not applicable.

Consent for publication

The authors agree to publication of the article in English by Springer.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pan, H., Guan, S. & Jia, W. EMO-YOLO: a lightweight ship detection model for SAR images based on YOLOv5s. SIViP (2024). https://doi.org/10.1007/s11760-024-03258-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11760-024-03258-2

Keywords

Search

Navigation