Skip to main content
SpringerLink
Log in

RBFPDet: An anchor-free helmet wearing detection method

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Wearing a safety helmet can reduce the accident rate in production and construction, and it is a necessary part of safety production management. At present, the effective supervision of helmet wearing still relies on manual on-site work, which is inefficient and wastes manpower and material resources. Therefore, the automatic supervision of helmet wearing detection is of great significance. Due to the detection difficulties such as small helmet target, complex background and variety of helmet shape with the posture of workers, helmet wearing detection has always been one of the most difficult tasks in the field of computer vision. To address this issue, we propose a novel object detection model based on anchor-free mechanism—Recurrent Bidirectional Feature Pyramid Detector (RBFPDet). Different from most other detection methods, we regard helmet wearing detection as a strong semantic feature points detection task. In order to prove the effectiveness of our method, we conduct control experiment and ablation study on two mainstream safety helmet wearing datasets. The experiment results show that our method significantly improves the accuracy of helmet wearing detection compared with other outstanding detection models in this field and our model can realize real-time detection under complex background. At the same time, we further intuitively illustrate the effectiveness of our method by means of feature map visualization.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. MOHURD (2019) Circular of the general office of the Ministry of housing and urban rural development on production safety accidents of municipal housing projects in 2019. Ministry of Housing and Urban-Rural Development of the People’s Republic of China. http://www.mohurd.gov.cn/wjfb/202006/t20200624_246031.html. Accessed 10 July 2021

  2. HSE (2021) Work-related fatal injuries in Great Britain. UK Health and Safety Executive. https://www.hse.gov.uk/statistics/fatals.htm. Accessed 10 July 2021

  3. Wang Z, Wu Y, Yang L, Thirunavukarasu A, Evison C, Zhao Y (2021) Fast personal protective equipment detection for real construction sites using deep learning approaches. Sensors 21(10):3478. https://doi.org/10.3390/s21103478

    Article  Google Scholar 

  4. Luo XC, Li H, Yang XC, Yu YT (2018) Capturing and understanding workers’ activities in far-field surveillance videos with deep action recognition and Bayesian nonparametric learning. Comput-Aided Civ Inf Eng 34(4):333–351. https://doi.org/10.1111/mice.12419

    Article  Google Scholar 

  5. Shen J, Xiong X, Li Y, He W, Li P, Zheng XY (2020) Detecting safety helmet wearing on construction sites with bounding-box regression and deep transfer learning. Comput-Aided Civ Inf Eng 36:180–196. https://doi.org/10.1111/mice.12579

    Article  Google Scholar 

  6. Tan MX, Pang RM, Le QV (2020) EfficientDet: Scalable and Efficient Object Detection. In: 2020 IEEE/CVF conference on computer vision and pattern recognition (CVPR). https://doi.org/10.1109/CVPR42600.2020.01079

  7. Safety-Helmet-Wearing-Dataset. https://github.com/njvisionpower/Safety-Helmet-Wearing-Dataset. Accessed 28 October 2020

  8. Safety Helmet Detection Dataset, https://www.kaggle.com/andrewmvd/hard-hat-detection. Accessed 25 December 2021

  9. Kim Y, Baek J, Choi Y (2021) Smart Helmet-Based personnel proximity warning system for improving underground mine safety. Appl Sci 11(10):4342. https://doi.org/10.3390/app11104342

    Article  Google Scholar 

  10. Shravya K, Mandapati Y, Keerthi D, Harika K, Senapati RK (2019) Smart helmet for safe driving. E3S Web Conferences. https://doi.org/10.1051/e3sconf/20198701023

  11. Zhang H, Yan X, Li H, Jin R, Fu HF (2019) Real-Time Alarming, monitoring, and locating for Non-Hard-Hat use in construction. J Constr Eng Manag 145:1–13. https://doi.org/10.1061/(asce)co.1943-7862.0001629

    Article  Google Scholar 

  12. Silva RR, Aires KR, Veras RD (2018) Detection of helmets on motorcyclists. Multimed Tools Appl 77(5):5659–5683. https://doi.org/10.1007/s11042-017-4482-7

    Article  Google Scholar 

  13. Wu H, Zhao JS (2018) An intelligent vision-based approach for helmet identification for work safety - ScienceDirect. Comput Ind 100:267–277. https://doi.org/10.1016/j.compind.2018.03.037

    Article  Google Scholar 

  14. Su J, Yang L, Huang H, Jin GD (2020) Improved SSD algorithm for ship detection of small targets in SAR images. Syst Eng Electron 42(5):1026–1034. https://doi.org/10.3969/j.issn.1001-506X.2020.05.08

    Google Scholar 

  15. Krizhevsky A, Sutskever I, Hinton G (2017) Imagenet classification with deep convolutional neural networks. Commun ACM 60(6):84–90. https://doi.org/10.1145/3065386

    Article  Google Scholar 

  16. Simonyan K, Zisserman A (2014) Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv:1409.1556

  17. He KM, Zhang XY, Ren SQ, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the 2016 IEEE conference on computer vision and pattern recognition (CVPR). https://doi.org/10.1109/CVPR.2016.90

  18. Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR. https://doi.org/10.1109/CVPR.2014.81

  19. Girshick R (2015) Fast R-CNN. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). arXiv:1504.08083

  20. Redmon J, Farhadi A (2018) YOLOv3: An Incremental Improvement. arXiv:1804.02767

  21. Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC (2016) SSD: Single shot multibox detector. In: Proceedings of the European conference on computer vision (ECCV), pp 21–37. https://doi.org/10.1007/978-3-319-46448-0_2

  22. Wang H, Hu Z, Guo Y, Yang Z, Zhou F, Xu P (2020) A real-time safety helmet wearing detection approach based on CSYOLOv3. Appl Sci 10(19):6732. https://doi.org/10.3390/app10196732

    Article  Google Scholar 

  23. Cheng R, He X, Zheng Z, Wang Z (2021) Multi-scale safety helmet detection based on SAS-YOLOv3-tiny. Appl Sci 11(8):3652. https://doi.org/10.3390/app11083652

    Article  Google Scholar 

  24. Li Y, Wei H, Han Z, Huang JL, Wang WD (2020) Deep Learning-Based safety helmet detection in engineering management based on convolutional neural networks. Adv Civ Eng 2020 (6):1–10. https://doi.org/10.1155/2020/9703560

    Article  Google Scholar 

  25. Ghiasi G, Lin TY, Le QV (2019) NAS-FPN: Learning scalable feature pyramid architecture for object detection. In: 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR). https://doi.org/10.1109/CVPR.2019.00720

  26. Liu W, Hasan I, Liao SC (2019) Center and scale prediction: A box-free approach for pedestrian and face detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). arXiv:1904.02948v3

  27. Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: Unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). https://doi.org/10.1109/CVPR.2016.91

  28. Tian Z, Shen C, Chen H, He T (2019) FCOS: Fully convolutional one-stage object detection. In: 2019 IEEE/CVF international conference on computer vision (ICCV). https://doi.org/10.1109/ICCV.2019.00972

  29. Law H, Deng J (2020) Cornernet: Detecting objects as paired keypoints. Int J Comput Vis 128(3):642–656. https://doi.org/10.1007/s11263-019-01204-1

    Article  Google Scholar 

  30. Zhou XY, Wang DQ, Krhenbühl P (2019) Objects as Points. arXiv:1904.07850

  31. Lin TY, Dollar P, Girshick R, He KM, Hariharan B, Belongie A (2017) Feature pyramid networks for object detection. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR. https://doi.org/10.1109/CVPR.2017.106

  32. Liu S, Qi L, Qin HF, Shi JP, Jia JY (2018) Path aggregation network for instance segmentation. In: 2018 IEEE/CVF conference on computer vision and pattern recognition (ICCV. https://doi.org/10.1109/CVPR.2018.00913

  33. Luo WJ, Li YJ, Urtasun R, Zemel R (2017) Understanding the Effective Receptive Field in Deep Convolutional Neural Networks. arXiv:1701.04128v1

  34. Wang XL, Girshick R, Gupta A, He KM (2017) Non-local Neural Networks. arXiv:1711.07971

  35. Pang JM, Chen K, Shi JP, Feng HJ, Ouyang W, Lin DH (2019) Libra R-CNN: Towards balanced learning for object detection. In: 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR). https://doi.org/10.1109/CVPR.2019.00091https://doi.org/10.1109/CVPR.2019.00091

  36. Han G, Zhu MC, Zhao XC, Gao H (2021) Method Based on the Cross-layer Attention Mechanism and Multiscale Perception for Safety Helmet-wearing Detection. Computers & Electrical Engineering. https://doi.org/10.1016/j.compeleceng.2021.107458

Download references

Author information

Authors and Affiliations

  1. School of Computer Science, Northeast Electric Power University, No.169 Changchun Road, Jilin, 132012, Jilin, China

    Renjie Song & Ziming Wang

Authors
  1. Renjie Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ziming Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ziming Wang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Song, R., Wang, Z. RBFPDet: An anchor-free helmet wearing detection method. Appl Intell 53, 5013–5028 (2023). https://doi.org/10.1007/s10489-022-03664-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-03664-4

Keywords

Search

Navigation