Skip to main content
SpringerLink
Log in

A real-time detection for miner behavior via DYS-YOLOv8n model

  • Research
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

To address the issues of low real-time performance and poor algorithm accuracy in detecting miner behavior underground, we propose a high-precision real-time detection method named DSY-YOLOv8n based on the characteristics of human body behavior. This method integrates DSConv into the backbone network to enhance multi-scale feature extraction. Additionally, SCConv-C2f replaces C2f modules, reducing redundant calculations and improving model training speed. The optimization strategy of the loss function is employed, and MPDIoU is used to improve the model’s accuracy and speed. The experimental results show: (1) With almost no increase in parameters and calculation amount, the mAP50 of the DSY-YOLOv8n model is 97.4%, which is a 3.2% great improvement over the YOLOv8n model. (2) Compared to Faster-R-CNN, YOLOv5s, and YOLOv7, DYS-YOLOv8n has improved the average accuracy to varying degrees while significantly increasing the detection speed. (3) DYS-YOLOv8n meets the real-time requirements for behavioral detection in mines with a detection speed of 243FPS. In summary, the DYS-YOLOv8n offers a real-time, efficient, and lightweight method for detecting miner behavior in mines, which has high practical value.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data availability

Data will be made available on request.

References

  1. Xiaobin, Y., Shilu, Z., Na, L.I., Xiaoyao, W.: Deep learning and its application in coal mine safety. Safety in Coal Mines (2019)

  2. Wu, B., Wang, J., Zhong, M., Xu, C., Qu, B.: Multidimensional analysis of coal mine safety accidents in china—70 years review. In: Mining, Metallurgy & Exploration, pp. 1–10 (2022)

  3. Ren, S., He, K., Girshick, R., Sun, J.: Faster r-cnn: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2017)

    Article  Google Scholar 

  4. Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: Computer vision & pattern recognition (2016)

  5. Farhadi, A., Redmon, J.: Yolo9000: better, faster, stronger (2016)

  6. Redmon, J., Farhadi, A.: Yolov3: an incremental improvement. arXiv e-prints (2018)

  7. Bochkovskiy, A., Wang, C.Y., Liao, H.Y.M.: Yolov4: optimal speed and accuracy of object detection (2020)

  8. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. IEEE (2016)

  9. Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks (2017)

  10. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., Adam, H.: Mobilenets: efficient convolutional neural networks for mobile vision applications (2017)

  11. Zhu, X., Lyu, S., Wang, X., Zhao, Q.: Tph-yolov5: Improved yolov5 based on transformer prediction head for object detection on drone-captured scenarios (2021)

  12. Ge, Z., Liu, S., Wang, F., Li, Z., Sun, J.: Yolox: exceeding yolo series in 2021 (2021)

  13. Cao, X., Zhang, C., Wang, P., Wei, H., Huang, S., Li, H.: Unsafe mining behavior identification method based on an improved st-gcn. Sustainability 15(2) (2023)

  14. Shi, X., Huang, J., Huang, B.: An underground abnormal behavior recognition method based on an optimized alphapose-st-gcn. J. Circuits Syst. Comput. (2022)

  15. Liu, S., Bai, X., Fang, M., Li, L., Hung, C.C.: Mixed graph convolution and residual transformation network for skeleton-based action recognition. Appl. Intell. 1–12 (2021)

  16. Zhang, P., Lan, C., Zeng, W., Xing, J., Zheng, N.: Semantics-guided neural networks for efficient skeleton-based human action recognition. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2020)

  17. Yang, H., Gu, Y., Zhu, J., Hu, K., Zhang, X.: Pgcn-tca: pseudo graph convolutional network with temporal and channel-wise attention for skeleton-based action recognition. IEEE Access 8, 8 (2020)

    Google Scholar 

  18. Shi, L., Zhang, Y., Cheng, J., Lu, H.: Two-stream adaptive graph convolutional networks for skeleton-based action recognition (2018)

  19. Rijayanti, R., Hwang, M., Jin, K.: Detection of anomalous behavior of manufacturing workers using deep learning-based recognition of human-object interaction. Appl. Sci. 13(15), 8584 (2023)

    Article  Google Scholar 

  20. Li, X., Hao, T., Li, F., Zhao, L., Wang, Z.: Faster r-cnn-lstm construction site unsafe behavior recognition model. Appl. Sci. 13(19), 10700 (2023)

    Article  Google Scholar 

  21. Yao, W., Wang, A., Nie, Y., Lv, Z., Nie, S., Huang, C., Liu, Z.: Study on the recognition of coal miners’ unsafe behavior and status in the hoist cage based on machine vision. Sensors 23(21), 8794 (2023)

    Article  Google Scholar 

  22. Li, L., Zhang, P., Yang, S., Jiao, W.: Yolov5-sfe: an algorithm fusing spatio-temporal features for detecting and recognizing workers’ operating behaviors. Adv. Eng. Inform. 56, 101988 (2023)

    Article  Google Scholar 

  23. Shao, X., Liu, S., Li, X., Lyu, Z., Li, H.: Rep-yolo: an efficient detection method for mine personnel. J. Real-Time Image Proc. 21(2), 1–16 (2024)

    Article  Google Scholar 

  24. Li, X., Wang, S., Liu, B., Chen, W., Fan, W., Tian, Z.: Improved yolov4 network using infrared images for personnel detection in coal mines. J. Electron. Imaging 31(1), 013017 (2022)

    Article  Google Scholar 

  25. Zhao, D., Guoyong, S., Cheng, G., Wang, P., Chen, W., Yang, Y.: Research on real-time perception method of key targets in the comprehensive excavation working face of coal mine. Meas. Sci. Technol. 35(1), 015410 (2023)

    Article  Google Scholar 

  26. Zhi, X., Li, J., Meng, Y., Zhang, X.: Cap-yolo: channel attention based pruning yolo for coal mine real-time intelligent monitoring. Sensors 22(12), 4331 (2022)

    Article  Google Scholar 

  27. Fan, Y., Mao, S., Li, M., Wu, Z., Kang, J.: Cm-yolov8: lightweight yolo for coal mine fully mechanized mining face (2024)

  28. Yu, F., Koltun, V.: Multi-scale context aggregation by dilated convolutions. In: ICLR (2016)

  29. Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., Wei, Y.: Deformable convolutional networks. IEEE (2017)

  30. Qi, Y., He, Y., Qi, X., Zhang, Y., Yang, G.: Dynamic snake convolution based on topological geometric constraints for tubular structure segmentation. In: 2023 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 6047–6056 (2023)

  31. Li, J., Wen, Y., He, L.: Scconv: spatial and channel reconstruction convolution for feature redundancy. In: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6153–6162 (2023)

  32. Ma, S., Yong, X.: Mpdiou: a loss for efficient and accurate bounding box regression (2023)

  33. Yang, W., Zhang, X., Ma, B., Wang, Y., Wu, Y., Yan, J., Liu, Y., Zhang, C., Wan, J., Wang, Y.: An open dataset for intelligent recognition and classification of abnormal condition in longwall mining. Sci. Data 10(1) (2023)

Download references

Acknowledgements

This work is supported by the Xi’an Science and Technology Program (23ZDCYJSGG0025-2022), the General Project of Science and Technology Department of Shaanxi Province (2021JQ-574), the Science ResearchProgram of Shaanxi Educational Committee under Grant 23JC049, Science and Technology Innovation Fund Special project of Tiandi (Changzhou) Automation Co., Ltd. (2022TY2012).

Author information

Authors and Affiliations

  1. College of Electrical and Control Engineering, Xi’an University of Science and Technology, Xi’an, 710054, Shaanxi, China

    Fangfang Xin, Xinyu He & Hongguang Pan

  2. Xi’an Key Laboratory of Electrical Equipment Condition Monitoring and Power Supply Security, Xi’an, 710054, Shaanxi, China

    Fangfang Xin, Xinyu He & Hongguang Pan

  3. Tiandi (Changzhou) Automation Co., Ltd., Changzhou, 213015, China

    Chaoxiu Yao

  4. CHN Energy Shendong Coal Group Design Company, Shenmu, 719315, Shaanxi, China

    Shan Li & Biao Ma

Authors
  1. Fangfang Xin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xinyu He
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chaoxiu Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Biao Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hongguang Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

FX: methodology, software, formal analysis, investigation. XH: supervision, writing—original draft, writing—review editing, funding acquisition. CY: conceptualization, methodology, validation, supervision. SL: conceptualization, methodology, validation, supervision, modification. BM: conceptualization, methodology, validation, supervision, modification. HP: conceptualization, methodology, validation, supervision.

Corresponding author

Correspondence to Hongguang Pan.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xin, F., He, X., Yao, C. et al. A real-time detection for miner behavior via DYS-YOLOv8n model. J Real-Time Image Proc 21, 92 (2024). https://doi.org/10.1007/s11554-024-01466-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11554-024-01466-0

Keywords

Search

Navigation