Skip to main content
SpringerLink
Log in

Maintenance Personnel Detection and Analysis Using Mask-RCNN Optimization on Power Grid Monitoring Video

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

In recent years, deep learning theory and applications have been grown rapidly. Its application aspects has been widely extended to medical care, unmanned driving, intelligent monitoring and other fields. In this paper, we focus on detecting and analyzing the movements of maintenance personnel based on power grid surveillance videos by using MASK-RCNN. Firstly, we detect the maintenance personnel in the video data using optimized MASK-RCNN network. Then, we plot the corresponding personnel path image using segmentation and centroid detection, which can accurately count the personnel trajectory with in-and-out information. Secondly, this paper introduce a tracking-learning-detection algorithm to further track and analyze interested feature events of power grid video. The experimental results show that our algorithm can accurately detect multiple personnel and obtain the key features of the video contents.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Szegedy C et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9

  2. Russakovsky O et al (2015) Imagenet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252

    Article  MathSciNet  Google Scholar 

  3. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

  4. Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In: AAAI, vol 4, p 12

  5. Karpathy A, Toderici G, Shetty S, Leung T, Sukthankar R, Fei-Fei L (2014) Large-scale video classification with convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1725–1732

  6. Yue-Hei Ng J, Hausknecht M, Vijayanarasimhan S, Vinyals O, Monga R, Toderici G (2015) Beyond short snippets: Deep networks for video classification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4694–4702

  7. Wu Z, Wang X, Jiang Y-G, Ye H, Xue X (2015) Modeling spatial-temporal clues in a hybrid deep learning framework for video classification. In Proceedings of the 23rd ACM international conference on multimedia. ACM, pp 461–470

  8. Nie L et al (2017) Enhancing Micro-video understanding by harnessing external sounds. In: Presented at the Proceedings of the 25th ACM international conference on multimedia, Mountain View, California, USA

  9. Hao C, Yapin H, Jiongcong C (2014) Study on application of intelligent network video monitoring system. Electro Test 1:10–16

    Google Scholar 

  10. Yang Y, Liu C, Huang L (2010) Application of image and video analysis in monitor system of power equipment. J Comput Appl 30:281–284

    Google Scholar 

  11. Tianbing K, Yongqian L (2014) Research of object detection and tracking algorithm on the video surveillance in electric power system. Electr Power Sci Eng 30:42–46

    Google Scholar 

  12. Qing W, Yaoquan Y (2018) Research on moving target detection algorithm in power monitoring system. Electr Power Sci Eng 5:71–77

    Google Scholar 

  13. De P, Qin Z, Wan D et al (2002) Application of video monitoring and intelligent warning system at unattended substations. Heilongjiang Electr Power 5:43–50

    Google Scholar 

  14. Limin W, Yanwei G, Xinyu L (2010) Automatic tracking system for non-attended substation based on image procession. J North China Univ Water Resour Electr Power (Nat Sci Ed) 1:20–27

    Google Scholar 

  15. He K, Gkioxari G, Dollár P, Girshick R (2017) Mask r-cnn. In 2017 IEEE international conference on computer vision (ICCV). IEEE, pp 2980–2988

  16. Girshick R (2015) Fast r-cnn. In Proceedings of the IEEE international conference on computer vision, pp 1440–1448

  17. Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431–3440

Download references

Acknowledgements

Funding was provided by Major Research Plan (Grant No. 61871319) and Natural Science Foundation of Shaanxi Province (Grant No. 2019JM-221).

Author information

Authors and Affiliations

  1. State Grid Zhejiang Electric Power Company Information and Telecommunication Branch, Hangzhou, 310002, China

    Tong Chen, Ying Jiang, Wang Jian & Lanxin Qiu

  2. Xi’an University of Technology, Xi’an, China

    Huan Liu & Zhaolin Xiao

Authors
  1. Tong Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ying Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wang Jian
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lanxin Qiu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Huan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Zhaolin Xiao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhaolin Xiao.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, T., Jiang, Y., Jian, W. et al. Maintenance Personnel Detection and Analysis Using Mask-RCNN Optimization on Power Grid Monitoring Video. Neural Process Lett 51, 1599–1610 (2020). https://doi.org/10.1007/s11063-019-10159-w

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-019-10159-w

Keywords

Search

Navigation