Skip to main content
Log in

ADGSC: video anomaly detection algorithm based on graph structure change detection in public places

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In real life, the types of anomalous events are diverse and low-frequency, and the collection and labeling of training data is complex. However, most detection algorithms are based on training data and test data, which are difficult to adapt to various monitoring scenarios. In this paper, we propose a video A nomaly D etection algorithm based on G raph S tructure C hange detection, which we call ADGSC. Firstly, we use key frame technique to pre-process the video and enhance the pseudo-periodicity of the video data. Second, our approach proposes an improved DTW algorithm for pseudo-periodicity estimation, which transforms periodicity estimation into a global matching growth rate optimization problem. Thus, the periodicity calculation no longer requires a priori knowledge or parameter settings and can be automatically computed in practical applications. Then, we stitch the normalized HSV histogram and HOG feature descriptors into feature vectors following the period obtained in the previous step for feature extraction of key frames. Further, a sliding window is used to build a graph model to measure the temporal variation of the video data, and median plot denoising is used to reduce the errors caused by feature extraction and metric methods, reduce background, blur and other noise interference, and improve the detection effect. Finally, we use box-line plots and box-line graphs to make decisions. Since we do not use deep learning methods, the evaluation metrics AUC and ROC applied for deep learning are no longer applicable to this method. Instead, our experiments use precision, recall, and F-value, which are commonly used in anomaly detection, to measure the effectiveness of our method. Experiment results show that our algorithm outperforms other current algorithms with unsupervised, adaptive, fault-tolerant, and real-time performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Algorithm 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Data Availability

The datasets analysed during the current study are available at: http://mha.cs.umn.edu/; http://www.cse.cuhk.edu.hk/leojia/projects/detectabnormal/dataset.html

References

  1. Benvenuto D, Giovanetti M, Vassallo L, Angeletti S, Ciccozzi M (2020) Application of the arima model on the covid-2019 epidemic dataset. Data in brief 29:105340

    Article  Google Scholar 

  2. Cewu L u, Shi J, Jia J (2013) Abnormal event detection at 150 fps in matlab. In: Proceedings of the IEEE international conference on computer vision, pp 2720–2727

  3. Chen T, Liu X, Feng R, Wang W, Yuan C, Lu W, He H, Gao H, Ying H, Chen DZ et al (2021) Discriminative cervical lesion detection in colposcopic images with global class activation and local bin excitation. IEEE J Biomed Health Inf 26(4):1411–1421

    Article  Google Scholar 

  4. Chong YS, Tay YH (2017) Abnormal event detection in videos using spatiotemporal autoencoder

  5. Chris C (1978) The holt-winters forecasting procedure. J Royal Stat Soc: Series C (Appl Stat) 27:264–279

    Google Scholar 

  6. Contreras J, Espinola R, Nogales FJ, Conejo AJ (2003) Arima models to predict next-day electricity prices. IEEE Trans Power Syst 18:1014–1020

    Article  Google Scholar 

  7. Cui X, Liu Q, Gao M, Metaxas DN (2011) Abnormal detection using interaction energy potentials. In: CVPR 2011. IEEE, pp 3161–3167

  8. Dan Xu, Ricci E, Yan Y, Song J, Sebe N (2015) Learning deep representations of appearance and motion for anomalous event detection. arXiv:1510.01553

  9. Dehmer M, Mowshowitz A (2011) A history of graph entropy measures. Inf Sci 181:57–78

    Article  MathSciNet  MATH  Google Scholar 

  10. Gandhi T, Trivedi MM (2007) Pedestrian protection issues, survey, and challenges. IEEE Trans Intell Transp Syst 8:413–430

    Article  Google Scholar 

  11. Gao H, Qiu B, Barroso RJD, Hussain W, Xu Y, Wang X (2022) Tsmae: a novel anomaly detection approach for internet of things time series data using memory-augmented autoencoder. IEEE Trans Netw Sci Eng

  12. Gao H, Xiao J, Yin Y, Liu T, Shi J (2022) A mutually supervised graph attention network for few-shot segmentation: the perspective of fully utilizing limited samples. IEEE Trans Neural Netw Learning Syst

  13. Gao H, Xu K, Cao M, Xiao J, Xu Q, Yin Y (2021) The deep features and attention mechanism-based method to dish healthcare under social iot systems: an empirical study with a hand-deep local–global net. IEEE Trans Comput Social Syst 9(1):336–347

    Article  Google Scholar 

  14. Gong F, Han N, Li D (2020) Shiming Tian Trend analysis of building power consumption based on prophet algorithm. In: Asia energy and electrical engineering symposium (AEEES). IEEE, pp 1002–1006

  15. Hasan M, Choi J, Neumann J, Roy-Chowdhury AK, Davis L (2016) Learning temporal regularity in video sequences. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 733–742

  16. Huang K, Tan T (2010) A visual interpretation system for visual surveillance. Pattern Recogn Lett 31:2265–2285

    Article  Google Scholar 

  17. Jian M, Lam K-M, Dong J, Shen L (2014) Visual-patch-attention-aware saliency detection. IEEE Trans Cybern 45(8):1575–1586

    Article  Google Scholar 

  18. Jian M, Wang J, Hui Y u, Wang Gai-Ge (2021) Integrating object proposal with attention networks for video saliency detection. Inf Sci 576:819–830

    Article  MathSciNet  Google Scholar 

  19. Jian M, Wang J, Hui Y u, Wang G, Meng X, Yang L u, Dong J, Yin Y (2021) Visual saliency detection by integrating spatial position prior of object with background cues. Expert Syst Appl 168:114219

    Article  Google Scholar 

  20. Jian M, Yin Y, Dong J, Lam Kin-Man (2018) Content-based image retrieval via a hierarchical-local-feature extraction scheme. Multimed Tools Appl 77(21):29099–29117

    Article  Google Scholar 

  21. Jiang X, Munger A, Bunke H (2001) An median graphs: properties, algorithms, and applications. IEEE Trans Patt Anal Mach Intell 23:1144–1151

    Article  Google Scholar 

  22. Kim J, Grauman K (2009) Observe locally, infer globally: a space-time mrf for detecting abnormal activities with incremental updates. In: 2009 IEEE conference on computer vision and pattern recognition. IEEE, pp 2921–2928

  23. Krubsack DA, Niederjohn RJ (1991) An autocorrelation pitch detector and voicing decision with confidence measures developed for noise-corrupted speech. IEEE Trans Signal Process 39:319–329

    Article  Google Scholar 

  24. Li H (2021) Time works well: dynamic time warping based on time weighting for time series data mining. Inf Sci 547:592–608

    Article  MathSciNet  MATH  Google Scholar 

  25. LiuJingjing T et al (2016) Video anomaly detection algorithm combined with histogram of oriented gradients and optical flow. J Signal Process 32:1

    Google Scholar 

  26. Lu G, Liu J, Yan P (2018) Graph-based structural change detection for rotating machinery monitoring. Mech Syst Signal Process 99:73–82

    Article  Google Scholar 

  27. Lu X, Wang W, Shen J, Crandall D, Gool LV (2021) Segmenting objects from relational visual data. IEEE Trans Patt Anal Mach Intell

  28. Lu X, Wenguan wang, Shen J, Crandall D, Luo J (2020) Zero-shot video object segmentation with co-attention siamese networks. IEEE Trans Patt Anal Mach Intell

  29. Lu X, Wang W, Danelljan M, Zhou T, Shen J, Gool LV (2020) Video object segmentation with episodic graph memory networks. In: European conference on computer vision. Springer, pp 661–679

  30. Michael IJ (2004) Graphical models. Stat Sci 19:140–155

    MathSciNet  MATH  Google Scholar 

  31. Mohamed AA, Alqahtani F, Shalaby A, Tolba A (2022) Texture classification-based feature processing for violence-based anomaly detection in crowded environments. Image Vision Comput:104488

  32. Mubashir M, Shao L, Seed L (2013) A survey on fall detection principles and approaches. Neurocomputing 100:144–152

    Article  Google Scholar 

  33. Müller M (2007) Dynamic time warping, Inf Retriev Music Motion:69–84

  34. Noureen S, Atique S, Roy V, Bayne S (2019) Analysis and application of seasonal arima model in energy demand forecasting: a case study of small scale agricultural load. In: 2019 IEEE 62nd international midwest symposium on circuits and systems (MWSCAS). IEEE, pp 521–524

  35. Oscar T, García-díaz JC, Troncoso A (2020) Initialization methods for multiple seasonal holt–winters forecasting models. Mathematics 8:268

    Article  Google Scholar 

  36. Ribeiro RCM, Marques GT, Santos Paulo Cerqueira dos (2019) Holt-winters forecasting for brazilian natural gas production. Int J Innov Educ and Res 7(6):119–129

    Article  Google Scholar 

  37. Sodemann AA, Ross MP, Borghetti BJ (2012) A review of anomaly detection in automated surveillance. IEEE Transactions on Systems Man, and Cybernetics Part C (Applications and Reviews) 42:1257–1272

    Article  Google Scholar 

  38. Spielman DA (2007) Spectral graph theory and its applications. In: 48th annual IEEE symposium on foundations of computer science (FOCS’07), pp 29–38

  39. Tae HK, Nah S, Lee KM (2016) Dynamic scene deblurring using a locally adaptive linear blur model. arXiv:1603.04265

  40. Taylor SJ, Letham B (2018) Forecasting at scale. American Stat 72:37–45

    Article  MathSciNet  MATH  Google Scholar 

  41. Teh YW (2003) Bethe free energy and contrastive divergence approximations for undirected graphical models

  42. Thirumalai C, Kanimozhi R, Vaishnavi B (2017) Data analysis using box plot on electricity consumption. In: International conference of electronics, communication and aerospace technology (ICECA). IEEE, vol 2, pp 598–600, p 2017

  43. Tirkeş G, Güray C, Neş’e Ç (2017) Demand forecasting a comparison between the holt-winters, trend analysis and decomposition models. Tehnicki vjesnik/Technical Gazette: 24

  44. Ullah H, Khan SD, Ullah M, Cheikh FA (2021) Social modeling meets virtual reality: An immersive implication. In: International conference on pattern recognition. Springer, pp 131–140

  45. Wang W, Lu X, Shen J, Crandall DJ, Shao L (2019) Zero-shot video object segmentation via attentive graph neural networks. In: Proceedings of the IEEE/CVF international conference on computer vision (ICCV)

  46. Xiao J, Xu H, Gao H, Bian M, Li Y (2021) A weakly supervised semantic segmentation network by aggregating seed cues: the multi-object proposal generation perspective. ACM Trans Multimidia Comput Commun Appl 17(1s):1–19

    Article  Google Scholar 

  47. Yang Hu, Zhang Y, Davis L (2013) Unsupervised abnormal crowd activity detection using semiparametric scan statistic. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 767–774

  48. Zhang Y, Qin L, Yao H, Huang Q (2012) Abnormal crowd behavior detection based on social attribute-aware force model. In: 2012 19th IEEE international conference on image processing, pp 2689–2692. IEEE

Download references

Acknowledgements

This paper has undergone several revisions, and these revisions were finally completed successfully main thanks to two people. Wang Xin participated in writing of the manuscript. Caixia Ma is served as scientific advisors.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chen Lyu.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jiang, H., Lyu, C., Gao, Y. et al. ADGSC: video anomaly detection algorithm based on graph structure change detection in public places. Multimed Tools Appl 82, 38923–38945 (2023). https://doi.org/10.1007/s11042-023-15009-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-15009-5

Keywords

Navigation