Skip to main content
SpringerLink
Log in

Unsupervised deep learning system for local anomaly event detection in crowded scenes

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Anomaly detection in video surveillance is a significant research subject because of its immense use in real-time applications. These days, open spots like hospitals, traffic areas, airports are monitored by video surveillance cameras. Strange occasions in these recordings have alluded to the anomaly. Unsupervised anomaly detection in the video be endowed with many challenges as there is no exact definition of abnormal events. It varies as for various situations. This paper aims to propose an effective unsupervised deep learning framework for video anomaly detection. Raw image sequences are combined with edge image sequences and given as input to the convolutional auto encoder-ConvLSTM model. Experimental evaluation of the proposed work is performed in three different benchmark datasets such as Avenue, UCSD ped1 and UCSD ped2. The proposed method Hybrid Deep Learning framework for Video Anomaly Detection (HDLVAD) reaches better accuracy compared to existing methods. Investigating video streaming in big data is our further research work.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Amraee S, Vafaei A, Jamshidi K, Adibi P (2018) Abnormal event detection in crowded scenes using one-class SVM, vol. 12

  2. Amraee S, Vafaei A, Jamshidi K, Adibi P (2018) Anomaly detection and localization in crowded scenes using connected component analysis. Multimed Tools Appl 77(12):14767–14782

    Article  Google Scholar 

  3. Canny J (1986) A computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell (6):679–698

  4. Chaker R, Aghbari ZA, Junejo IN Social network model for crowd anomaly detection and localization. Pattern Recogn 61:266–281

  5. Cheng KW, Chen YT, Fang WH (2015) Video anomaly detection and localization using hierarchical feature representation and Gaussian process regression. pp. 2909–2917

  6. Chong YS, Tay YH (2017) Abnormal event detection in videos using spatiotemporal autoencoder. In: International Symposium on Neural Networks, pp. 189–196

  7. Colque RVHM, Caetano C, Andrade MTL, Schwartz WR (2017) Histograms of optical flow orientation and magnitude and entropy to detect anomalous events in videos. IEEE Transactions on Circuits and Systems for Video Technology 27(3):673–682

    Article  Google Scholar 

  8. Cong Y, Yuan J, Liu J (2013) Abnormal event detection in crowded scenes using sparse representation. Pattern Recogn 46(7):1851–1864

    Article  Google Scholar 

  9. Fang Z, Fei F, Fang Y, Lee C, Xiong N, Shu L, Chen S. (2016) Abnormal event detection in crowded scenes based on deep learning, vol. 75

  10. Feng Y, Yuan Y, Lu X:X (2016) Deep representation for abnormal event detection in crowded scenes. Neurocomputing 219:591–595

    Google Scholar 

  11. Feng Y, Yuan Y, Lu X (2017) Learning deep event models for crowd anomaly detection. Neurocomputing 219:548–556

    Article  Google Scholar 

  12. Haering N, Venetianer PL, Lipton A (2008) The evolution of video surveillance: an overview, vol. 19

  13. Hu X, Huang Y, Duan Q, Ci W, Dai J, Yang H. (2018) Abnormal event detection in crowded scenes using histogram of oriented contextual gradient descriptor, vol. 2018

  14. Huang S, Huang D, Zhou X (2018) Learning multimodal deep representations for crowd anomaly event detection

  15. Ionescu RT, Smeureanu S, Alexe B, Popescu M (2017) Unmasking the abnormal events in video. pp. 2895–2903

  16. Leyva R, Sanchez V, Li CT (2017) Video anomaly detection with compact feature sets for online performance. IEEE Trans Image Process 26(7):3463–3478

    Article  MathSciNet  Google Scholar 

  17. Li W, Mahadevan V, Vasconcelos N (2014) Anomaly detection and localization in crowded scenes. IEEE Trans Pattern Anal Mach Intell 36(1):18–32

    Article  Google Scholar 

  18. Li S, Liu C, Yang Y (2018) Anomaly detection based on maximum a posteriori. Pattern Recogn Lett 107:91–97

    Article  Google Scholar 

  19. Li S, Yang Y, Liu C (2018) Anomaly detection based on two global grid motion templates, vol. 60

  20. Lin H, Deng JD, Woodford BJ, Shahi A (2016) Online weighted clustering for real-time abnormal event detection in video surveillance. pp. 536–540

  21. Liu P, Tao Y, Zhao W, Tang X (2017) Abnormal crowd motion detection using double sparse representation. Neurocomputing 269:3–12

    Article  Google Scholar 

  22. Lu C, Shi J, Jia J (2013) Abnormal event detection at 150 fps in matlab. pp. 2720–2727

  23. Ma D, Wang Q, Yuan Y (2014) Anomaly detection in crowd scene via online learning. p. 158. ACM

  24. Masci J, Meier U, Ciresan D, Schmidhuber J. (2011) Stacked convolutional auto-encoders for hierarchical feature extraction

  25. Narasimhan MG, Kamath S (2017) Dynamic video anomaly detection and localization using sparse denoising autoencoders

  26. Piciarelli C, Micheloni C, Foresti GL (2008) Trajectory-based anomalous event detection. IEEE Transactions on 18(11):1544–1554

    Google Scholar 

  27. Ravanbakhsh M, Sangineto E, Nabi M, Sebe N (2019) Training adversarial discriminators for cross-channel abnormal event detection in crowds. IEEE

  28. Ribeiro M, Lazzaretti AE, Lopes HS (2018) A study of deep convolutional auto-encoders for anomaly detection in videos. Pattern Recogn Lett 105:13–22

    Article  Google Scholar 

  29. Sabokrou M, Fathy M, Hoseini M (2016) Video anomaly detection and localisation based on the sparsity and reconstruction error of auto-encoder. Electron Lett 52(13):1122–1124

    Article  Google Scholar 

  30. Sabokrou M, Fayyaz M, Fathy M, Klette R (2017) Deep-cascade: cascading 3D deep neural networks for fast anomaly detection and localization in crowded scenes. IEEE Trans Image Process 26(4):1992–2004

    Article  MathSciNet  Google Scholar 

  31. Sabokrou M, Fayyaz M, Fathy M, Moayed Z, Klette R (2018) Deepanomaly: fully convolutional neural network for fast anomaly detection in crowded scenes. Comput Vis Image Underst 172:88–97

    Article  Google Scholar 

  32. Sodemann AA, Ross MP, Borghetti BJ:BJ (2012) A review of anomaly detection in automated surveillance. IEEE Trans Syst Man Cybern Part C Appl Rev 42(6):1257–1272

    Article  Google Scholar 

  33. Tran HT, Hogg DC. (2017) Anomaly detection using a convolutional winner

  34. Vu, H., Phung, D., Nguyen, T.D., Trevors, A., Venkatesh, S. (2017) Energy-based Models for Video Anomaly Detection. arXiv preprint arXiv:1708.05211

  35. Wang, J., Xu, Z. (2015) Crowd anomaly detection for automated video surveillance

  36. Wang S, Zhu E, Yin J, Porikli F (2018) Video anomaly detection and localization by local motion based joint video representation and OCELM. Neurocomputing 277:161–175

    Article  Google Scholar 

  37. Wang T, Qiao M, Deng Y, Zhou Y, Wang H, Lyu Q, Snoussi H (2018) Abnormal event detection based on analysis of movement information of video sequence. Optik-International Journal for Light and Electron Optics 152:50–60

    Article  Google Scholar 

  38. Wang, X., Xie, W., Song, J. (2018) Learning Spatiotemporal Features With 3DCNN and ConvGRU for Video Anomaly Detection

  39. Wang T, Qiao M, Lin Z, Li C, Snoussi H, Liu Z, Choi C (2019) Generative neural networks for anomaly detection in crowded scenes. IEEE Transactions on Information Forensics and Security 14(5):1390–1399

    Article  Google Scholar 

  40. Xingjian SHI, Chen Z, Wang H, Yeung DY, Wong WK, Woo W (2015) Convolutional LSTM network: A machine learning approach for precipitation nowcasting

  41. Xu D, Yan Y, Ricci E, Sebe N (2017) Detecting anomalous events in videos by learning deep representations of appearance and motion. Comput Vis Image Underst 156:117–127

    Article  Google Scholar 

  42. Yi Y, Li X, Zhao R, Bi C, Wang J, Sun H. (2016) A constrained sparse representation approach for video anomaly detection

  43. Yuan Y, Feng Y, Lu X (2018) Structured dictionary learning for abnormal event detection in crowded scenes. Pattern Recogn 73:99–110

    Article  Google Scholar 

  44. Zhang Y, Lu H, Zhang L, Ruan X (2016) Combining motion and appearance cues for anomaly detection. Pattern Recogn 51:443–452

    Article  Google Scholar 

  45. Zhang Y, Lu H, Zhang L, Ruan X, Sakai S (2016) Video anomaly detection based on locality sensitive hashing filters. Pattern Recogn 59:302–311

    Article  Google Scholar 

  46. Zhao Y., Deng B, Shen C, Liu Y, Lu H, Hua XS (2017) Spatiotemporal autoencoder for video anomaly detection. pp. 1933–1941

  47. Zhou S, Shen W, Zeng D, Fang M, Wei Y, Zhang Z (2016) Spatialtemporal convolutional neural networks for anomaly detection and localization in crowded scenes, vol. 47

Download references

Author information

Authors and Affiliations

  1. School of Computing Science and Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, 632014, India

    Anitha Ramchandran & Arun Kumar Sangaiah

Authors
  1. Anitha Ramchandran
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Arun Kumar Sangaiah
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Arun Kumar Sangaiah.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ramchandran, A., Sangaiah, A.K. Unsupervised deep learning system for local anomaly event detection in crowded scenes. Multimed Tools Appl 79, 35275–35295 (2020). https://doi.org/10.1007/s11042-019-7702-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-7702-5

Keywords

Search

Navigation