Multimedia Tools and Applications

, Volume 76, Issue 22, pp 23213–23224 | Cite as

Abnormal event detection and localization in crowded scenes based on PCANet

  • Tianlong Bao
  • Saleem Karmoshi
  • Chunhui Ding
  • Ming Zhu
Article
First Online:
Received:
Revised:
Accepted:

Abstract

Detecting and localizing abnormal events in crowded scenes still remains a challenging task among computer vision community. An unsupervised framework is proposed in this paper to address the problem. Low-level features and optical flows (OF) of video sequences are extracted to represent motion information in the temporal domain. Moreover, abnormal events usually occur in local regions and are closely linked to their surrounding areas in the spatial domain. To extract high-level information from local regions and model the relationship in spatial domain, the first step is to calculate optical flow maps and divide them into a set of non-overlapping sub-maps. Next, corresponding PCANet models are trained using the sub-maps at same spatial location in the optical flow maps. Based on the block-wise histograms extracted by PCANet models, a set of one-class classifiers are trained to predict the anomaly scores of test frames. The framework is completely unsupervised because it utilizes only normal videos. Experiments were carried out on UCSD Ped2 and UMN datasets, and the results show competitive performance of this framework when compared with other state-of-the-art methods.

Keywords

Abnormal event detection Optical flow PCANet 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgments

This work was supported by special funder from Chinese Academy of Sciences, with grant number XDA060112030.

References

  1. 1.
    Benezeth Y, Jodoin PM, Saligrama V, Rosenberger C (2009) Abnormal events detection based on spatio-temporal co-occurences. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 2458–2465Google Scholar
  2. 2.
    Bertini M, Del Bimbo A, Seidenari L (2012) Multi-scale and real-time non-parametric approach for anomaly detection and localization. Comput Vis Image Understand 116(3):320–329CrossRefGoogle Scholar
  3. 3.
    Boiman O, Irani M (2007) Detecting irregularities in images and in video. Int J Comput Vis 74(1):17–31CrossRefGoogle Scholar
  4. 4.
    Chan TH, Jia K, Gao S, Lu J, Zeng Z, Ma Y (2015) Pcanet: A simple deep learning baseline for image classification? IEEE Trans Image Process 24 (12):5017–5032CrossRefMathSciNetGoogle Scholar
  5. 5.
    Cong Y, Yuan J, Liu J (2011) Sparse reconstruction cost for abnormal event detection. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 3449–3456Google Scholar
  6. 6.
    Cong Y, Yuan J, Tang Y (2013) Video anomaly search in crowded scenes via spatio-temporal motion context. IEEE Trans Inf Forensic Secur 8(10):1590–1599CrossRefGoogle Scholar
  7. 7.
    Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol 1, pp 886–893Google Scholar
  8. 8.
    Fang Z, Fei F, Fang Y, Lee C, Xiong N, Shu L, Chen S (2016) Abnormal event detection in crowded scenes based on deep learning. Multimedia Tools and Applications pp 1–23Google Scholar
  9. 9.
    Felzenszwalb PF, Girshick RB, McAllester D, Ramanan D (2010) Object detection with discriminatively trained part-based models, vol 32, pp 1627–1645Google Scholar
  10. 10.
    Khalid S (2010) Activity classification and anomaly detection using m-mediods based modelling of motion patterns. Pattern Recogn 43(10):3636–3647CrossRefMATHGoogle Scholar
  11. 11.
    Kim J, Grauman K (2009) Observe locally, infer globally: a space-time mrf for detecting abnormal activities with incremental updates. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 2921–2928Google Scholar
  12. 12.
    Li W, Mahadevan V, Vasconcelos N (2014) Anomaly detection and localization in crowded scenes. IEEE Trans Pattern Anal Mach Intell 36(1):18–32CrossRefGoogle Scholar
  13. 13.
    Lu C, Shi J, Jia J (2013) Abnormal event detection at 150 fps in matlab. In: IEEE International Conference on Computer Vision (ICCV), pp 2720–2727Google Scholar
  14. 14.
    Mahadevan V, Li W, Bhalodia V, Vasconcelos N (2010) Anomaly detection in crowded scenes. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 1975–1981Google Scholar
  15. 15.
    Mehran R, Oyama A, Shah M (2009) Abnormal crowd behavior detection using social force model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 935–942Google Scholar
  16. 16.
    Popoola OP, Wang K (2012) Video-based abnormal human behavior recognition review. IEEE Trans Syst, Man, Cybern, Part C: Appl Rev 42(6):865–878CrossRefGoogle Scholar
  17. 17.
    Raghavendra R, Bue AD, Cristani M (2006) Unusual crowd activity dataset of University of Minnesota. http://mha.cs.umn.edu/Movies/Crowd-Activity-All.avi
  18. 18.
    Rasheed N, Khan SA, Khalid A (2014) Tracking and abnormal behavior detection in video surveillance using optical flow and neural networks. In: 28th International Conference on Advanced Information Networking and Applications Workshops (WAINA), pp 61–66Google Scholar
  19. 19.
    Sabokrou M, Fathy M, Hosseini M (2015) Real-time anomalous behavior detection and localization in crowded scenes. CoRR 1511.07425
  20. 20.
    Wang X, Ma X, Grimson E (2007) Unsupervised activity perception by hierarchical bayesian models. In: IEEE Conference on Computer Vision and Pattern Recognition. IEEE, pp 1–8Google Scholar
  21. 21.
    Wu S, Moore BE, Shah M (2010) Chaotic invariants of lagrangian particle trajectories for anomaly detection in crowded scenes. In: IEEE Computer on Computer Vision and Pattern Recognition (CVPR), pp 2054–2060Google Scholar
  22. 22.
    Xiao T, Zhang C, Zha H (2015) Learning to detect anoMalies in surveillance video. IEEE Signal Process Lett 22(9):1477–1481CrossRefGoogle Scholar
  23. 23.
    Xu D, Song R, Wu X, Li N, Feng W, Qian H (2014) Video anomaly detection based on a hierarchical activity discovery within spatio-temporal contexts. Neurocomputing 143:144–152CrossRefGoogle Scholar
  24. 24.
    Yuan Y, Fang J, Wang Q (2015) Online anomaly detection in crowd scenes via structure analysis. IEEE Trans Cybern 45(3):548–561CrossRefGoogle Scholar
  25. 25.
    Zhang D, Gatica-Perez D, Bengio S, McCowan I (2005) Semi-supervised adapted hmms for unusual event detection. In: IEEE Conference on Computer Vision and Pattern Recognition, vol 1. IEEE, pp 611–618Google Scholar
  26. 26.
    Zhang Y, Qin L, Ji R, Yao H, Huang Q (2015) Social attribute-aware force model: exploiting richness of interaction for abnormal crowd detection. IEEE Trans Circ Syst Video Technol 25(7):1231–1245CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • Tianlong Bao
    • 1
  • Saleem Karmoshi
    • 1
  • Chunhui Ding
    • 1
  • Ming Zhu
    • 1
  1. 1.School of Information Science and TechnologyUniversity of Science and Technology of ChinaHefeiChina

Personalised recommendations