Advertisement

Multimedia Tools and Applications

, Volume 74, Issue 24, pp 11099–11115 | Cite as

Anomaly detection in compressed H.264/AVC video

  • Sovan Biswas
  • R. Venkatesh Babu
Article

Abstract

Real time anomaly detection is the need of the hour for any security applications. In this article, we have proposed a real time anomaly detection for H.264 compressed video streams utilizing pre-encoded motion vectors (MVs). The proposed work is principally motivated by the observation that MVs have distinct characteristics during anomaly than usual. Our observation shows that H.264 MV magnitude and orientation contain relevant information which can be used to model the usual behavior (UB) effectively. This is subsequently extended to detect abnormality/anomaly based on the probability of occurrence of a behavior. The performance of the proposed algorithm was evaluated and bench-marked on UMN and Ped anomaly detection video datasets, with a detection rate of 70 frames per sec resulting in 90× and 250× speedup, along with on-par detection accuracy compared to the state-of-the-art algorithms.

Keywords

Anomaly detection H.264 Motion vectors Compressed domain video analysis Kernel density estimation Visual surveillance 

References

  1. 1.
    Adam A, Rivlin E, Shimshoni I, Reinitz D (2008) Robust real-time unusual event detection using multiple fixed-location monitors. IEEE Trans Pattern Anal and Mach Intell 30(3):555–560CrossRefGoogle Scholar
  2. 2.
    Benezeth Y, Jodoin PM, Saligrama V, Rosenberger C (2009) Abnormal events detection based on spatio-temporal co-occurences. In: Proceedings of the IEEE conference on Computer vision and pattern recognition, pp 2458–2465Google Scholar
  3. 3.
    Biswas S, Babu R V (2013) Real time anomaly detection in H.264 compressed videos. In: National conference on Computer vision, pattern recognition, image processing and graphics. NCVPRIPG, pp 1–4Google Scholar
  4. 4.
    Boiman O, Irani M (2005) Detecting irregularities in images and in video. In: Proceedings of the IEEE international conference on Computer vision, pp 462–469Google Scholar
  5. 5.
    Chan AB, Vasconcelos N (2008) Modeling, clustering, and segmenting video with mixtures of dynamic textures. IEEE Trans Pattern Anal and Mach Intell 30(5):909–926CrossRefGoogle Scholar
  6. 6.
    Cong Y, Yuan J, Liu J (2011) Sparse reconstruction cost for abnormal event detection. In: Proceedings of the IEEE conference on Computer vision and pattern recognition, pp 3449–3456Google Scholar
  7. 7.
    Hu W, Xiao X, Fu Z, Xie D, Tan T, Maybank S (2006) A system for learning statistical motion patterns. IEEE Trans Pattern Anal and Mach Intell 28(9):1450–1464CrossRefGoogle Scholar
  8. 8.
    Itti L, Baldi P (2005) A principled approach to detecting surprising events in video. In: Proceedings of the IEEE conference on Computer vision and pattern recognition, vol 1, pp 631–637Google Scholar
  9. 9.
    Kim J, Grauman K (2009) Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2921–2928Google Scholar
  10. 10.
    Kratz L, Nishino K (2009) Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models. In: Proceedings of the IEEE conference on Computer vision and pattern recognition, pp 1446–1453Google Scholar
  11. 11.
    Mahadevan V, Li W, Bhalodia V, Vasconcelos N (2010) Anomaly detection in crowded scenes. In: Proceedings of the IEEE conference on Computer vision and pattern recognition, pp 1975–1981Google Scholar
  12. 12.
    Mehran R, Oyama A, Shah M (2009) Abnormal crowd behavior detection using social force model. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 935–942Google Scholar
  13. 13.
    Moiron S, Faria S, Assunçao P, Silva V, Navarro A (2007) H. 264/AVC to MPEG-2 video transcoding architecture. In: Proceeding of the conference on Telecommunications, pp 449–452Google Scholar
  14. 14.
  15. 15.
    Piciarelli C, Micheloni C, Foresti GL (2008) Trajectory-based anomalous event detection. IEEE Trans Circ and Syst for Video Technol 18(11):1544–1554CrossRefGoogle Scholar
  16. 16.
    Pourazad MT, Nasiopoulos P, Ward RK (2010) Generating the depth map from the motion information of H.264-encoded 2D video sequence. J Image and Video Process 2010(4):4:1–4:13Google Scholar
  17. 17.
    Ramakanth SA, Babu RV (2012) Feature match: an efficient low dimensional patchmatch technique. In: Proceedings of the indian conference on computer vision, graphics and image processing, pp 45:1–45:7Google Scholar
  18. 18.
    Reddy V, Sanderson C, Lovell BC (2011) Improved anomaly detection in crowded scenes via cell-based analysis of foreground speed, size and texture. In: IEEE conference on Computer vision and pattern recognition workshops. CVPRW, pp 55–61Google Scholar
  19. 19.
    Remagnino P, Jones GA (2001) Classifying surveillance events from attributes and behaviour. algorithms 6(7):1–12Google Scholar
  20. 20.
    Ryan D, Denman S, Fookes C, Sridharan S (2011) Textures of optical flow for real-time anomaly detection in crowds. In: 8th IEEE international conference on Advanced video and signal-based surveillance. AVSS, pp 230–235Google Scholar
  21. 21.
    Saligrama V, Chen Z (2012) Video anomaly detection based on local statistical aggregates. In: Proceedings of the IEEE conference on Computer vision and pattern recognition, pp 2112–2119Google Scholar
  22. 22.
    Stauffer C, Grimson WEL (2000) Learning patterns of activity using real-time tracking. IEEE Trans Pattern Anal and Mach Intell 22(8):747–757CrossRefGoogle Scholar
  23. 23.
    Sun X, Yao H, Ji R, Liu X, Xu P (2011) Unsupervised fast anomaly detection in crowds. In: Proceedings of the ACM international conference on Multimedia, pp 1469–1472Google Scholar
  24. 24.
  25. 25.
    Wiegand T, Sullivan GJ, Bjontegaard G, Luthra A (2003) Overview of the H.264/AVC video coding standard. IEEE Trans Circ and Syst for Video Technol 13(7):560–576CrossRefGoogle Scholar
  26. 26.
    Wu S, Oreifej O, Shah M (2011) Action recognition in videos acquired by a moving camera using motion decomposition of lagrangian particle trajectories. In: Proceedings of the IEEE international conference on Computer vision, pp 1419–1426Google Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  1. 1.Video Analytics Lab, Supercomputer Education and Research CenterIndian Institute of ScienceBangaloreIndia

Personalised recommendations