Skip to main content

Advertisement

SpringerLink
Log in

A fast recognition algorithm for suspicious behavior in high definition videos

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Detecting suspicious behavior from high definition (HD) videos is always a complex and time-consuming process. To solve that problem, a fast suspicious behavior recognition method is proposed based on motion vectors. In this paper, the data format and decoding features of HD videos are analyzed. Then, the characteristics of suspicious activities and the ways of obtaining motion vectors directly from the video stream are concluded. Besides, the motion vectors are normalized by taking the reference frames into account. The feature vectors that display the inter-frame and intra-frame information of the region of interest are extracted. Gaussian radial basis function is employed as the kernel function of the support vector machines (SVM). It also realizes the detection and classification of suspicious behavior in HD videos. Finally, an extensive set of experiments are performed and this method is compared with some of the most recent approaches in the field using publicly available datasets as well as a new annotated human action dataset including actions performed in complex scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Aggarwal, J.K., Ryoo, M.S.: Human activity analysis: a review. In: ACM (2011)

  2. Rao C., Shah, M.: View-invariance in action recognition. In: CVPR (2001)

  3. Savarese, S., Delpozo, A., Niebles, J., Fei-Fei, L.: Spatial-temporal correlations for unsupervised action classification. In: WMVC (2008)

  4. Rodriguez, M.D., Ahmed, J., Shah, M.: Action MACH: a spatio-temporal maximum average correlation height filter for action recognition. In: CVPR (2008)

  5. Ryoo, M.S., Aggarwal, J.K.: Spatio-temporal relationship match: video structure comparison for recognition of complex human activities. In: ICCV (2009)

  6. Jiang, H., Drew, M., Li, Z.: Successive convex matching for action detection. In: CVPR (2006)

  7. Veeraraghavan, A., Chellappa, R., Roy-Chowdhury, A.: The function space of an activity. In: CVPR (2006)

  8. Natarajan, P., Nevatia, R.: Coupled hidden semi-markov models for activity recognition. In: WMVC (2007)

  9. Damen, D., Hogg, D.: Recognizing linked events: searching the space of feasible explanations. In: CVPR (2009)

  10. Joo, S.W., Chellappa, R.: Attribute grammar-based event recognition and anomaly detection. In: CVPR (2006)

  11. Ryoo, M.S., Aggarwal, J.K.: Semantic representation and recognition of continued and recursive human activities. In: IJCV (2009)

  12. Ryoo, M.S., Aggarwal, J.K.: Recognition of composite human activities through context-free grammar based representation. In: CVPR (2006)

  13. Schüldt, C., Laptev, I., Caputo, B.: Recognizing human actions: a local SVM approach. In: ICPR (2004)

  14. Marszałek, M., Laptev, I., Schmid, C.: Actions in context. In: CVPR (2009)

  15. Blank, M., Gorelick, L., Shechtman, E., Irani, M., Basri, R.: Actions as space-time shapes. In: ICCV (2005)

  16. Laptev, I., Marszałek, M., Schmid, C., Rozenfeld, B.: Learning realistic human actions from movies. In: CVPR (2008)

  17. Liu, J., Luo, J., Shah, M.: Recognizing realistic actions from videos’in the wild’. In: CVPR (2009)

  18. Porikli, F., Bashir, F., Sun, H.: Compressed domain video object segmentation, IEEE Trans. Circuits Syst. Video Technol. 20(1), 2–14 (2010)

    Article  Google Scholar 

  19. Messing, R., Pal, C., Kautz, H.: Activity recognition using the velocity histories of tracked keypoints. In: ICCV (2009)

  20. Wang, H., Klaser, A., Schmid, C., Liu, C.L.: Action recognition by dense trajectories. In: CVPR (2011)

  21. Sadanand, S., Corso, J.J.: Action Bank: a high-level representation of activity in video. In: CVPR (2012)

  22. Lavee, G., Khan, L., Thuraisingham, B.: A framework for a video analysis tool for suspicious event detection. In: MDM (2005)

  23. Mecocci, A., Pannozzo, M., Fumarola, A.: Automatic Detection of Anomalous Behavioural Events for Advanced Real-Time Video Surveilance, International Symposium on Computational Intelligence for Measurement Systems and Applications, pp. 187–192. Lugano (2003)

  24. Barbará, D., Filippone, M.: Detecting suspicious behavior in surveillance images. In: ICDMW (2008)

  25. Wiliem, A., Madasu, V., Boles, W., Yarlagadda, P.: A context-based approach for detecting suspicious behaviours. In: DICTA (2009)

  26. Qamar, S.A., Jaffar, M.A., Habib, H.A.: A supervisory system to detect suspicious behavior in online testing system. In: ICMLC (2009)

  27. Kaluža, B., Kaminka, G.A., Tambe, M.: Detection of suspicious behavior from a sparse set of multiagent interactions. In: AAMAS (2012)

  28. Schindler, K., Gool, L.J.V.: Action snippets: how many frames does human action recognition require?. In: CVPR (2008)

  29. Gilbert, A., Illingworth, J., Bowden, R.: Fast realistic multi-action recognition using mined dense spatio-temporal features. In: ICCV (2009)

  30. Yao, A., Gall, J., Van Gool, L.: A hough transform-based voting framework for action recognition. In: CVPR (2010)

  31. Barnich, Olivier, Van Droogenbroeck, Marc: ViBe: a universal background subtraction algorithm for video sequences. IEEE Trans. Image Process 20(6), 1709–1724 (2011)

    Article  MathSciNet  Google Scholar 

  32. Jiangbin, Zheng, Xiuxiu, Li, Yanning, Zhang: Novel tacking algorithm for video surveillance. Syst. Eng. Electron. 29(11), 191–193 (2007)

    Google Scholar 

  33. Nagasaka, A., Tanaka, Y.: Automatic video indexing and full video search for object appearances. Visual Database Systems II, pp. 113–127 (1992)

Download references

Author information

Authors and Affiliations

  1. College of Electronic Science and Engineering, National University of Defense Technology, Changsha, 410073, China

    Chundi Mu, Jianbin Xie, Wei Yan, Tong Liu & Peiqin Li

Authors
  1. Chundi Mu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jianbin Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wei Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tong Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Peiqin Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wei Yan.

Additional information

Communicated by T. Mei.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mu, C., Xie, J., Yan, W. et al. A fast recognition algorithm for suspicious behavior in high definition videos. Multimedia Systems 22, 275–285 (2016). https://doi.org/10.1007/s00530-015-0456-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-015-0456-7

Keywords

Search

Navigation