Detecting Abnormal Behavioral Patterns in Crowd Scenarios

  • Hossein Mousavi
  • Hamed Kiani Galoogahi
  • Alessandro Perina
  • Vittorio Murino
Chapter
Part of the Intelligent Systems Reference Library book series (ISRL, volume 106)

Abstract

This Chapter presents a framework for the the task of abnormality detection in crowded scenes based on the analysis of trajectories, build up upon a novel video descriptor, called Histogram of Oriented Tracklets. Unlike standard approaches that employ low level motion features, e.g. optical flow, to form video descriptors, we propose to exploit mid-level features extracted from long-range motion trajectories called tracklets, which have been successfully applied for action modeling and video analysis. Following standard procedure, a video sequence is divided into spatio-temporal cuboids within which we collect statistics of the tracklets passing through them. Specifically, tracklets orientation and magnitude are quantized in a two-dimensional histogram which encodes the actual motion patterns in each cuboid. These histograms are then fed into machine learning models (e.g., Latent Dirichlet allocation and Support Vector Machines) to detect abnormal behaviors in video sequences. The evaluation of the proposed descriptor on different datasets, namely UCSD, BEHAVE, UMN and Violence in Crowds, yields compelling results in abnormality detection, by setting new state-of-the-art and outperforming former descriptors based on the optical flow, dense trajectories and social force models.

References

  1. 1.
    Adam A, Rivlin E, Shimshoni I, Reinitz D (2008) Robust real-time unusual event detection using multiple fixed-location monitors. IEEE Trans Pattern Anal Mach Intell 30:555–560CrossRefGoogle Scholar
  2. 2.
    Alvar M, Torsello A, Sanchez-Miralles A, Armingol JM (2014) Abnormal behavior detection using dominant sets. Mach Vis Appl 32(6):1–18Google Scholar
  3. 3.
    Bera A, Manocha D (2014) Realtime multilevel crowd tracking using reciprocal velocity obstacles. arXiv:1402.2826
  4. 4.
    Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Mach Learn Res 3:993–1022MATHGoogle Scholar
  5. 5.
    Blunsden S, Fisher R (2010) The behave video dataset: ground truthed video for multi-person behavior classification. Ann Br Mach Vis Assoc 4:1–12Google Scholar
  6. 6.
    Boiman O, Irani M (2007) Detecting irregularities in images and in video. Int J Comput Vis 74:17–31CrossRefGoogle Scholar
  7. 7.
    Chen K, Gong S, Xiang T, Loy CC (2013) Cumulative attribute space for age and crowd density estimation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2467–2474Google Scholar
  8. 8.
    Cong Y, Yuan J, Liu J (2011) Sparse reconstruction cost for abnormal event detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3449–3456Google Scholar
  9. 9.
    Cui X, Liu Q, Gao M, Metaxas DN (2011) Abnormal detection using interaction energy potentials. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3161–3167Google Scholar
  10. 10.
    Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, vol 1, pp 886–893Google Scholar
  11. 11.
    Fu Z, Hu W, Tan T (2005) Similarity based vehicle trajectory clustering and anomaly detection. In: Proceedings of the IEEE international conference on image processing, vol 2, pp II–602Google Scholar
  12. 12.
    Haque M, Murshed M (2010) Panic-driven event detection from surveillance video stream without track and motion features. In: Proceedings of the IEEE international conference on multimedia and expo, pp 173–178Google Scholar
  13. 13.
    Hassner T, Itcher Y, Kliper-Gross O (2012) Violent flows: real-time detection of violent crowd behavior. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 1–6Google Scholar
  14. 14.
    Helbing D, Molnar P (1995) Social force model for pedestrian dynamics. Phys Rev E 51:4282CrossRefGoogle Scholar
  15. 15.
    Hu M, Ali S, Shah M (2008) Detecting global motion patterns in complex videos. In: Proceedings of the international conference on pattern recognition, pp 1–5Google Scholar
  16. 16.
    Junior SJ et al (2010) Crowd analysis using computer vision techniques. IEEE Signal Process Mag 27:66–77Google Scholar
  17. 17.
    Kim J, Grauman K (2009) Observe locally, infer globally: a space-time mrf for detecting abnormal activities with incremental updates. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2921–2928Google Scholar
  18. 18.
    Kim J, Grauman K (2009) Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2921–2928Google Scholar
  19. 19.
    Kratz L, Nishino K (2009) Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1446–1453Google Scholar
  20. 20.
    Kratz L, Nishino K (2010) Tracking with local spatio-temporal motion patterns in extremely crowded scenes. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 693–700Google Scholar
  21. 21.
    Krausz B, Bauckhage C (2011) Analyzing pedestrian behavior in crowds for automatic detection of congestions. In: Proceedings of the IEEE international conference on computer vision workshops, pp 144–149Google Scholar
  22. 22.
    Krausz B, Bauckhage C (2012) Loveparade 2010: automatic video analysis of a crowd disaster. Comput Vis Image Underst 116(3):307–319CrossRefGoogle Scholar
  23. 23.
    Laptev I, Marszalek M, Schmid C, Rozenfeld B (2008) Learning realistic human actions from movies. In: Proceedings of the IEEE conference on computer vision and pattern recognitionGoogle Scholar
  24. 24.
    Li W, Mahadevan V, Vasconcelos N (2014) Anomaly detection and localization in crowded scenes. IEEE Trans Pattern Anal Mach Intell 36:18–32CrossRefGoogle Scholar
  25. 25.
    Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110CrossRefGoogle Scholar
  26. 26.
    Lucas BD, Kanade T et al (1981) An iterative image registration technique with an application to stereo vision. In: IJCAI, vol 81, pp 674–679Google Scholar
  27. 27.
    Mahadevan V, Li W, Bhalodia V, Vasconcelos N (2010) Anomaly detection in crowded scenes. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1975–1981Google Scholar
  28. 28.
    Marques JS, Jorge PM, Abrantes AJ, Lemos J (2003) Tracking groups of pedestrians in video sequences. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshop, vol 9, pp 101–101Google Scholar
  29. 29.
    Mehran R, Oyama A, Shah M (2009) Abnormal crowd behavior detection using social force model. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 935–942Google Scholar
  30. 30.
    Mousavi H, Mohammadi S, Perina A, Chellali R, Murino V (2015) Analyzing tracklets for the detection of abnormal crowd behavior. In: Proceedings of the IEEE Winter conference on applications of computer vision, pp 148–155Google Scholar
  31. 31.
    Mousavi H, Nabi M, Kiani H, Perina A, Murino V (2015) Crowd motion monitoring using tracklet-based commotion measure. In: Proceedings of the IEEE international conference on image processingGoogle Scholar
  32. 32.
    Mousavi H, Nabi M, Kiani Galogahi H, Perina A, Murino V (2015) Abnormality detection with improved histogram of oriented tracklets. In: Proceedings of the international conference on image analysis and processingGoogle Scholar
  33. 33.
    Piciarelli C, Micheloni C, Foresti GL (2008) Trajectory-based anomalous event detection. IEEE Trans Circuits Syst Video Technol 18:1544–1554CrossRefGoogle Scholar
  34. 34.
    Rabaud V, Belongie S (2006) Counting crowded moving objects. In: Proceedings of the IEEE conference on computer vision and pattern recognitionGoogle Scholar
  35. 35.
    Rabaud V, Belongie S (2006) Counting crowded moving objects. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 705–711Google Scholar
  36. 36.
    Raptis M, Soatto S (2010) Tracklet descriptors for action modeling and video analysis. In: Proceedings of the IEEE European conference on computer visionGoogle Scholar
  37. 37.
    Reddy V, Sanderson C, Lovell BC (2011) Improved anomaly detection in crowded scenes via cell-based analysis of foreground speed, size and texture. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshopsGoogle Scholar
  38. 38.
    Regazzoni C, Tesei A, Murino V (1993) A real-time vision system for crowding monitoring. In: Proceedings of the IECON’93, International conference on industrial electronics, control, and instrumentation, pp 1860–1864Google Scholar
  39. 39.
    Rittscher J, Tu PH, Krahnstoever N (2005) Simultaneous estimation of segmentation and shape. In: CVPR, vol 2, pp 486–493. IEEEGoogle Scholar
  40. 40.
    Shi J, Tomasi C (1994) Good features to track. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 593–600Google Scholar
  41. 41.
    Solmaz B, Moore BE, Shah M (2012) Identifying behaviors in crowd scenes using stability analysis for dynamical systems. IEEE Trans Pattern Anal Mach Intell 34:2064–2070CrossRefGoogle Scholar
  42. 42.
    Tomasi C, Kanade T (1991) Detection and tracking of point featuresGoogle Scholar
  43. 43.
    Wang B, Ye M, Li X, Zhao F, Ding J (2012) Abnormal crowd behavior detection using high-frequency and spatio-temporal features. Mach Vis Appl 23:501–511CrossRefGoogle Scholar
  44. 44.
    Wang H, Kläser A, Schmid C, Liu C-L (2011) Action recognition by dense trajectories. In: Proceedings of the IEEE conference on computer vision and pattern recognitionGoogle Scholar
  45. 45.
    Wang T, Snoussi H (2012) Histograms of optical flow orientation for visual abnormal events detection. In: AVSS, pp 13–18Google Scholar
  46. 46.
    Wang X, Ma X, Grimson WEL (2009) Unsupervised activity perception in crowded and complicated scenes using hierarchical bayesian models. IEEE Trans Pattern Anal Mach Intell 31:539–555CrossRefGoogle Scholar
  47. 47.
    Wijermans N, Jorna R, Jager W, Vliet TV (2007) Modelling crowd dynamics, influence factors related to the probability of a riot. In: Proceedings of the fourth European social simualtion association conference (ESSA). Toulouse University of Social SciencesGoogle Scholar
  48. 48.
    Wu S, Moore BE, Shah M (2010) Chaotic invariants of lagrangian particle trajectories for anomaly detection in crowded scenes. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2054–2060Google Scholar
  49. 49.
    Wu S, San Wong H (2012) Crowd motion partitioning in a scattered motion field. IEEE Trans Syst Man Cybern Part B: Cybern 42:1443–1454CrossRefGoogle Scholar
  50. 50.
    Wu S, Wong H-S, Yu Z (2014) A Bayesian model for crowd escape behavior detection. IEEE Trans Circuits Syst Video Technol 24(1):85–98CrossRefGoogle Scholar
  51. 51.
    Xiang T, Gong S (2008) Video behavior profiling for anomaly detection. IEEE Trans Pattern Anal Mach Intell 30:893–908CrossRefGoogle Scholar
  52. 52.
    Yeffet L, Wolf L (2009) Local trinary patterns for human action recognition. In: Proceedings of the IEEE international conference on computer visionGoogle Scholar
  53. 53.
    Zhang Y, Qin L, Ji R, Yao H, Huang Q (2014) Social attribute-aware force model: exploiting richness of interaction for abnormal crowd detectionGoogle Scholar
  54. 54.
    Zhao T, Nevatia R (2003) Bayesian human segmentation in crowded situations. In: Proceedings of the IEEE conference on computer vision and pattern recognition, vol 2, pp II–459Google Scholar
  55. 55.
    Zhong H, Shi J, Visontai M (2004) Detecting unusual activity in video. In: Proceedings of the IEEE conference on computer vision and pattern recognition, vol 2Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Hossein Mousavi
    • 1
  • Hamed Kiani Galoogahi
    • 1
  • Alessandro Perina
    • 1
  • Vittorio Murino
    • 1
    • 2
  1. 1.Pattern Analysis and Computer Vision DepartmentIstituto Italiano di TecnologiaGenoaItaly
  2. 2.Department of Computer ScienceUniversity of VeronaVeronaItaly

Personalised recommendations