Abnormal Crowd Behavior Detection by Social Force Optimization

  • R. Raghavendra
  • Alessio Del Bue
  • Marco Cristani
  • Vittorio Murino
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7065)

Abstract

We propose a new scheme for detecting and localizing the abnormal crowd behavior in video sequences. The proposed method starts from the assumption that the interaction force, as estimated by the Social Force Model (SFM), is a significant feature to analyze crowd behavior. We step forward this hypothesis by optimizing this force using Particle Swarm Optimization (PSO) to perform the advection of a particle population spread randomly over the image frames. The population of particles is drifted towards the areas of the main image motion, driven by the PSO fitness function aimed at minimizing the interaction force, so as to model the most diffused, normal, behavior of the crowd. In this way, anomalies can be detected by checking if some particles (forces) do not fit the estimated distribution, and this is done by a RANSAC-like method followed by a segmentation algorithm to finely localize the abnormal areas. A large set of experiments are carried out on public available datasets, and results show the consistent higher performances of the proposed method as compared to other state-of-the-art algorithms, proving the goodness of the proposed approach.

Keywords

Particle Swarm Optimization Video Sequence Interaction Force Anomaly Detection Equal Error Rate 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Adam, A., Rivlin, E., Shimshoni, I., Reinitz, D.: Robust real-time unusual event detection using multiple fixed-location monitors. IEEE Transactions on Pattern Analysis and Machine Intelligence 30(3), 555–560 (2008)CrossRefGoogle Scholar
  2. 2.
    Ali, S., Shah, M.: A Lagrangian particle dynamics approach for crowd flow segmentation and stability analysis. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–6 (2007)Google Scholar
  3. 3.
    Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High Accuracy Optical Flow Estimation Based on a Theory for Warping. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3024, pp. 25–36. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  4. 4.
    Fischler, M.A., Bolles, R.C.: Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24(1), 381–395 (1981)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Fukunaga, K., Hostetler, L.: The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Transactions on Information Theory 21(1), 32–40 (1975)MathSciNetCrossRefMATHGoogle Scholar
  6. 6.
    Helbing, D., Molnar, P.: Social force model for pedestrian dynamics. Physical Review E 51(4), 42–82 (1995)CrossRefGoogle Scholar
  7. 7.
    Junior, J.C.S.J., Musse, S.R., Jung, C.R.: Crowd analysis using computer vision techniques: A survey. IEEE Signal Processing Magazine 27(5), 66–77 (2010)Google Scholar
  8. 8.
    Kennedy, J., Eberhart, R.: Particle swarm optimization. In: IEEE International Conference on Neural Networks, Perth, Australia, pp. 1942–1948 (1995)Google Scholar
  9. 9.
    Kim, J., Grauman, K.: Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR (2009)Google Scholar
  10. 10.
    Kratz, L., Nishino, K.: Tracking with local spatio-temporal motion patterns in extremely crowded scenes. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 693–700 (2010)Google Scholar
  11. 11.
    Lekien, F., Marsden, J.: Tricubic interpolation in three dimensions. Journal of Numerical Methods and Engineering 63(3), 455–471 (2005)MathSciNetCrossRefMATHGoogle Scholar
  12. 12.
    Mahadevan, V., Li, W., Bhalodia, V., Vasconcelos, N.: Anomaly detection in crowded scenes. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1975–1981 (2010)Google Scholar
  13. 13.
    Mehran, R., Oyama, A., Shah, M.: Abnormal crowd behavior detection using social force model. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 935–942 (2009)Google Scholar
  14. 14.
    Reicher, S.: The Psychology of Crowd Dynamics, pp. 182–208. Blackwell, Oxford (2001)Google Scholar
  15. 15.
    Wang, X., Ma, X., Grimson, W.: Unsupervised activity perception in crowded and complicated scenes using hierarchical bayesian models. IEEE Transactions on Pattern Analysis and Machine Intelligence 31(3), 539–555 (2009)CrossRefGoogle Scholar
  16. 16.
    Wu, S., Shah, M.: Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • R. Raghavendra
    • 1
  • Alessio Del Bue
    • 1
  • Marco Cristani
    • 1
    • 2
  • Vittorio Murino
    • 1
    • 2
  1. 1.Istituto Italiano di Tecnologia (IIT)Italy
  2. 2.Dipartimento di InformaticaUniversity of VeronaItaly

Personalised recommendations