Detecting anomalous crowd behavior using correlation analysis of optical flow

  • Navneet Nayan
  • Sitanshu Sekhar SahuEmail author
  • Sanjeet Kumar
Original Paper


Defining anomaly criteria is inherently a challenging and critical task. In current scenario, accurate and fast detection of any anomalous events by the visual surveillance system is a major target. To tackle this challenge, a novel method based on correlation analysis of the optical flow has been proposed in this paper for accurate and fast detection of anomalous behavior of a crowd. Exhaustive experimentation has been carried out on the available standard UMN and PETS 2009 datasets for performance comparison. The experimental results demonstrate that the proposed method provides fast detection compared to the existing methods with an accuracy of 97.32%. Further, several factors such as frame gap (the gap of frames for processing during event detection) and illumination condition have been studied. It has been found that the range of correlation value is large under proper illumination condition, whereas its range is small under improper illumination condition. Based on the empirical study, the optimum threshold of 0.75 justifies all types of illumination conditions for the event detection. Again, the optimal value of a gap of four frames has been found suitable to accurately detect the anomalous crowd behavior with less computational burden.


Anomalous crowd behavior Optical flow Correlation analysis Correlation coefficient Frame gap Optimal threshold value 



  1. 1.
    Li, T., Chang, H., Wang, M., Ni, B., Hong, R., Yan, S.: Crowded scene analysis: a survey. IEEE Trans. Circuits Syst. Video Technol. 25(3), 367–386 (2015)CrossRefGoogle Scholar
  2. 2.
    Junior, J.C.S.J., Musse, S.R., Jung, C.R.: Crowd analysis using computer vision techniques: a survey. IEEE Signal Process. Mag. 27, 66–77 (2010)Google Scholar
  3. 3.
    Bon, G.L.: The Crowd: A Study of the Popular Mind. Dover Publications, New York (2012)Google Scholar
  4. 4.
    Still, G.K.: Introduction to Crowd Science. CRC Press, Boca Raton (2013)Google Scholar
  5. 5.
    Dogbe, C.: Modeling crowd dynamics from a kinetic theory view point. J. Math. Sci. Adv. Appl. 30, 71–88 (2014)Google Scholar
  6. 6.
    Bellomo, N., Berrone, S., Gibelli, L., Pieri, A.: First order models of human crowds with behavioral-social dynamics. Phys. Soc. (Physics.soc-ph), 1–13 (2015)Google Scholar
  7. 7.
    Chen, C.Y., Shao, Y.: Crowd escape behavior detection and localization based on divergent centers. IEEE Sens. J. 15(4), 2431–2439 (2015)CrossRefGoogle Scholar
  8. 8.
    Mehran, R., Oyama, A., Shah, M.: Anomalous crowd behavior detection using social force model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 935–942 (2009)Google Scholar
  9. 9.
    Chen, C., Shao, Y., Bi, X.: Detection of anomalous crowd behavior based on the acceleration feature. IEEE Sens. J. 15(12), 7252–7261 (2015)CrossRefGoogle Scholar
  10. 10.
    Rao, A.S., Gubbi, J., Marusic, S., Palaniswami, M.: Crowd event detection on optical flow manifolds. IEEE Trans. Cybern. 46(7), 1524–1537 (2016)CrossRefGoogle Scholar
  11. 11.
    Hu, M., Ali, S., Shah, M.: Learning motion patterns in crowded scenes using motion flow field. In: IEEE International Conference on Pattern Recognition (ICPR), pp. 1–5 (2008)Google Scholar
  12. 12.
    Chen, D.Y., Huang, P.C.: Visual based human crowds behavior analysis based on graph modeling and matching. IEEE Sens. J. 13(6), 2129–2138 (2013)CrossRefGoogle Scholar
  13. 13.
    Fradi, H., Luvison, B., Pham, Q.C.: Crowd behavior analysis using local mid-level visual descriptors. IEEE Trans. Circuits Syst. Video Technol. 27(3), 589–602 (2017)CrossRefGoogle Scholar
  14. 14.
    Zhang, Y., Qin, L., Ji, R., Yao, H., Huang, Q.: Social attribute-aware force model: exploiting richness of interaction for abnormal crowd detection. IEEE Trans. Circuit Syst. Video Technol. 25(7), 1231–1245 (2015)CrossRefGoogle Scholar
  15. 15.
    Yi, S., Li, H., Wang, X.: Pedestrian behavior modelling from stationary crowds with application to intelligent surveillance. IEEE Trans. Image Proc. 25(9), 4354–4368 (2016)CrossRefzbMATHGoogle Scholar
  16. 16.
    Cong, Y., Yuan, J., Tang, Y.: Video anomaly search in crowded scenes via spatio–temporal motion context. IEEE Trans. Inf. Forensic Secur. 8(10), 1590–1599 (2013)CrossRefGoogle Scholar
  17. 17.
    Andersson, M., Gustafsson, F., Laurent, L.S., Prevost, D.: Recognition of anomalous motion patterns in urban surveillance. IEEE J. Sel. Top. Signal Process. 7(1), 102–110 (2013)CrossRefGoogle Scholar
  18. 18.
    Amit, A., Rivlin, E., Shimshoni, I., Reinitz, D.: Robust real-time unusual event detection using multiple fixed-location monitors. IEEE Trans. Pattern Anal. Mach. Intell. 30(3), 555–560 (2008)CrossRefGoogle Scholar
  19. 19.
    Gunduz, A.E., Ongun, C., Temizel, T.T., Temizel, A.: Density aware anomaly detection in crowded scenes. IET Comput. Vis. 10(5), 374–381 (2015)Google Scholar
  20. 20.
    Velastin, S.A., Yin, J.H., Davies, A.C., Vicencio-Silva, M.A., Allsop, R.E., Penn, A.: Analysis of crowd movements and densities in built-up environments using image processing. In: IEE Colloquium on Image Processing for Transport Applications, pp. 8/1–8/6 (1993)Google Scholar
  21. 21.
    Velastin, S.A., Yin, J.H., Davies, A.C., Vicencio-Silva, M.A., Allsop, R.E., Penn, A.: Automated measurement of crowd density and motion using image processing. In: IEEE International Conference on Road Traffic Monitoring and Control (ICRTMC), pp. 127–132 (1994)Google Scholar
  22. 22.
    Khan, M.U.K., Park, H., Kyung, C.: Rejecting motion outliers for efficient crowd anomaly detection. IEEE Trans. Inf. Forensic Secur. 14(2), 541–556 (2019)CrossRefGoogle Scholar
  23. 23.
    Hu, X., Hu, S., Huang, Y., Zhang, H., Wu, H.: Video anomaly detection using deep incremental slow feature analysis network. IET Comput. Vis. 10(4), 258–265 (2016)CrossRefGoogle Scholar
  24. 24.
    Revathi, A.R., Kumar, D.: An efficient system for anomaly detection using deep learning classifier. Signal Image Video Process. 11(2), 291–299 (2017)CrossRefGoogle Scholar
  25. 25.
    Kangwei, L., Jianhua, W., Zhongzhi, H.: Abnormal event detection and localization using level set based on hybrid features. Signal Image Video Process. 12(2), 255–261 (2018)CrossRefGoogle Scholar
  26. 26.
    Li, S., Liu, C., Yang, Y.: Anomaly detection based on sparse coding with two kinds of dictionaries. Signal Image Video Process. 12(5), 983–989 (2018)CrossRefGoogle Scholar
  27. 27.
    Amraee, S., Vafaei, A., Jamshidi, K., Adibi, P.: Abnormal event detection in crowded scenes using one-class SVM. Signal Image Video Process. 12(6), 1115–1123 (2018)CrossRefGoogle Scholar
  28. 28.
    Horn, B.K.P., Schunck, B.G.: determining optical flow. Artif. Intell. 17(1–3), 185–203 (1981)CrossRefGoogle Scholar
  29. 29.
    Hassner, T., Itcher, Y., Kliper-Gross, O.: Violent flows: real-time detection of violent crowd behavior. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPR), pp. 1–6 (2012)Google Scholar
  30. 30.
    Bai, L., Velichko, A., Drinkwater, B.W.: Ultrasonic characterization of crack-like defects using scattering matrix similarity metrics. IEEE Trans. Ultrason. Ferroelecr. Freq. Control 62(3), 545–559 (2015)CrossRefGoogle Scholar
  31. 31.
    Barron, J.L., Fleet, D.J., Beauchemin, S.S., Burkitt, T.A.: Performance of optical flow techniques. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), pp. 236–242 (1992)Google Scholar
  32. 32.
    UMN dataset: Detection of Unusual Crowd Activity. Accessed 1 Dec 2016
  33. 33.
    PETS 2009 Benchmark Data. Accessed 15 Mar 2017
  34. 34.
    Zhang, Y., Huang, Q., Qin, L., Zhao, S., Yao, H., Xu, P.: Representing dense crowd patterns using bag of trajectory graphs. Signal Image Video Process. 8(1), 173–181 (2014)CrossRefGoogle Scholar
  35. 35.
    Susan, S., Hanmandlu, M.: Unsupervised detection of nonlinearity in motion using weighted average of non-extensive entropies. Signal Image Video Process. 9(3), 511–525 (2015)CrossRefGoogle Scholar
  36. 36.
    Kaltsa, V., Briassouli, A., Kompatsiaris, I., Hadjileontiadis, L.J., Strintzis, M.J.: Swarm intelligence for detecting interesting events in crowded environments. IEEE Trans. Image Process. 24(7), 2153–2166 (2015)MathSciNetCrossRefzbMATHGoogle Scholar
  37. 37.
    Cui, X., Liu, Q., Gao, M., Metaxas, D.N.: Abnormal detection using interaction energy potentials. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3161–3167 (2011)Google Scholar
  38. 38.
    Lloyd, K., Rosin, P.L., Marshall, D., Moore, S.C.: Detecting violent and abnormal crowd activity using temporal analysis of grey level co-occurrence matrix (GLCM) based texture measures. Signal Image Video Process. 28, 361–371 (2017)Google Scholar
  39. 39.
    Yuan, Y., Fang, J., Wang, Q.: Online anomaly detection in crowd scenes via structure analysis. IEEE Trans. Cybern. 45(3), 548–561 (2015)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of Electronics and Communication EngineeringBirla Institute of TechnologyRanchiIndia

Personalised recommendations