Skip to main content
SpringerLink
Log in

Real-time frequency-based detection of a panic behavior in human crowds

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The real-time detection of a panic behavior in a human crowd is of a high interest as it helps alleviating crowd disasters and ensures that timely appropriate action will be taken. However, the fast analysis of video sequences to detect abnormal behaviours is one of the most challenging tasks for computer vision experts. While many research works propose off-line solutions, few studies investigate the real-time analysis of crowded scenes. This may be due to the fact that detecting a panic behaviour is closely related to the analysis of the crowd dynamics, which commonly necessitates heavy computations. In order to alleviate this problem, we propose a real-time panic detection technique that analyzes the crowd movements based on a simple and efficient solution. The key idea of the proposed approach consists of analyzing the interactions between moving edges along the video in the frequency domain. Our contribution is threefold. First, moving edges are considered for analysis along the video. Second, when a panic situation occurs within a human crowd, it leads to interactions between people that are different from those that occur during a normal situation. Therefore, to reveal such a behavior, a new frequency based-feature is proposed. To select the most appropriate frequency domain, the fast fourier transform, the discrete cosine transform and the discrete wavelet transform are investigated. Third, two different formulations of the problem of detecting a panic are explored. The experimental evaluation of the proposed technique shows its outperforming compared to the state-of-the-art approaches in terms of detection rates and execution time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Agency TOSP (2015) Hajj / civil defense: 150 pilgrims died and 400 others injured in a stampede in Mina. http://www.spa.gov.sa

  2. Ahmed N, Natarajan T, Rao KR (1974) Discrete cosine transform. IEEE Trans Comput 100(1):90–93

    Article  MathSciNet  Google Scholar 

  3. Bergland GD (1969) A guided tour of the fast Fourier transform. IEEE spectrum 6(7):41–52

    Article  Google Scholar 

  4. Bleistein N (1987) On the imaging of reflectors in the earth. Geophysics 52(7):931–942

    Article  Google Scholar 

  5. Cai C, CaiHarrington PDB (1998) Different discrete wavelet transforms applied to denoising analytical data. Journal of chemical information and computer sciences 38(6):1161–1170

    Article  Google Scholar 

  6. Catherine ES, Shoichet E, Botelho G (2016) Footage shows suspects in Brussels attack. http://edition.cnn.com/2016/03/22/europe/brussels-explosions

  7. Chen D-Y, Huang P-C (2011) Motion-based unusual event detection in human crowds. J Vis Commun Image Represent 22(2):178–186

    Article  Google Scholar 

  8. Daubechies I et al (1991) Ten lectures on wavelets. In: CBMS-NSF regional conference series in applied mathematics, vol 61, no. 4

  9. Ferryman JA (2009) Pets2009benchmarkdata. http://www.cvg.reading.ac.uk/PETS2009/a.html

  10. Firdaus S, Uddin MA (2015) A survey on clustering algorithms and complexity analysis. Int J Comput Scie Issues (IJCSI) 12(2):62

    Google Scholar 

  11. Forgy EW (1965) Cluster analysis of multivariate data: efficiency versus interpretability of classifications. Biometrics 21:768–769

    Google Scholar 

  12. Fradi H, Dugelay J-L (2015) Towards crowd density-aware video surveillance applications. Inf Fus 24:3–15

    Article  Google Scholar 

  13. Fradi H, Luvison B, Pham Q-C (2017) Crowd behavior analysis using local mid-level visual descriptors. IEEE Trans Circuits Syst Video Technol 27 (3):589–602

    Article  Google Scholar 

  14. Guardian T (2017) More than a dozen fans killed in stampede at Angolan football match. https://www.theguardian.com/world/2017/feb/10/17-fans-killed-stampede-football-match-angola

  15. Gunduz AE, Ongun C, Temizel TT, Temizel A (2016) Density aware anomaly detection in crowded scenes. IET Computer Vision 10(5):376–383

    Article  Google Scholar 

  16. Kaufman L, Rousseeuw PJ (2009) Finding groups in data: An introduction to cluster analysis, vol 344. Wiley, New York

    Google Scholar 

  17. Lewis AS, Knowles G (1991) VLSI architecture for 2D Daubechies wavelet transform without multipliers. Elect Lett 27(2):171–173

    Article  Google Scholar 

  18. Li T, Chang H, Wang M, Ni B, Hong R, Yan S (2015) Crowded scene analysis: A survey. IEEE trans Circ Syst Video Technol 25(3):367–386

    Article  Google Scholar 

  19. Mallat S (1999) A wavelet tour of signal processing, Academic Press, San Diego

  20. Maurus S, Plant C (2016) Skinny-dip: Clustering in a sea of noise. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 1055–1064

  21. Mehran R, Oyama A, Shah M (2009) Abnormal crowd behavior detection using social force model. In: IEEE conference on computer vision and pattern recognition, 2009. CVPR 2009. IEEE, pp 935–942

  22. Nady A, Atia A, Abutabl AE (2018) Real-time abnormal event detection in crowded scenes. J Theo Appl Inf Technol 96:6064–6075

    Google Scholar 

  23. University of Minnesota (2006) Unusual crowd activity dataset. http://mha.cs.umn.edu/Movies/Crowd-Activity-All.avi

  24. Pennisi A, Bloisi DD, Iocchi L (2016) Online real-time crowd behavior detection in video sequences. Comput Vis Image Und 144:166–176

    Article  Google Scholar 

  25. Rabiee H, Haddadnia J, Mousavi H, Kalantarzadeh M, Nabi M, Murino V (2016) Novel dataset for fine-grained abnormal behavior understanding in crowd. In: 2016 13th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS). IEEE, pp 95–101

  26. Roshtkhari MJ, Levine MD (2013) An on-line, real-time learning method for detecting anomalies in videos using spatio-temporal compositions. Comput Vis Image Und 117(10):1436–1452

    Article  Google Scholar 

  27. Rousseeuw PJ, Driessen KV (1999) A fast algorithm for the minimum covariance determinant estimator. Technometrics 41(3):212–223

    Article  Google Scholar 

  28. Sajana T, Rani CS, Narayana K (2016) A survey on clustering techniques for big data mining. Ind J Sci Technol 9(3):14721835

    Google Scholar 

  29. Shehab D, Ammar H (2018) Statistical detection of a panic behavior in crowded scenes. Mach Vis Appl 30:1–13

    Google Scholar 

  30. Sheng Y, Roberge D, Szu HH (1992) Optical wavelet transform. Opt Eng 31(9):1840–1846

    Article  Google Scholar 

  31. Shi Y, Gao Y, Wang R (2010) Real-time abnormal event detection in complicated scenes. In: 2010 20th international conference on pattern recognition (ICPR). IEEE, pp 3653–3656

  32. Thida M, Yong YL, Climent-Pérez P, Eng H-L, Remagnino P (2013) A literature review on video analytics of crowded scenes. Springer, Berlin, pp 17–36

    Google Scholar 

  33. Stanford University (2016) WAVELAB 850. http://statweb.stanford.edu/~wavelab/

  34. Wang J, Xu Z (2016) Spatio-temporal texture modelling for real-time crowd anomaly detection. Comput Vis Image Und 144:177–187

    Article  Google Scholar 

  35. Wang L, Dong M (2012) Real-time detection of abnormal crowd behavior using a matrix approximation-based approach. In: 2012 19th IEEE international conference on image processing (ICIP), pp 2701–2704

  36. Wang Q, Deng X (1999) Damage detection with spatial wavelets. Int J Solids Struct 36(23):3443–3468

    Article  Google Scholar 

  37. waze digital (1966) cloud digital asset management platform. http://commerce.wazeedigital.com/license/clip/14121797.do

  38. waze digital (2001) cloud digital asset management platform. http://commerce.wazeedigital.com/license/clip/3682865.do

  39. Wickerhauser MV (1996) Adapted wavelet analysis: from theory to software. AK Peters/CRC Press

  40. Wu S, Moore BE, Shah M (2010) Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes. In: 2010 IEEE computer society conference on computer vision and pattern recognition, pp 2054–2060

  41. Wu S, Wong H-S, Yu Z (2014) A Bayesian model for crowd escape behavior detection. IEEE Trans Circ Syst Video Technol 24(1):85–98

    Article  Google Scholar 

  42. Xiong G, Wu X, Chen Y-L, Ou Y (2011) Abnormal crowd behavior detection based on the energy model. In: 2011 IEEE international conference on information and automation (ICIA), pp 495–500

  43. Zhan B, Monekosso DN, Remagnino P, Velastin SA, Xu L-Q (2008) Crowd analysis: A survey. Mach Vis Appl 19(5):345–357. https://doi.org/10.1007/s00138-008-0132-4

    Article  Google Scholar 

Download references

Acknowledgments

This project was funded by the Deanship of Scientific Research (DSR), King Abdulaziz University, Jeddah, under grant No. (DG-046-612-1140). The authors, therefore, gratefully acknowledge the DSR technical and financial support.

Author information

Authors and Affiliations

  1. FCIT, King Abdulaziz University, KSA, Jeddah, Saudi Arabia

    Bahya Aldissi

  2. Laboratory of Robotics, Informatics and Complex Systems (RISC-Lab), National Engineering School of Tunis, University of Tunis El Manar, Tunis, Tunisia

    Heyfa Ammar

Authors
  1. Bahya Aldissi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Heyfa Ammar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Heyfa Ammar.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Aldissi, B., Ammar, H. Real-time frequency-based detection of a panic behavior in human crowds. Multimed Tools Appl 79, 24851–24871 (2020). https://doi.org/10.1007/s11042-020-09024-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09024-z

Keywords

Search

Navigation