Skip to main content

Anomalous-Aggressive Event Detection Techniques

  • Conference paper
  • First Online:
Proceedings of Eighth International Congress on Information and Communication Technology (ICICT 2023)

Abstract

Human behavior refers to the way humans interact with their surroundings. It can be classified as either being normal or anomalous behavior. Anomalous events are behaviors that are deviant against all societal norms. One event makes another event happen, where the cause-effect relationship in behavior is the law of science. Automatically detecting anomalous events has become an important research area. It plays a significant role in video surveillance security, especially in public places also human–computer interaction. Recently, researchers have oscillated between traditional learning, deep learning, and hybrid-based models. The traditional learning-based model depends on extracting the best features to contribute to the result. The deep learning-based model deals directly with data and skips the manual step of feature extraction, offering an end-to-end problem solution. The hybrid-based model combines the benefits of both models to improve the detection result. This paper presents an inclusive review of traditional learning, deep learning, and hybrid-based models for anomalous event detection. It also hands out discussions on state-of-the-art approaches used.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Gottlieb G (1991) Experiential canalization of behavioral development: theory. Dev Psychol 27(1):4

    Google Scholar 

  2. Skinner BF (1965) Science and human behavior, no 92904. Simon and Schuster

    Google Scholar 

  3. 2 February 2012. [Online]. Available: https://edition.cnn.com/soccer-deaths/

  4. 24 September 2015. [Online]. Available: https://www.bbc.com/news/

  5. 19 August 2019. [Online]. Available: https://usatoday.com/soccer-riots/

  6. Hatfield E, Carpenter M, Rapson RL (2017) Emotional contagion as a precursor to collective emotions. In: Collective emotions: perspectives from psychology, philosophy, and sociology, pp 108–122

    Google Scholar 

  7. Slutkin G (2015) Violence is a contagious disease, Violence is a contagious disease

    Google Scholar 

  8. Datta A, Shah M, Lobo NDV (2002) Person-on-person violence detection in video data. In: Object recognition supported by user interaction for service robots

    Google Scholar 

  9. Spaaij R (2014) Sports crowd violence: an interdisciplinary synthesis. Aggression Violent Behav 19(2):146–155

    Google Scholar 

  10. Bermejo Nievas E, Deniz Suarez O, Bueno García G, Sukthankar R (2011) Violence detection in video using computer vision techniques. In: International conference on Computer analysis of images and patterns. Berlin, Heidelberg

    Google Scholar 

  11. Hassner T, Itcher Y, Kliper-Gross O (2012) Violent flows: real-time detection of violent crowd behavior. In: 2012 IEEE computer society conference on computer vision and pattern recognition workshops. IEEE, pp 1–6

    Google Scholar 

  12. Demarty CH, Penet C, Soleymani M, Gravier G (2015) VSD, a public dataset for the detection of violent scenes in movies: design, annotation, analysis and evaluation. Multimed Tools Appl 74(17)

    Google Scholar 

  13. Yun K, Honorio J, Chattopadhyay D, Berg TL, Samaras D (2012) Two-person interaction detection using body-pose features and multiple instance learning. In: 2012 IEEE computer society conference on computer vision and pattern recognition workshops

    Google Scholar 

  14. Sultani W, Chen C, Shah M (2019) Real-world anomaly detection in surveillance videos. In: Proceedings of the IEEE conference on computer vision and pattern recognition

    Google Scholar 

  15. Perez M, Kot AC, Rocha A (2019) Detection of real-world fights in surveillance videos. In: ICASSP 2019–2019 IEEE international conference on acoustics, speech and signal processing (ICASSP)

    Google Scholar 

  16. Donia MM, Youssif AA, Hashad A (2014) Spontaneous facial expression recognition based on histogram of oriented gradients descriptor. Comput Inf Sci 7(3):31–37

    Google Scholar 

  17. Potharaju Y, Kamsali M, Kesavari CR (2019) Classification of ontological violence content detection through audio features and supervised learning. Int J Intell Eng Syst 12(3):20–230

    Google Scholar 

  18. Sarman S, Sert M (2018) Audio based violent scene classification using ensemble learning. In: 2018 6th international symposium on digital forensic and security (ISDFS)

    Google Scholar 

  19. Lamba S, Nain N (2019) Detecting anomalous crowd scenes by oriented Tracklets’ approach in active contour region. Multimed Tools Appl 78(22):31101–31120

    Google Scholar 

  20. Khan M, Tahir MA, Ahmed Z (2018) Detection of violent content in cartoon videos using multimedia content detection techniques. In: 2018 IEEE 21st international multi-topic conference (INMIC). IEEE, pp 1–5

    Google Scholar 

  21. Salman M, Yar H, Jan T, Rahman KU, Real-time Violence Detection in Surveillance Videos using RPi

    Google Scholar 

  22. Das S, Sarker A, Mahmud T (2019) Violence detection from Videos using HOG features. In: 4th international conference on electrical information and communication technology (EICT)

    Google Scholar 

  23. Lohithashva BH, Aradhya VM, Guru DS (2020) Violent video event detection based on integrated LBP and GLCM texture features. Rev d’Intelligence Artif 34(2):179–187

    Google Scholar 

  24. Nadeem MS, Franqueira VN, Kurugollu F, Zhai X (2019) WVD: a new synthetic dataset for video-based violence detection. In: International conference on innovative techniques and applications of artificial intelligence, Cham

    Google Scholar 

  25. Esen E, Arabaci MA, Soysal M (2013) Fight detection in surveillance videos. In: 2013 11th international workshop on content-based multimedia indexing (CBMI)

    Google Scholar 

  26. Direkoglu C, Sah M, O’Connor NE (2017) Abnormal crowd behavior detection using novel optical flow-based features. In: 2017 14th IEEE international conference on advanced video and signal based surveillance (AVSS)

    Google Scholar 

  27. Yao C, Su X, Wang X, Kang X, Zhang J, Ren J (2021) motion direction inconsistency-based fight detection for multiview surveillance videos. Wirel Commun Mobile Comput

    Google Scholar 

  28. Parenteau M (2020) Violence detection in crowd footage: engineering statistical features using transformed optical flow

    Google Scholar 

  29. Chen S, Li T, Niu Y, Cai G (2020) Fighting detection based on hybrid features. In: Fuzzy information and engineering, pp 37–50

    Google Scholar 

  30. Wang K, Zhang Z, Wang L (2012) Violence video detection by discriminative slow feature analysis. In: Chinese conference on pattern recognition, Berlin, Heidelberg

    Google Scholar 

  31. Guo Z, Wu F, Chen H, Yuan J, Cai C (2017) Pedestrian violence detection based on optical flow energy characteristics. In: 4th international conference on systems and informatics (ICSAI). IEEE, pp 1261–1265

    Google Scholar 

  32. Zach C, Pock T, Bischof H (2007) A duality based approach for realtime TV-L1 optical flow. In: Joint pattern recognition symposium, Berlin, Heidelberg

    Google Scholar 

  33. Zhou P, Ding Q, Luo H, Hou X (2018) Violence detection in surveillance video using low-level features. PLoS One 13(10):e0203668

    Google Scholar 

  34. Febin IP, Jayasree K, Joy PT (2020) Violence detection in videos for an intelligent surveillance system using MoBSIFT and movement filtering algorithm. Pattern Anal Appl 23(2):611–623

    Google Scholar 

  35. Yun SS, Nguyen Q, Choi J (2019) Recognition of emergency situations using audio–visual perception sensor network for ambient assistive living. J Ambient Intell Humanized Comput, 10

    Google Scholar 

  36. Acar E, Hopfgartner F, Albayrak S (2016) Breaking down violence detection: combining divide-et-impera and coarse-to-fine strategies. Neurocomputing, 208

    Google Scholar 

  37. Perperis T, Giannakopoulos T, Makris A, Kosmopoulos DI, Tsekeridou S, Perantonis SJ, Theodoridis S (2011) Multimodal and ontology-based fusion approaches of audio and visual processing for violence detection in movies. Expert Syst Appl, 38

    Google Scholar 

  38. Sejnowski TJ (2018) The deep learning revolution. MIT Press

    Google Scholar 

  39. Perez L, Wang J (2017) The effectiveness of data augmentation in image classification using deep learning. arXiv preprint arXiv:1712.04621

  40. Wu P, Liu J, Shi Y, Sun Y, Shao F, Wu Z, Yang Z (2020) Not only look, but also listen: learning multimodal violence detection under weak supervision. In: European conference on computer vision, Cham

    Google Scholar 

  41. Jaafar N, Lachiri Z (2019) Audio-visual fusion for aggression detection using deep neural networks. In: 2019 international conference on control, automation and diagnosis (ICCAD). IEEE, pp 1–5

    Google Scholar 

  42. Dubey S, Boragule A, Jeon M (2019) 3D ResNet with ranking loss function for abnormal activity detection in videos. In: 2019 international conference on control, automation and information sciences (ICCAIS)

    Google Scholar 

  43. Lu B, Lv Z, Zhu S (2019) Pseudo-3D residual networks based anomaly detection in surveillance videos. In: 2019 Chinese automation congress (CAC). IEEE, pp 3769–3773

    Google Scholar 

  44. Mumtaz A, Sargano AB, Habib Z (2018) Violence detection in surveillance videos with deep network using transfer learning. In: 2018 2nd European conference on electrical engineering and computer science (EECS)

    Google Scholar 

  45. Koppikar U, Sujatha C, Patil P, Mudenagudi U (2019) Real-world anomaly detection using deep learning. In: International conference on intelligent computing and communication, Singapore

    Google Scholar 

  46. Kumar A, Anand A, Tomar A, Yadav P, Sing KK (2021) Deep learning based intelligent violence detection surveillance system. In: Recent trends in communication and electronics, pp 29–33. CRC Press

    Google Scholar 

  47. Navalgund UV, Priyadharshini K (2018) Crime intention detection system using deep learning. In: 2018 international conference on circuits and systems in digital enterprise technology

    Google Scholar 

  48. Ullah FUM, Ullah A, Muhammad K, Haq IU, Baik SW (2019) Violence detection using spatiotemporal features with 3D convolutional neural network. Sensors 19(11):2472

    Google Scholar 

  49. Jiang B, Xu F, Tu W, Yang C (2019) Channel-wise attention in 3d convolutional networks for violence detection. In: 2019 international conference on intelligent computing and its emerging applications (ICEA). IEEE, pp59–64

    Google Scholar 

  50. Deepak K, Chandrakala S, Mohan CK (2021) Residual spatiotemporal autoencoder for unsupervised video anomaly detection. Signal Image Video Process 15(1)

    Google Scholar 

  51. Gong D, Liu L, Le V, Saha B, Mansour MR (2019) Memorizing normality to detect anomaly: memory-augmented deep autoencoder for unsupervised anomaly detection. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 1705–1714

    Google Scholar 

  52. Scaria E, Aby Abahai T, Isaac E (2017) Suspicious activity detection in surveillance video using discriminative deep belief network. Int J Control Theory Appl, 10(29-2017)

    Google Scholar 

  53. Muhammad IZ, Nasrun M, Setianingsih C (2020) Hate speech detection using global vector and deep belief network algorithm. In: 2020 1st international conference on big data analytics and practices (IBDAP)

    Google Scholar 

  54. Mathew B, Dutt R, Goyal P, Mukherjee A (2019) Spread of hate speech in online social media. In: Proceedings of the 10th ACM conference on web science, pp 173–182

    Google Scholar 

  55. Sumon SA, Goni R, Hashem NB, Shahria T, Rahman RM (2020) Violence detection by pretrained modules with different deep learning approaches. Vietnam J Comput Sci 7(01):19–40

    Google Scholar 

  56. Deshmukh A, Warang K, Pente Y, Marathe N (2021) Violence detection through surveillance system. In: ICT systems and sustainability, Singapore

    Google Scholar 

  57. Islam Z, Rukonuzzaman M, Ahmed R, Kabir M (2021) Efficient two-stream network for violence detection using separable convolutional LSTM. In: 2021 international joint conference on neural networks (IJCNN). IEEE, pp 1–8

    Google Scholar 

  58. Hanson A, Pnvr K, Krishnagopal S, Davis L (2018) Bidirectional convolutional LSTM for the detection of violence in videos. In: Proceedings of the European conference on computer vision (ECCV) workshops

    Google Scholar 

  59. Imran J, Raman B, Rajput AS (2020) Robust, efficient and privacy-preserving violent activity recognition in videos. In: Proceedings of the 35th annual ACM symposium on applied computing, pp 2081–2088

    Google Scholar 

  60. Vijeikis R, Raudonis V, Dervinis G (2022) Efficient violence detection in surveillance. Sensors 22(6):2216

    Google Scholar 

  61. Srivastava A, Badal T, Saxena P, Vidyarthi A, Singh R (2022) UAV surveillance for violence detection and individual identification. Autom Softw Eng 29(1):1–28

    Google Scholar 

  62. Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Houlsby N (2020) An image is worth 16x16 words: transformers for image recognition at scale

    Google Scholar 

  63. Aktı Ş, Ofli F, Imran M, Ekenel HK (2022) Fight detection from still images in the wild. In: Proceedings of the IEEE/CVF Winter conference on applications of computer vision

    Google Scholar 

  64. Abdali AR (2021) Data efficient video transformer for violence detection. In: 2021 IEEE international conference on communication, networks and satellite (COMNETSAT)

    Google Scholar 

  65. Li S, Liu F, Jiao L (2022) Self-training multi-sequence learning with transformer for weakly supervised video anomaly detection. In: Proceedings of the AAAI, Virtual, p 24

    Google Scholar 

  66. Ye L, Liu T, Han T, Ferdinando H, Seppänen T, Alasaarela E (2021) Campus violence detection based on artificial intelligent interpretation of surveillance video sequences. Remote Sens 13(4):628

    Google Scholar 

  67. Chatterjee R, Halder R (2021) Discrete wavelet transform for CNN-BiLSTM-based violence detection. In: Advances in systems, control and automations: select proceedings of ETAEERE, Singapore

    Google Scholar 

  68. Fenil E, Manogaran G, Vivekananda GN (2019) Real time violence detection framework for football stadium comprising of big data analysis and deep learning through bidirectional LSTM. Comput Netw 151:191–200

    Google Scholar 

  69. Hu X, Fan Z, Jiang L, Xu J, Li G, Chen W, Zeng X, Yang G, Zhang D (2022) TOP-ALCM: a novel video analysis method for violence detection in crowded scenes. Inf Sci

    Google Scholar 

  70. Keçeli AS, Kaya A (2017) Violent activity detection with transfer learning method. Electron Lett 53(15):1047–1048

    Google Scholar 

  71. Dong Z, Qin J, Wang Y (2016) Multi-stream deep networks for person to person violence detection in videos. In: Chinese conference on pattern recognition, Singapore

    Google Scholar 

  72. Rendón-Segador FJ, Álvarez-García JA, Enríquez F, Deniz O (2021) Violencenet: dense multi-head self-attention with bidirectional convolutional LSTM for detecting violence. Electronics 10(13):1601

    Google Scholar 

  73. Meng Z, Yuan J, Li Z (2017) Trajectory-pooled deep convolutional networks for violence detection in videos. In: International conference on computer vision systems, Cham

    Google Scholar 

  74. Traoré A, Akhloufi MA (2020) Violence detection in videos using deep recurrent and convolutional neural networks. In: 2020 IEEE international conference on systems, man, and cybernetics (SMC)

    Google Scholar 

  75. Mohtavipour SM, Saeidi M, Arabsorkhi A (2022) A multi-stream CNN for deep violence detection in video sequences using handcrafted features. Visual Comput 38(6):2057–2072

    Google Scholar 

  76. Li Y (2018) A deep spatiotemporal perspective for understanding crowd behavior. IEEE Trans Multimed 20(12):3289–3297

    Google Scholar 

  77. Mabrouk AB, Zagrouba E (2021) Spatiotemporal feature based convolutional neural network for violence detection. In: Thirteenth international conference on machine vision, vol 11605. SPIE, pp 386–393

    Google Scholar 

  78. Accattoli S, Sernani P, Falcionelli N, Mekuria DN, Dragoni AF (2020) Violence detection in videos by combining 3D convolutional neural networks and support vector machines. Appl Artif Intell 34(4)

    Google Scholar 

  79. Peixoto B, Lavi B, Bestagini P, Dias Z, Rocha A (2020) Multimodal violence detection in videos. In: ICASSP 2020—2020 IEEE international conference on acoustics, speech and signal processing (ICASSP)

    Google Scholar 

  80. Sun S, Liu Y, Mao L (2019) Multi-view learning for visual violence recognition with maximum entropy discrimination and deep features. Information Fusion, 50

    Google Scholar 

  81. Deepak K, Vignesh LKP, Srivathsan G, Roshan S, Chandrakala S (2020) Statistical features-based violence detection in surveillance videos. In: Cognitive informatics and soft computing, Singapore

    Google Scholar 

  82. Tian Y, Pang G, Chen Y, Singh R, Verjans JW, Carneiro G (2021) Weakly-supervised video anomaly detection with contrastive learning of long and short-range temporal features

    Google Scholar 

  83. Li T, Wang Z, Liu S, Lin WY (2021) Deep unsupervised anomaly detection. In: Proceedings of the IEEE/CVF Winter conference on applications of computer vision, pp 3636–3645

    Google Scholar 

  84. Pawar K, Attar V (2021) Application of deep learning for crowd anomaly detection from surveillance videos. In: 2021 11th international conference on cloud computing, data science & engineering (confluence)

    Google Scholar 

  85. Jalal A, Khalid N, Kim K (2020) Automatic recognition of human interaction via hybrid descriptors and maximum entropy Markov model using depth sensors. Entropy 22(8)

    Google Scholar 

  86. Ferdinando H, Ye L, Han T, Zhang Z, Sun G (2017) Violence detection from ECG signals: a preliminary study. Doctoral dissertation, Petra Christian University

    Google Scholar 

  87. Mahmoodi J, Salajeghe A (2019) A classification method based on optical flow for violence detection. Expert Syst Appl 127:121–127

    Google Scholar 

  88. Ye L, Wang L, Ferdinando H, Seppänen T, Alasaarela E (2020) A video-based DT–SVM school violence detecting algorithm. Sensors 20(7):2018

    Google Scholar 

  89. Thirumagal E, Saruladha K (2021) Design of LSTM–CNN with feature map merge for crime scene detection in CCTV footage. In: Data engineering and intelligent computing, Singapore

    Google Scholar 

  90. Ullah W, Ullah A, Hussain T, Khan ZA, Baik SW (2021) An efficient anomaly recognition framework using an attention residual LSTM in surveillance videos. Sensors 21(8):2811

    Google Scholar 

  91. Patel M (2021) Real-time violence detection using CNN-LSTM, arXiv preprint arXiv:2107.07578

  92. Shagufta A, Hesham MT, Masood S, Abd El-latif A (2021) A vision transformer model for violence detection from real-time videos. In: The 5th international conference on future networks & distributed systems, pp 834–840

    Google Scholar 

  93. Asad M, Yang J, He J, Shamsolmoali P, He X (2020) Multi-frame feature-fusion-based model for violence detection. Vis Comput, 1–17

    Google Scholar 

  94. Karim MA, Razin MJI, Ahmed NU, Shopon M, Alam T (2021) An automatic violence detection technique using 3D convolutional neural network. In: Sustainable communication networks and application: proceedings of ICSCN 2020, vol 55, p 17

    Google Scholar 

  95. Xia Q, Zhang P, Wang J, Tian M, Fei C (2018) Real time violence detection based on deep spatio-temporal features. In: Chinese conference on biometric recognition, Cham

    Google Scholar 

Download references

Funding

This work has not received any funding.

Author information

Authors and Affiliations

Authors

Contributions

All authors have contributed equally.

Corresponding author

Correspondence to Manar M. F. Donia .

Editor information

Editors and Affiliations

Ethics declarations

All authors declare that they have no known competing interests or conflict of interest to influence this work.

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Donia, M.M.F., Youssif, A.A.A., El-Behaidy, W.M.H. (2024). Anomalous-Aggressive Event Detection Techniques. In: Yang, XS., Sherratt, R.S., Dey, N., Joshi, A. (eds) Proceedings of Eighth International Congress on Information and Communication Technology. ICICT 2023. Lecture Notes in Networks and Systems, vol 695. Springer, Singapore. https://doi.org/10.1007/978-981-99-3043-2_7

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-3043-2_7

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-3042-5

  • Online ISBN: 978-981-99-3043-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics