Abstract
Human behavior refers to the way humans interact with their surroundings. It can be classified as either being normal or anomalous behavior. Anomalous events are behaviors that are deviant against all societal norms. One event makes another event happen, where the cause-effect relationship in behavior is the law of science. Automatically detecting anomalous events has become an important research area. It plays a significant role in video surveillance security, especially in public places also human–computer interaction. Recently, researchers have oscillated between traditional learning, deep learning, and hybrid-based models. The traditional learning-based model depends on extracting the best features to contribute to the result. The deep learning-based model deals directly with data and skips the manual step of feature extraction, offering an end-to-end problem solution. The hybrid-based model combines the benefits of both models to improve the detection result. This paper presents an inclusive review of traditional learning, deep learning, and hybrid-based models for anomalous event detection. It also hands out discussions on state-of-the-art approaches used.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Gottlieb G (1991) Experiential canalization of behavioral development: theory. Dev Psychol 27(1):4
Skinner BF (1965) Science and human behavior, no 92904. Simon and Schuster
2 February 2012. [Online]. Available: https://edition.cnn.com/soccer-deaths/
24 September 2015. [Online]. Available: https://www.bbc.com/news/
19 August 2019. [Online]. Available: https://usatoday.com/soccer-riots/
Hatfield E, Carpenter M, Rapson RL (2017) Emotional contagion as a precursor to collective emotions. In: Collective emotions: perspectives from psychology, philosophy, and sociology, pp 108–122
Slutkin G (2015) Violence is a contagious disease, Violence is a contagious disease
Datta A, Shah M, Lobo NDV (2002) Person-on-person violence detection in video data. In: Object recognition supported by user interaction for service robots
Spaaij R (2014) Sports crowd violence: an interdisciplinary synthesis. Aggression Violent Behav 19(2):146–155
Bermejo Nievas E, Deniz Suarez O, Bueno García G, Sukthankar R (2011) Violence detection in video using computer vision techniques. In: International conference on Computer analysis of images and patterns. Berlin, Heidelberg
Hassner T, Itcher Y, Kliper-Gross O (2012) Violent flows: real-time detection of violent crowd behavior. In: 2012 IEEE computer society conference on computer vision and pattern recognition workshops. IEEE, pp 1–6
Demarty CH, Penet C, Soleymani M, Gravier G (2015) VSD, a public dataset for the detection of violent scenes in movies: design, annotation, analysis and evaluation. Multimed Tools Appl 74(17)
Yun K, Honorio J, Chattopadhyay D, Berg TL, Samaras D (2012) Two-person interaction detection using body-pose features and multiple instance learning. In: 2012 IEEE computer society conference on computer vision and pattern recognition workshops
Sultani W, Chen C, Shah M (2019) Real-world anomaly detection in surveillance videos. In: Proceedings of the IEEE conference on computer vision and pattern recognition
Perez M, Kot AC, Rocha A (2019) Detection of real-world fights in surveillance videos. In: ICASSP 2019–2019 IEEE international conference on acoustics, speech and signal processing (ICASSP)
Donia MM, Youssif AA, Hashad A (2014) Spontaneous facial expression recognition based on histogram of oriented gradients descriptor. Comput Inf Sci 7(3):31–37
Potharaju Y, Kamsali M, Kesavari CR (2019) Classification of ontological violence content detection through audio features and supervised learning. Int J Intell Eng Syst 12(3):20–230
Sarman S, Sert M (2018) Audio based violent scene classification using ensemble learning. In: 2018 6th international symposium on digital forensic and security (ISDFS)
Lamba S, Nain N (2019) Detecting anomalous crowd scenes by oriented Tracklets’ approach in active contour region. Multimed Tools Appl 78(22):31101–31120
Khan M, Tahir MA, Ahmed Z (2018) Detection of violent content in cartoon videos using multimedia content detection techniques. In: 2018 IEEE 21st international multi-topic conference (INMIC). IEEE, pp 1–5
Salman M, Yar H, Jan T, Rahman KU, Real-time Violence Detection in Surveillance Videos using RPi
Das S, Sarker A, Mahmud T (2019) Violence detection from Videos using HOG features. In: 4th international conference on electrical information and communication technology (EICT)
Lohithashva BH, Aradhya VM, Guru DS (2020) Violent video event detection based on integrated LBP and GLCM texture features. Rev d’Intelligence Artif 34(2):179–187
Nadeem MS, Franqueira VN, Kurugollu F, Zhai X (2019) WVD: a new synthetic dataset for video-based violence detection. In: International conference on innovative techniques and applications of artificial intelligence, Cham
Esen E, Arabaci MA, Soysal M (2013) Fight detection in surveillance videos. In: 2013 11th international workshop on content-based multimedia indexing (CBMI)
Direkoglu C, Sah M, O’Connor NE (2017) Abnormal crowd behavior detection using novel optical flow-based features. In: 2017 14th IEEE international conference on advanced video and signal based surveillance (AVSS)
Yao C, Su X, Wang X, Kang X, Zhang J, Ren J (2021) motion direction inconsistency-based fight detection for multiview surveillance videos. Wirel Commun Mobile Comput
Parenteau M (2020) Violence detection in crowd footage: engineering statistical features using transformed optical flow
Chen S, Li T, Niu Y, Cai G (2020) Fighting detection based on hybrid features. In: Fuzzy information and engineering, pp 37–50
Wang K, Zhang Z, Wang L (2012) Violence video detection by discriminative slow feature analysis. In: Chinese conference on pattern recognition, Berlin, Heidelberg
Guo Z, Wu F, Chen H, Yuan J, Cai C (2017) Pedestrian violence detection based on optical flow energy characteristics. In: 4th international conference on systems and informatics (ICSAI). IEEE, pp 1261–1265
Zach C, Pock T, Bischof H (2007) A duality based approach for realtime TV-L1 optical flow. In: Joint pattern recognition symposium, Berlin, Heidelberg
Zhou P, Ding Q, Luo H, Hou X (2018) Violence detection in surveillance video using low-level features. PLoS One 13(10):e0203668
Febin IP, Jayasree K, Joy PT (2020) Violence detection in videos for an intelligent surveillance system using MoBSIFT and movement filtering algorithm. Pattern Anal Appl 23(2):611–623
Yun SS, Nguyen Q, Choi J (2019) Recognition of emergency situations using audio–visual perception sensor network for ambient assistive living. J Ambient Intell Humanized Comput, 10
Acar E, Hopfgartner F, Albayrak S (2016) Breaking down violence detection: combining divide-et-impera and coarse-to-fine strategies. Neurocomputing, 208
Perperis T, Giannakopoulos T, Makris A, Kosmopoulos DI, Tsekeridou S, Perantonis SJ, Theodoridis S (2011) Multimodal and ontology-based fusion approaches of audio and visual processing for violence detection in movies. Expert Syst Appl, 38
Sejnowski TJ (2018) The deep learning revolution. MIT Press
Perez L, Wang J (2017) The effectiveness of data augmentation in image classification using deep learning. arXiv preprint arXiv:1712.04621
Wu P, Liu J, Shi Y, Sun Y, Shao F, Wu Z, Yang Z (2020) Not only look, but also listen: learning multimodal violence detection under weak supervision. In: European conference on computer vision, Cham
Jaafar N, Lachiri Z (2019) Audio-visual fusion for aggression detection using deep neural networks. In: 2019 international conference on control, automation and diagnosis (ICCAD). IEEE, pp 1–5
Dubey S, Boragule A, Jeon M (2019) 3D ResNet with ranking loss function for abnormal activity detection in videos. In: 2019 international conference on control, automation and information sciences (ICCAIS)
Lu B, Lv Z, Zhu S (2019) Pseudo-3D residual networks based anomaly detection in surveillance videos. In: 2019 Chinese automation congress (CAC). IEEE, pp 3769–3773
Mumtaz A, Sargano AB, Habib Z (2018) Violence detection in surveillance videos with deep network using transfer learning. In: 2018 2nd European conference on electrical engineering and computer science (EECS)
Koppikar U, Sujatha C, Patil P, Mudenagudi U (2019) Real-world anomaly detection using deep learning. In: International conference on intelligent computing and communication, Singapore
Kumar A, Anand A, Tomar A, Yadav P, Sing KK (2021) Deep learning based intelligent violence detection surveillance system. In: Recent trends in communication and electronics, pp 29–33. CRC Press
Navalgund UV, Priyadharshini K (2018) Crime intention detection system using deep learning. In: 2018 international conference on circuits and systems in digital enterprise technology
Ullah FUM, Ullah A, Muhammad K, Haq IU, Baik SW (2019) Violence detection using spatiotemporal features with 3D convolutional neural network. Sensors 19(11):2472
Jiang B, Xu F, Tu W, Yang C (2019) Channel-wise attention in 3d convolutional networks for violence detection. In: 2019 international conference on intelligent computing and its emerging applications (ICEA). IEEE, pp59–64
Deepak K, Chandrakala S, Mohan CK (2021) Residual spatiotemporal autoencoder for unsupervised video anomaly detection. Signal Image Video Process 15(1)
Gong D, Liu L, Le V, Saha B, Mansour MR (2019) Memorizing normality to detect anomaly: memory-augmented deep autoencoder for unsupervised anomaly detection. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 1705–1714
Scaria E, Aby Abahai T, Isaac E (2017) Suspicious activity detection in surveillance video using discriminative deep belief network. Int J Control Theory Appl, 10(29-2017)
Muhammad IZ, Nasrun M, Setianingsih C (2020) Hate speech detection using global vector and deep belief network algorithm. In: 2020 1st international conference on big data analytics and practices (IBDAP)
Mathew B, Dutt R, Goyal P, Mukherjee A (2019) Spread of hate speech in online social media. In: Proceedings of the 10th ACM conference on web science, pp 173–182
Sumon SA, Goni R, Hashem NB, Shahria T, Rahman RM (2020) Violence detection by pretrained modules with different deep learning approaches. Vietnam J Comput Sci 7(01):19–40
Deshmukh A, Warang K, Pente Y, Marathe N (2021) Violence detection through surveillance system. In: ICT systems and sustainability, Singapore
Islam Z, Rukonuzzaman M, Ahmed R, Kabir M (2021) Efficient two-stream network for violence detection using separable convolutional LSTM. In: 2021 international joint conference on neural networks (IJCNN). IEEE, pp 1–8
Hanson A, Pnvr K, Krishnagopal S, Davis L (2018) Bidirectional convolutional LSTM for the detection of violence in videos. In: Proceedings of the European conference on computer vision (ECCV) workshops
Imran J, Raman B, Rajput AS (2020) Robust, efficient and privacy-preserving violent activity recognition in videos. In: Proceedings of the 35th annual ACM symposium on applied computing, pp 2081–2088
Vijeikis R, Raudonis V, Dervinis G (2022) Efficient violence detection in surveillance. Sensors 22(6):2216
Srivastava A, Badal T, Saxena P, Vidyarthi A, Singh R (2022) UAV surveillance for violence detection and individual identification. Autom Softw Eng 29(1):1–28
Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Houlsby N (2020) An image is worth 16x16 words: transformers for image recognition at scale
Aktı Ş, Ofli F, Imran M, Ekenel HK (2022) Fight detection from still images in the wild. In: Proceedings of the IEEE/CVF Winter conference on applications of computer vision
Abdali AR (2021) Data efficient video transformer for violence detection. In: 2021 IEEE international conference on communication, networks and satellite (COMNETSAT)
Li S, Liu F, Jiao L (2022) Self-training multi-sequence learning with transformer for weakly supervised video anomaly detection. In: Proceedings of the AAAI, Virtual, p 24
Ye L, Liu T, Han T, Ferdinando H, Seppänen T, Alasaarela E (2021) Campus violence detection based on artificial intelligent interpretation of surveillance video sequences. Remote Sens 13(4):628
Chatterjee R, Halder R (2021) Discrete wavelet transform for CNN-BiLSTM-based violence detection. In: Advances in systems, control and automations: select proceedings of ETAEERE, Singapore
Fenil E, Manogaran G, Vivekananda GN (2019) Real time violence detection framework for football stadium comprising of big data analysis and deep learning through bidirectional LSTM. Comput Netw 151:191–200
Hu X, Fan Z, Jiang L, Xu J, Li G, Chen W, Zeng X, Yang G, Zhang D (2022) TOP-ALCM: a novel video analysis method for violence detection in crowded scenes. Inf Sci
Keçeli AS, Kaya A (2017) Violent activity detection with transfer learning method. Electron Lett 53(15):1047–1048
Dong Z, Qin J, Wang Y (2016) Multi-stream deep networks for person to person violence detection in videos. In: Chinese conference on pattern recognition, Singapore
Rendón-Segador FJ, Álvarez-García JA, Enríquez F, Deniz O (2021) Violencenet: dense multi-head self-attention with bidirectional convolutional LSTM for detecting violence. Electronics 10(13):1601
Meng Z, Yuan J, Li Z (2017) Trajectory-pooled deep convolutional networks for violence detection in videos. In: International conference on computer vision systems, Cham
Traoré A, Akhloufi MA (2020) Violence detection in videos using deep recurrent and convolutional neural networks. In: 2020 IEEE international conference on systems, man, and cybernetics (SMC)
Mohtavipour SM, Saeidi M, Arabsorkhi A (2022) A multi-stream CNN for deep violence detection in video sequences using handcrafted features. Visual Comput 38(6):2057–2072
Li Y (2018) A deep spatiotemporal perspective for understanding crowd behavior. IEEE Trans Multimed 20(12):3289–3297
Mabrouk AB, Zagrouba E (2021) Spatiotemporal feature based convolutional neural network for violence detection. In: Thirteenth international conference on machine vision, vol 11605. SPIE, pp 386–393
Accattoli S, Sernani P, Falcionelli N, Mekuria DN, Dragoni AF (2020) Violence detection in videos by combining 3D convolutional neural networks and support vector machines. Appl Artif Intell 34(4)
Peixoto B, Lavi B, Bestagini P, Dias Z, Rocha A (2020) Multimodal violence detection in videos. In: ICASSP 2020—2020 IEEE international conference on acoustics, speech and signal processing (ICASSP)
Sun S, Liu Y, Mao L (2019) Multi-view learning for visual violence recognition with maximum entropy discrimination and deep features. Information Fusion, 50
Deepak K, Vignesh LKP, Srivathsan G, Roshan S, Chandrakala S (2020) Statistical features-based violence detection in surveillance videos. In: Cognitive informatics and soft computing, Singapore
Tian Y, Pang G, Chen Y, Singh R, Verjans JW, Carneiro G (2021) Weakly-supervised video anomaly detection with contrastive learning of long and short-range temporal features
Li T, Wang Z, Liu S, Lin WY (2021) Deep unsupervised anomaly detection. In: Proceedings of the IEEE/CVF Winter conference on applications of computer vision, pp 3636–3645
Pawar K, Attar V (2021) Application of deep learning for crowd anomaly detection from surveillance videos. In: 2021 11th international conference on cloud computing, data science & engineering (confluence)
Jalal A, Khalid N, Kim K (2020) Automatic recognition of human interaction via hybrid descriptors and maximum entropy Markov model using depth sensors. Entropy 22(8)
Ferdinando H, Ye L, Han T, Zhang Z, Sun G (2017) Violence detection from ECG signals: a preliminary study. Doctoral dissertation, Petra Christian University
Mahmoodi J, Salajeghe A (2019) A classification method based on optical flow for violence detection. Expert Syst Appl 127:121–127
Ye L, Wang L, Ferdinando H, Seppänen T, Alasaarela E (2020) A video-based DT–SVM school violence detecting algorithm. Sensors 20(7):2018
Thirumagal E, Saruladha K (2021) Design of LSTM–CNN with feature map merge for crime scene detection in CCTV footage. In: Data engineering and intelligent computing, Singapore
Ullah W, Ullah A, Hussain T, Khan ZA, Baik SW (2021) An efficient anomaly recognition framework using an attention residual LSTM in surveillance videos. Sensors 21(8):2811
Patel M (2021) Real-time violence detection using CNN-LSTM, arXiv preprint arXiv:2107.07578
Shagufta A, Hesham MT, Masood S, Abd El-latif A (2021) A vision transformer model for violence detection from real-time videos. In: The 5th international conference on future networks & distributed systems, pp 834–840
Asad M, Yang J, He J, Shamsolmoali P, He X (2020) Multi-frame feature-fusion-based model for violence detection. Vis Comput, 1–17
Karim MA, Razin MJI, Ahmed NU, Shopon M, Alam T (2021) An automatic violence detection technique using 3D convolutional neural network. In: Sustainable communication networks and application: proceedings of ICSCN 2020, vol 55, p 17
Xia Q, Zhang P, Wang J, Tian M, Fei C (2018) Real time violence detection based on deep spatio-temporal features. In: Chinese conference on biometric recognition, Cham
Funding
This work has not received any funding.
Author information
Authors and Affiliations
Contributions
All authors have contributed equally.
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
All authors declare that they have no known competing interests or conflict of interest to influence this work.
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Donia, M.M.F., Youssif, A.A.A., El-Behaidy, W.M.H. (2024). Anomalous-Aggressive Event Detection Techniques. In: Yang, XS., Sherratt, R.S., Dey, N., Joshi, A. (eds) Proceedings of Eighth International Congress on Information and Communication Technology. ICICT 2023. Lecture Notes in Networks and Systems, vol 695. Springer, Singapore. https://doi.org/10.1007/978-981-99-3043-2_7
Download citation
DOI: https://doi.org/10.1007/978-981-99-3043-2_7
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-3042-5
Online ISBN: 978-981-99-3043-2
eBook Packages: EngineeringEngineering (R0)