Abstract
We explore in this chapter a location-based approach for behavior modeling and abnormality detection. In contrast to conventional object-based approaches for which objects are identified, classified, and tracked to locate objects with suspicious behavior, we proceed directly with event characterization and behavior modeling using low-level features. Our approach consists of two-phases. In the first phase, co-occurrence of activity between temporal sequences of motion labels are used to build a statistical model for normal behavior. This model of co-occurrence statistics is embedded within a co-occurrence matrix which accounts for spatio-temporal co-occurrence of activity. In the second phase, the co-occurrence matrix is used as a potential function in a Markov-Random Field framework to describe, as the video streams in, the probability of observing new volumes of activity. The co-occurrence matrix is thus used for detecting moving objects whose behavior differs from the ones observed during the training phase. Interestingly, the Markov-Random Field distribution implicitly accounts for speed, direction, as well as the average size of the objects without any higher-level intervention. Furthermore, when the spatio-temporal volume is large enough, the co-occurrence distribution contains the average normal path followed by moving objects. Our method has been tested on various outdoor videos representing various challenges.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Adam, A., Rivlin, E., Shimshoni, I., Reinitz, D.: Robust real-time unusual event detection using multiple fixed-location monitors. Trans. Pattern Anal. Mach. Intell. 30(3), 555–560 (2008)
Benezeth, Y., Jodoin, P.-M., Emile, B., Laurent, H., Rosenberger, C.: Review and evaluation of commonly-implemented background subtraction algorithms. In: International Conference on Pattern Recognition (ICPR) (2008)
Benezeth, Y., Jodoin, P.-M., Saligrama, V., Rosenberger, C.: Abnormal events detection based on spatio-temporal co-occurrences. In: International Conference on Computer Vision and Pattern Recognition, pp. 2458–2465 (2009)
Bobick, A.F., Davis, J.W.: The recognition of human movement using temporal templates. Trans. Pattern Anal. Mach. Intell. 23(3), 257–267 (2001)
Hu, W., Tab, T., Wang, L., Maybank, S.: A survey on visual surveillance of object motion and behaviors. Trans. Syst. Man Cybern. Part C, Appl. Rev. 34(3), 334–352 (2004)
Jodoin, P.-M., Konrad, J., Saligrama, V.: Modeling background activity for behavior subtraction. In: International Conference on Distributed Smart Cameras
Polonik, W.: Minimum volume sets and generalized quantile processes. Stoch. Process. Appl. 69, 1–24 (1997)
Pritch, Y., Rav-Acha, A., Peleg, S.: Non-chronological video synopsis and indexing. Trans. Pattern Anal. Mach. Intell. 30(11), 1971–1984 (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag London Limited
About this chapter
Cite this chapter
Benezeth, Y., Jodoin, PM., Saligrama, V. (2011). Modeling Patterns of Activity and Detecting Abnormal Events with Low-Level Co-occurrences. In: Bhanu, B., Ravishankar, C., Roy-Chowdhury, A., Aghajan, H., Terzopoulos, D. (eds) Distributed Video Sensor Networks. Springer, London. https://doi.org/10.1007/978-0-85729-127-1_9
Download citation
DOI: https://doi.org/10.1007/978-0-85729-127-1_9
Publisher Name: Springer, London
Print ISBN: 978-0-85729-126-4
Online ISBN: 978-0-85729-127-1
eBook Packages: Computer ScienceComputer Science (R0)