Abstract
In the last few years, the installation of a large number of cameras has led to a need for increased capabilities in video surveillance systems. It has, indeed, been more and more necessary for human operators to be helped in the understanding of ongoing activities in real environments. Nowadays, the technology and the research in the machine vision and artificial intelligence fields allow one to expect a new generation of completely autonomous systems able to reckon the behaviors of entities such as pedestrians, vehicles, and so forth. Hence, whereas the sensing aspect of these systems has been the issue considered the most so far, research is now focused mainly on more newsworthy problems concerning understanding. In this article, we present a novel method for hypothesizing the evolution of behavior. For such purposes, the system is required to extract useful information by means of low-level techniques for detecting and maintaining track of moving objects. The further estimation of performed trajectories, together with objects classification, enables one to compute the probability distribution of the normal activities (e.g., trajectories). Such a distribution is defined by means of a novel clustering technique. The resulting clusters are used to estimate the evolution of objects’ behaviors and to speculate about any intention to act dangerously. The provided solution for hypothesizing behaviors occurring in real environments was tested in the context of an outdoor parking lot.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Ayers, D., &Shah, M. (1998). Monitoring human behavior in an office environment. InProceedings of the Interpretation of Visual Motion Workshop, IEEE Conference on Computer Vision and Pattern Recognition (pp. 65–72). Los Alamitos, CA: IEEE Computer Society Press.
Brand, M., Oliver, N., &Pentland, A. (1997). Coupled hidden Markov models for complex action recognition. InProceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 994–999). Los Alamitos, CA: IEEE Computer Society Press.
Buxton, H., &Gong, S. (1995). Visual surveillance in a dynamic and uncertain world.Artificial Intelligence,78, 431–459.
Chleq, N., &Thonnat, M. (1996). Real-time image sequence interpretation for video-surveillance applications. InProceedings of the IEEE International Conference on Image Processing (Vol. 3, pp. 801–804). Los Alamitos, CA: IEEE Computer Society Press.
Collins, R. T., Lipton, A. J., Fujiyoshi, H., &Kanade, T. (2001). A system for video surveillance and monitoring.Proceedings of the IEEE,89, 1456–1477.
Enser, P. (2000). Visual image retrieval: Seeking the alliance of conceptbased and content-based paradigms.Journal of Information Science,26, 199–210.
Foresti, G. L., &Dolso, T. (2004). An adaptive high-order neural tree for pattern recognition.IEEE Transactions on Systems, Man, & Cybernetics: Part B,34, 988–996.
Foresti, G. L., &Gentili, S. (1999). Noise-robust and invariant object classification by the high-order statistical pattern spectrum.International Journal of Pattern Recognition & Artificial Intelligence,13, 1219–1232.
Foresti, G. L., Micheloni, C., &Snidaro, L. (2004). Event classification for automatic visual-based surveillance of parking lots. InProceedings of the IEEE International Conference on Pattern Recognition (Vol. 3, pp. 314–317). Los Alamitos, CA: IEEE Computer Society Press.
Foresti, G. L., Micheloni, C., Snidaro, L., Remagnino, P., &Ellis, T. (2005). Advanced image and video processing in active video-based surveillance systems.IEEE Signal Processing Magazine,22, 25–37.
Gao, J. B., &Harris, C. J. (2002). Some remarks on Kalman filters for the multisensor fusion.Information Fusion,3, 191–201.
Herzog, G. (1992). Utilizing interval-based event representations for incremental high-level scene analysis. In M. Aurnague, A. Borillo, M. Borillo, & M. Bras (Eds.),Proceedings of the 4th International Workshop on Semantics of Time, Space, and Movement and Spatio-Temporal Reasoning (pp. 425–435). Toulouse: Université Paul Sabatier, Groupe Langue, Raisonnement, Calcul.
Liao, S. X., &Pawlak, M. (1996). On image analysis by moments.IEEE Transactions on Pattern Analysis & Machine Intelligence,18, 254–266.
Mahonen, P. (1999). Wireless video surveillance: System concepts. InProceedings of the IEEE International Conference on Image Analysis and Processing (pp. 1090–1095). Los Alamitos, CA: IEEE Computer Society Press.
Piciarelli, C., &Foresti, G. L. (2005). Toward event recognition using dynamic trajectory analysis and prediction. InProceedings of the IEEE International Symposium on Imaging for Crime Detection and Prevention (pp. 131–134). Los Alamitos, CA: IEEE Computer Society Press.
Rosin, P. L. (2002). Thresholding for change detection.Computer Vision & Image Understanding,86, 79–95.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Micheloni, C., Piciarelli, C. & Foresti, G.L. How a visual surveillance system hypothesizes how you behave. Behavior Research Methods 38, 447–455 (2006). https://doi.org/10.3758/BF03192799
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03192799