Statistical Analysis of Visual Attentional Patterns for Video Surveillance
We show that the way people observe video sequences, other than what they observe, is important for the understanding and the prediction of human activities. In this study, we consider 36 surveillance videos, organized in four categories (confront, nothing, fight, play): the videos are observed by 19 people, ten of them are experienced operators and the other nine are novices, and the gaze trajectories of both populations are recorded by an eye tracking device. Due to the proved superior ability of experienced operators in predicting violence in surveillance footage, our aim is to distinguish the two classes of people, highlighting in which respect expert operators differ from novices. Extracting spatio-temporal features from the eye tracking data, and training standard machine learning classifiers, we are able to discriminate the two groups of subjects with an average accuracy of 80.26%. The idea is that expert operators are more focused on few regions of the scene, sampling them with high frequency and low predictability. This can be thought as a first step toward the advanced automated analysis of video surveillance footage, where machines imitate as best as possible the attentive mechanisms of humans.
Keywordssurveillance gaze control eye movement analysis activity recognition eye tracking
Unable to display preview. Download preview PDF.
- 1.Bahill, A.T., Clark, M.R., Stark, L.: The main sequence, a tool for studying human eye movements. Math. Biosci. (2) (1975)Google Scholar
- 2.Blechko, A., Darker, I., Gale, A.: Skills in detecting gun carrying from CCTV. In: International Carnahan Conference on Security Technology (2008)Google Scholar
- 3.Cristani, M., Murino, V., Vinciarelli, A.: Socially intelligent surveillance and monitoring: Analysing social dimensions of physical space. In: CVPRW 2010, pp. 51–58 (2010)Google Scholar
- 5.Hales, G., Lewis, C., Silverstone, D.: Gun Crime: The Market in and Use of Illegal Firearms. Findings (Great Britain. Home Office. Research, Development and Statistics Directorate). Home Office (2006)Google Scholar
- 7.Ji, R., Sun, X., Yao, H.: What are we looking for: Towards statistical modeling of saccadic eye movements and visual saliency. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, vol. (3), pp. 1552–1559 (2012)Google Scholar
- 8.Kasarskis, P., Stehwien, J., Hickox, J., Aretz, A., Wickens, C.: Comparison of expert and novice scan behaviors during vfr flight. In: Proceedings of the 11th International Symposium on Aviation Psychology (2001)Google Scholar
- 11.Law, B., Atkins, M.S., Kirkpatrick, A.E., Lomax, A.J.: Eye gaze patterns differentiate novice and experts in a virtual laparoscopic surgery training environment, pp. 41–48 (2004)Google Scholar
- 12.Petrini, K., McAleer, P., Neary, C., Gillard, J., Pollick, F.E.: Experience in judging intent to harm modulates parahippocampal activity: an fmri study with experienced cctv operators. In: European Conference on Visual Perception (2012)Google Scholar
- 16.Torralba, A., Castelhano, M.S., Oliva, A., Henderson, J.M.: Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. Psychological Review 113 (2006)Google Scholar