Multi-perspective Video Analysis of Persons and Vehicles for Enhanced Situational Awareness
This paper presents a multi-perspective vision-based analysis of people and vehicle activities for the enhancement of situational awareness. Multiple perspectives provide a useful invariant feature of object in image, i.e., the footage area on the ground. Moving objects are detected in image domain, and tracking results of the objects are represented in projection domain using planar homography. Spatio-temporal relationships between human and vehicle tracks are categorized to safe or unsafe situation depending on site context such as walkway and driveway locations. Semantic-level information of the situation is achieved with the anticipation of possible directions of near-future tracks using piecewise velocity history. Crowd density is estimated from the footage in homography plane. Experimental data show promising results. Our framework can be applied to broad range of situational awareness for emergency response, disaster prevention, human interactions in structured environments, and crowd movement analysis in wide-view areas.
KeywordsGaussian Mixture Model Situational Awareness Virtual View World Coordinate System Foreground Region
Unable to display preview. Download preview PDF.
- 2.Antonini, G., Bierlaire, M.: Capturing interactions in pedestrian walking behavior in a discrete choice framework. Transportation Research Part B (September 2005)Google Scholar
- 5.McKenna, S.J., Jabri, S., Duric, Z., Wechsler, H.: Tracking interacting people. In: 4th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2000), pp. 348–353 (2000)Google Scholar
- 7.Park, S., Trivedi, M.M.: A track-based human movement analysis and privacy protection system adaptive to environmental contexts. In: IEEE International Conference on Advanced Video and Signal based Surveillance, Como, Italy (2005)Google Scholar
- 8.Remagnino, P., Shihab, A.I., Jones, G.A.: Distributed intelligence for multi-camera visual surveillance. Pattern Recognition: Special Issue on Agent-based Computer Vision 37(4), 675–689 (2004)Google Scholar
- 9.Trivedi, M.M., Gandhi, T., Huang, K.: Distributed interactive video arrays for event capture and enhanced situational awareness. In: IEEE Intelligent Systems, Special Issue on Artificial Intelligence for Homeland Security (September 2005)Google Scholar