Video Analysis of Vehicles and Persons for Surveillance

  • Sangho Park
  • Mohan M. Trivedi
Part of the Studies in Computational Intelligence book series (SCI, volume 135)


This chapter presents a multi-perspective vision-based analysis of the activities of vehicles and persons for the enhancement of situational awareness in surveillance. Multiple perspectives provide a useful invariant feature of the object in the image, i.e., the footage area on the ground. Moving objects are detected in the image domain, and the tracking results of the objects are represented in the projection domain using planar homography. Spatio-temporal relationships between human and vehicle tracks are categorized as safe or unsafe situation depending on the site context such as walkway and driveway locations. Semantic-level information of the situation is achieved with the anticipation of possible directions of near-future tracks using piecewise velocity history. Crowd density is estimated from the footage on the homography plane. Experimental data show promising results. Our framework can be applied to broad range of situational awareness for emergency response, disaster prevention, human interactions in structured environments, and crowd movement analysis in a wide field of view.


Projection Plane Situational Awareness Video Surveillance Video Analysis Intelligent Transportation System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aggarwal, J.K., Cai, Q.: Human motion analysis: a review. Computer Vision and Image Understanding 73(3), 295–304 (1999)CrossRefGoogle Scholar
  2. 2.
    Antonini, G., Bierlaire, M.: Capturing interactions in pedestrian walking behavior in a discrete choice framework. Transportation Research Part B (2005)Google Scholar
  3. 3.
    Bar-Shalom, Y., Blair, W.: Multitarget-multisensor tracking: applications and advances, Norwood, MA, vol. 3, pp. 199–231 (2000)Google Scholar
  4. 4.
    Coifman, B.: A new algorithm for vehicle reidentification and travel time measurement on freeways. ASCE Applilcations of Advanced Technology in Transportation (1998)Google Scholar
  5. 5.
    Criminisi, A., Reid, I., Zisserman, A.: A plane measuring device. Image and Vision Computing 17(8), 625–634 (1999)CrossRefGoogle Scholar
  6. 6.
    Gavrila, D.: The visual analysis of human movement: a survey. Computer Vision and Image Understanding 73(1), 82–98 (1999)zbMATHCrossRefGoogle Scholar
  7. 7.
    Gupte, S., Masoud, O., Martin, R.F.K., Papanikolopoulos, N.P.: Detection and classification of vehicles. IEEE Trans. Intell. Transport. Syst. 3(1), 37–47 (2002)CrossRefGoogle Scholar
  8. 8.
    Haritaoglu, I., Harwood, D., Davis, L.S.: W4: Real-time surveillance of people and their activities. IEEE transactions on Pattern Analysis and Machine Intelligence 22(8), 797–808 (2000)CrossRefGoogle Scholar
  9. 9.
    Lipton, A.J., Fujiyoshi, H., Patil, R.S.: Moving target classification and tracking from real-time video. In: Proceedings of the Fourth IEEE Workshop on Applications of Computer Vision, Princeton, New Jersey, pp. 8–14 (1998)Google Scholar
  10. 10.
    Makris, D., Ellis, T., Black, J.: Learning scene semantics. In: ECOVISION 2004 Early Cognitive Vision Workshop, Isle of Skye, Scotland, UK (2004)Google Scholar
  11. 11.
    McKenna, S.J., Jabri, S., Duric, Z., Wechsler, H.: Tracking interacting people. In: Proceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2000), pp. 348–353 (2000)Google Scholar
  12. 12.
    Moeslund, T.B., Granum, E.: A Survey of Computer Vision-Based Human Motion Capture. Computer Vision and Image Understanding 81(3), 231–268 (2001)zbMATHCrossRefGoogle Scholar
  13. 13.
    Morris, B., Trivedi, M.M.: Improved Vehicle Classification in Long Traffic Video by Cooperating Tracker and Classifier Modules. In: IEEE Conference on Advanced Video and Signal based Surveillance (2006)Google Scholar
  14. 14.
    Oliver, N.M., Rosario, B., Pentland, A.P.: A Bayesian Computer Vision System for Modeling Human Interactions. IEEE Trans. Pattern Analysis and Machine Intelligence 22(8), 831–843 (2000)CrossRefGoogle Scholar
  15. 15.
    Park, S., Trivedi, M.M.: A track-based human movement analysis and privacy protection system adaptive to environmental contexts. In: IEEE International Conference on Advanced Video and Signal based Surveillance, Como, Italy (2005)Google Scholar
  16. 16.
    Park, S., Trivedi, M.M.: Analysis and Query of Person-Vehicle Interactions in Homography Domain. In: IEEE Conference on Video Surveillance and Sensor Networks, Santa Barbara, USA (2006)Google Scholar
  17. 17.
    Park, S., Trivedi, M.M.: Multi-person Interaction and Activity Analysis: A Synergistic Track- and Body- Level Analysis Framework. Machine Vision and Applications (to appear, 2007)Google Scholar
  18. 18.
    Ploetner, J., Trivedi, M.M.: A Multimodal Approach for Dynamic Event Capture of Vehicles and Pedestrians. In: Proceedings of the 4th ACM International Workshop on Video Surveillance and Sensor Networks, pp. 203–209 (2006)Google Scholar
  19. 19.
    Remagnino, P., Shihab, A.I., Jones, G.A.: Distributed intelligence for multicamera visual surveillance. Pattern Recognition: Special Issue on Agent-based Computer Vision 37(4), 675–689 (2004)Google Scholar
  20. 20.
    Trivedi, M.M., Gandhi, T., Huang, K.: Distributed interactive video arrays for event capture and enhanced situational awareness. In: IEEE Intelligent Systems, Special Issue on Artificial Intelligence for Homeland Security (2005)Google Scholar
  21. 21.
    Valera, M., Velastin, S.A.: Intelligent distributed surveillance systems: a review. IEEE Proceedings Vision, Image and Signal Processing 152(2), 192–204 (2005)CrossRefGoogle Scholar
  22. 22.
    Velastin, S.A., Boghossian, B.A., Lo, B., Sun, J., Vicencio-Silva, M.A.: Prismatica: Toward ambient intelligence in public transport environments. IEEE Transactions on Systems, Man, and Cybernetics -Part A 35(1), 182–214 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Sangho Park
    • 1
  • Mohan M. Trivedi
    • 1
  1. 1.Computer Vision and Robotics Research LaboratoryUniversity of California at San DiegoUSA

Personalised recommendations