Exploring the Dynamics of Visual Events in the Multi-dimensional Semantic Concept Space

  • Shahram Ebadollahi
  • Lexing Xie
  • Andres Abreu
  • Mark Podlaseck
  • Shih-Fu Chang
  • John R. Smith
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4071)

Abstract

We present a system for visualizing event detection in video and revealing the algorithmic and scientific insights. Visual events are viewed as evolving temporal patterns in the semantic concept space. For video clips of different events, we present their corresponding traces in the semantic concept space as the event evolves. The presentation of the event in the concept space is scored by pre-trained models of the dynamics of each concept in the context of the event, which provides a measure of how well the given event matches the evolution pattern of the target event in the multi-dimensional concept space. Scores obtained for different videos is shown to project them into different parts of the final score space. This presentation walks the user through the entire process of concept-centered event recognition for events such as exiting car, riot, and airplane flying.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Ebadollahi, S., Xie, L., Chang, S.-F., Smith, J.R.: Visual event detection using multi-dimensional concept dynamics. In: ICME 2006: Proceedings of the IEEE international conference on Multimedia and Exp (to be presented, 2006)Google Scholar
  2. 2.
    Naphade, M.R., Kennedy, L., Kender, J., Chang, S.F., Smith, J.R., Over, P., Hauptmann, A.: A light scale concept ontology for multimedia understanding for trecvid 2005. Technical report, IBM Research Technical Report (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Shahram Ebadollahi
    • 1
  • Lexing Xie
    • 1
  • Andres Abreu
    • 1
  • Mark Podlaseck
    • 1
  • Shih-Fu Chang
    • 2
  • John R. Smith
    • 1
  1. 1.IBM T.J. Watson Research CenterHawthorneUSA
  2. 2.Department of Electrical EngineeringColumbia UniversityNew YorkUSA

Personalised recommendations