Exploring the Dynamics of Visual Events in the Multi-dimensional Semantic Concept Space
We present a system for visualizing event detection in video and revealing the algorithmic and scientific insights. Visual events are viewed as evolving temporal patterns in the semantic concept space. For video clips of different events, we present their corresponding traces in the semantic concept space as the event evolves. The presentation of the event in the concept space is scored by pre-trained models of the dynamics of each concept in the context of the event, which provides a measure of how well the given event matches the evolution pattern of the target event in the multi-dimensional concept space. Scores obtained for different videos is shown to project them into different parts of the final score space. This presentation walks the user through the entire process of concept-centered event recognition for events such as exiting car, riot, and airplane flying.
Unable to display preview. Download preview PDF.
- 1.Ebadollahi, S., Xie, L., Chang, S.-F., Smith, J.R.: Visual event detection using multi-dimensional concept dynamics. In: ICME 2006: Proceedings of the IEEE international conference on Multimedia and Exp (to be presented, 2006)Google Scholar
- 2.Naphade, M.R., Kennedy, L., Kender, J., Chang, S.F., Smith, J.R., Over, P., Hauptmann, A.: A light scale concept ontology for multimedia understanding for trecvid 2005. Technical report, IBM Research Technical Report (2005)Google Scholar