Dynamic Events as Mixtures of Spatial and Temporal Features

  • Karteek Alahari
  • C. V. Jawahar
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4338)


Dynamic events comprise of spatiotemporal atomic units. In this paper we model them using a mixture model. Events are represented using a framework based on the Mixture of Factor Analyzers (MFA) model. It is to be noted that our framework is generic and is applicable for any mixture modelling scheme. The MFA, used to demonstrate the novelty of our approach, clusters events into spatially coherent mixtures in a low dimensional space. Based the observations that, (i) events comprise of varying degrees of spatial and temporal characteristics, and (ii) the number of mixtures determines the composition of these features, a method that incorporates models with varying number of mixtures is proposed. For a given event, the relative importance of each model component is estimated, thereby choosing the appropriate feature composition. The capabilities of the proposed framework are demonstrated with an application: recognition of events such as hand gestures, activities.


Mixture Model Video Sequence Temporal Feature Hand Gesture Expectation Maximization Algorithm 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bobick, A.F., Davis, J.W.: The recognition of human movement using temporal templates. IEEE Trans. on PAMI 23, 257–267 (2001)Google Scholar
  2. 2.
    Gavrila, D.M.: The visual analysis of human movement: A survey. Computer Vision and Image Understanding 73, 82–98 (1999)MATHCrossRefGoogle Scholar
  3. 3.
    Greenspan, H., Goldberger, J., Mayer, A.: A probabilistic framework for spatio-temporal video representation and indexing. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 461–475. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  4. 4.
    Veeraraghavan, A., Chellappa, R., Roy-Chowdhury, A.: The Function Space of an Activity. In: CVPR, vol. 1, pp. 959–968 (2006)Google Scholar
  5. 5.
    Wong, S.F., Cipolla, R.: Real-time Interpretation of Hand Motions using a Sparse Bayesian Classifier on Motion Gradient Orientation Images. In: BMVC, vol. 1, pp. 379–388 (2005)Google Scholar
  6. 6.
    Sheikh, Y., Sheikh, M., Shah, M.: Exploring the Space of a Human Action. In: ICCV, vol. 1, pp. 144–149 (2005)Google Scholar
  7. 7.
    Yacoob, Y., Black, M.J.: Parameterized Modeling and Recognition of Activities. CVIU 73, 232–247 (1999)Google Scholar
  8. 8.
    Yilmaz, A., Shah, M.: Actions Sketch: A Novel Action Representation. In: CVPR, vol. 1, pp. 984–989 (2005)Google Scholar
  9. 9.
    Sun, X., Chen, C.C., Manjunath, B.S.: Probabilistic Motion Parameter Models for Human Activity Recognition. In: ICPR, vol. 1, pp. 443–446 (2002)Google Scholar
  10. 10.
    Brand, M., Kettnaker, V.: Discovery and Segmentation of Activities in Video. IEEE Trans. on PAMI 22, 844–851 (2000)Google Scholar
  11. 11.
    Ghahramani, Z., Hinton, G.E.: The EM Algorithm for Mixtures of Factor Analyzers. Technical Report CRG-TR-96-1, University of Toronto, Canada (1996)Google Scholar
  12. 12.
    Robertson, N., Reid, I.: Behaviour understanding in video: a combined method. In: ICCV, vol. 1, pp. 808–815 (2005)Google Scholar
  13. 13.
    Zelnik-Manor, L., Irani, M.: Event-Based Analysis of Video. In: CVPR, vol. II, pp. 123–130 (2001)Google Scholar
  14. 14.
    Gross, R., Shi, J.: The CMU Motion of Body MoBo Database. Technical Report CMU-RI-TR-01-18, Robotics Institute, CMU, Pittsburgh, PA (2001)Google Scholar
  15. 15.
  16. 16.
    Veeraraghavan, A., Roy-Chowdhury, A., Chellappa, R.: Role of shape and kinematics in human movement analysis. In: CVPR, vol. 1, pp. 730–737 (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Karteek Alahari
    • 1
  • C. V. Jawahar
    • 1
  1. 1.Centre for Visual Information TechnologyInternational Institute of Information TechnologyHyderabadIndia

Personalised recommendations