Activity Recognition Via Classification Constrained Diffusion Maps

  • Yunqian Ma
  • S. B. Damelin
  • O. Masoud
  • N. Papanikolopoulos
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4291)


Applying advanced video technology to understand human activity and intent is becoming increasingly important for video surveillance. In this paper, we perform automatic activity recognition by classification of spatial temporal features from video sequence. We propose to incorporate class labels information to find optimal heating time for dimensionality reduction using diffusion via random walks. We perform experiments on real data, and compare the proposed method with existing random walk diffusion map method and dual root minimal spanning tree diffusion method. Experimental results show that our proposed method is better.


Random Walk Dimensionality Reduction Video Sequence Minimal Span Tree Spectral Cluster 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Shet, V.D., Harwood, D., Davis, L.S.: VidMAP: Video Monitoring of Activity with Prolog. In: IEEE International Conference on Advanced Video and Signal based Surveillance (AVSS), Como, Italy (September 2005)Google Scholar
  2. 2.
    Vu, V., Bremond, F., Thonnat, M.: Video surveillance: human behaviour representation and on-line recognition. In: ideo surveillance: human behaviour representation and on-line recognition, The Sixth International Conference on Knowledge-Based Intelligent Information and Engineering Systems, Podere d’Ombriano, Crema, Italy (September 2002)Google Scholar
  3. 3.
    Ma, Y., Miller, B., Buddharaju, P., Bazakos, M.: Activity Awareness: From Predefined Events to New Pattern Discovery. In: 2006 IEEE International Conference on Computer Vision Systems, January 5-7, 2006, New York, USA (2006)Google Scholar
  4. 4.
    Chellappa, R., Chowdhury, A., Zhou, S.: Recognition of Humans and Their Activities Using Video. Morgan Claypool (2005)Google Scholar
  5. 5.
    Jin, N., Mokhtarian, F.: Human Motion Recognition based on Statistical Shape Analysis. In: Proc. IEEE International Conference on Advanced Video and Signal based Surveillance, pp. 4–9 (2005)Google Scholar
  6. 6.
    Zhong, H., Shi, J., Visontai, M.: Detecting Unusual Activity in Video. In: IEEE Conference on Computer Vision and Pattern Recognition(CVPR) (2004)Google Scholar
  7. 7.
    Porikli, F., Haga, T.: Event detection by Eigenvector Decomposition using object and feature frame. In: CVPR workshop, pp. 114–114 (2004)Google Scholar
  8. 8.
    Belkin, M., Niyogi, P.: Laplacian Eigenmaps for Dimensionality Reduction and Data Representation. Neural Computation 15(6), 1373–1396 (2003)MATHCrossRefGoogle Scholar
  9. 9.
    Coifman, R.R., Lafon, S.: Diffusion Maps. Applied Computational and Harmonic Analysis (submitted to, 2004)Google Scholar
  10. 10.
    Davis, J., Bobick, A.: The Representation and Recognition of Action Using Temporal Templates. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, June 1997, pp. 928–934. Puerto Rico (1997)Google Scholar
  11. 11.
    Grikschat, S., Costa, J., Hero, A., Michel, O.: Dual rooted diffusions for clustering and classification on manifolds. In: 2006 IEEE Intl. Conf. on Acoustics, Speech, and Signal Processing, Toulouse France (2006)Google Scholar
  12. 12.
    Masoud, O., Papanikolopoulos, N.P.: A method for human action recognition. Image and Vision Computing 21(8), 729–743 (2003)CrossRefGoogle Scholar
  13. 13.
    Ng, A., Jordan, M., Weiss, Y.: On spectral clustering:analysis and an algorithm. Neural Information Processing Systems 14 (2001)Google Scholar
  14. 14.
    Ma, Y., Yu, Q., Cohen, I.: Multiple Hypothesis Target Tracking using Merge and Split of Graphs Nodes. In: 2nd International Symposium on Visual Computing, Lake Tahoe, Nevada (November 6-8, 2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Yunqian Ma
    • 1
  • S. B. Damelin
    • 2
  • O. Masoud
    • 3
  • N. Papanikolopoulos
    • 3
  1. 1.Honeywell labs, Honeywell International Inc.MinneapolisUSA
  2. 2.Institute for Mathematics and its ApplicationsUniversity of MinnesotaS.E MinneapolisUSA
  3. 3.Artificial Intelligence, Vision and Robotics Lab, Department of Computer Science and EngineeringUniversity of MinnesotaMinneapolisUSA

Personalised recommendations