Detection and Classification of Human Movements in Video Scenes

  • A. G. Hochuli
  • L. E. S. Oliveira
  • A. S. BrittoJr.
  • A. L. Koerich
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4872)


A novel approach for the detection and classification of human movements in videos scenes is presented in this paper. It consists in detecting, segmenting and tracking foreground objects in video scenes to further classify their movements as conventional or non-conventional. From each tracked object in the scene, features such as position, speed, changes in direction and temporal consistency of the bounding box dimension are extracted. These features make up feature vectors that are stored together with labels that categorize the movement and which are assigned by human supervisors. At the classification step, an instance-based learning algorithm is used to classify the object movement as conventional or non-conventional. For this aim, feature vectors computed from objects in motion are matched against reference feature vectors previously labeled. Experimental results on video clips from two different databases (Parking Lot and CAVIAR) have shown that the proposed approach is able to detect non-conventional human movements in video scenes with accuracies between 77% and 82%.


Human Movement Classification Computer Vision Security 


  1. 1.
    Hara, K., Omori, T., Ueno, R.: Detection of unusual human behavior in intelligent house. In: IEEE Workshop on Neural Networks for Signal Processing, Martigny, pp. 697–706. IEEE Computer Society Press, Los Alamitos (2002)CrossRefGoogle Scholar
  2. 2.
    Lühr, S., Bui, H.H., Venkatesh, S., West, G.A.W.: Recognition of human activity through hierarchical stochastic learning. In: IEEE Annual Conf on Pervasive Computing and Communications, Fort Worth, pp. 416–421. IEEE Computer Society Press, Los Alamitos (2003)Google Scholar
  3. 3.
    Brand, M., Kettnaker, V.: Discovery and segmentation of activities in video. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 844–851 (2000)CrossRefGoogle Scholar
  4. 4.
    Aggarwal, J.K., Cai, Q.: Human motion analysis: A review. Computer Vision and Image Understanding 73(3), 428–440 (1999)CrossRefGoogle Scholar
  5. 5.
    Mecocci, A., Pannozzo, M., Fumarola, A.: Automatic detection of anomalous behavioral events for advanced real-time video surveillance. In: IEEE Intl Symp on Computational Intelligence for Measurement Systems and Applications, pp. 187–192. IEEE Computer Society Press, Los Alamitos (2003)Google Scholar
  6. 6.
    Niu, W., Long, J., Han, D., Wang, Y.F.: Human activity detection and recognition for video surveillance. In: IEEE Intl Conf Multimedia and Expo, pp. 719–722. IEEE Computer Society Press, Los Alamitos (2004)Google Scholar
  7. 7.
    Cucchiara, R., Grana, C., Prati, A., Vezzani, R.: Probabilistic posture classification for human-behavior analysis. IEEE Trans. on Systems, Man, and Cybernetics, Part A 35(1), 42–54 (2005)CrossRefGoogle Scholar
  8. 8.
    Hu, W., Tan, T., Wang, L., Maybank, S.J.: A survey on visual surveillance of object motion and behaviors. IEEE Trans. Systems, Man, Cybernetics, Part C 34(3), 334–352 (2004)CrossRefGoogle Scholar
  9. 9.
    Stauffer, C., Grimson, W.E.L.: Learning patterns of activity using real-time tracking. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 747–757 (2000)CrossRefGoogle Scholar
  10. 10.
    Lei, B., Xu, L.Q.: From pixels to objects and trajectories: A generic real-time outdoor video surveillance system. In: IEE Intl Symp Imaging for Crime Detection and Prevention, London, UK, pp. 117–122 (2005)Google Scholar
  11. 11.
    Latecki, L.J., Miezianko, R.: Object tracking with dynamic template update and occlusion detection. In: 18th Intl Conf on Pattern Recognition, Washington, USA, pp. 556–560 (2006)Google Scholar
  12. 12.
    Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: 7th Intl Joint Conf Artificial Intelligence, Vancouver, Canada, pp. 674–679 (1981)Google Scholar
  13. 13.
    Aha, D.W., Kibler, D., Albert, M.K.: Instance-based learning algorithms. Machine Learning 6(1), 37–66 (1991)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • A. G. Hochuli
    • 1
  • L. E. S. Oliveira
    • 1
  • A. S. BrittoJr.
    • 1
  • A. L. Koerich
    • 1
  1. 1.Postgraduate Program in Computer Science (PPGIa), Pontifical Catholic University of Parana (PUCPR), R. Imaculada Conceição, 1155 Prado Velho, 80215-901, Curitiba, PRBrazil

Personalised recommendations