Estimation of 2D Motion Trajectories from Video Object Planes and Its Application in Hand Gesture Recognition

  • M. K. Bhuyan
  • D. Ghosh
  • P. K. Bora
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3776)


Hand gesture recognition from visual images finds applications in areas like human computer interaction, machine vision, virtual reality and so on. Vision-based hand gesture recognition involves visual analysis of hand shape, position and/or movement. In this paper, we present a model-based method for tracking hand motion in a complex scene, thereby estimating the hand motion trajectory. In our proposed technique, we first segment the frames into video object planes (VOPs) with the hand as the video object. This is followed by hand tracking using Hausdorff tracker. In the next step, the centroids of all VOPs are calculated using moments as well as motion information. Finally, the hand trajectory is estimated by joining the VOP centroids. In our experiment, the proposed trajectory estimation algorithm gives about 99% accuracy in finding the actual trajectory.


Motion Vector Hand Gesture Video Object Hand Gesture Recognition Hand Trajectory 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Pavlovic, V.I., Sharma, R., Huang, T.S.: Visual interpretation of hand gestures for human-computer interaction: A review. IEEE Trans. Pattern Analysis and Machine Intelligence 19(7), 677–695 (1997)CrossRefGoogle Scholar
  2. 2.
    Wu, Y., Huang, T.S.: Self-supervised learning for visual tracking and recognition of human hand. In: Proc. American Association for Artificial Intelligence (AAAI), pp. 243–248 (2000)Google Scholar
  3. 3.
    Bhuyan, M.K., Ghosh, D., Bora, P.K.: Automatic video object plane generation for recognition of hand gestures. In: Proc. International Conf. Systemics, Cybernetics and Informatics (ICSCI), pp. 147–152 (2005)Google Scholar
  4. 4.
    Huttenlocher, D.P., Noh, J.J., Rucklidge, W.J.: Tracking non-rigid objects in complex scene. In: 4th International Conf. Computer Vision, pp. 93–101 (1993)Google Scholar
  5. 5.
    Huttenlocher, D.P., Klanderman, G.A., Rucklidge, W.J.: Comparing images using the Hausdorff distance. IEEE Trans. Pattern Analysis and Machine Intelligence 15(9), 850–863 (1993)CrossRefGoogle Scholar
  6. 6.
    Borgefors, G.: Distance transformations in digital images. Computer Vision, Graphics and Image Processing 34, 344–371 (1986)CrossRefGoogle Scholar
  7. 7.
    Bhuyan, M.K., Ghosh, D., Bora, P.K.: Finite state representation of hand gestures using key video object plane. In: Proc. IEEE Region 10 - Asia-Pacific Conf (TENCON), pp. 21–24 (2004)Google Scholar
  8. 8.
    Bhuyan, M.K., Ghosh, D., Bora, P.K.: Key video object plane selection by MPEG-7 visual shape descriptor for summarization and recognition of hand gestures. In: Proc. 4th Indian Conf. Computer Vision, Graphics and Image Processing (ICVGIP), pp. 638–643 (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • M. K. Bhuyan
    • 1
  • D. Ghosh
    • 1
  • P. K. Bora
    • 1
  1. 1.Department of Electronics and Communication EngineeringIndian Institute of TechnologyGuwahatiIndia

Personalised recommendations