Estimation of 2D Motion Trajectories from Video Object Planes and Its Application in Hand Gesture Recognition
Hand gesture recognition from visual images finds applications in areas like human computer interaction, machine vision, virtual reality and so on. Vision-based hand gesture recognition involves visual analysis of hand shape, position and/or movement. In this paper, we present a model-based method for tracking hand motion in a complex scene, thereby estimating the hand motion trajectory. In our proposed technique, we first segment the frames into video object planes (VOPs) with the hand as the video object. This is followed by hand tracking using Hausdorff tracker. In the next step, the centroids of all VOPs are calculated using moments as well as motion information. Finally, the hand trajectory is estimated by joining the VOP centroids. In our experiment, the proposed trajectory estimation algorithm gives about 99% accuracy in finding the actual trajectory.
KeywordsMotion Vector Hand Gesture Video Object Hand Gesture Recognition Hand Trajectory
- 2.Wu, Y., Huang, T.S.: Self-supervised learning for visual tracking and recognition of human hand. In: Proc. American Association for Artificial Intelligence (AAAI), pp. 243–248 (2000)Google Scholar
- 3.Bhuyan, M.K., Ghosh, D., Bora, P.K.: Automatic video object plane generation for recognition of hand gestures. In: Proc. International Conf. Systemics, Cybernetics and Informatics (ICSCI), pp. 147–152 (2005)Google Scholar
- 4.Huttenlocher, D.P., Noh, J.J., Rucklidge, W.J.: Tracking non-rigid objects in complex scene. In: 4th International Conf. Computer Vision, pp. 93–101 (1993)Google Scholar
- 7.Bhuyan, M.K., Ghosh, D., Bora, P.K.: Finite state representation of hand gestures using key video object plane. In: Proc. IEEE Region 10 - Asia-Pacific Conf (TENCON), pp. 21–24 (2004)Google Scholar
- 8.Bhuyan, M.K., Ghosh, D., Bora, P.K.: Key video object plane selection by MPEG-7 visual shape descriptor for summarization and recognition of hand gestures. In: Proc. 4th Indian Conf. Computer Vision, Graphics and Image Processing (ICVGIP), pp. 638–643 (2004)Google Scholar