Real Time Hand Tracking as a User Input Device

  • Kittasil Silanon
  • Nikom Suvonvorn
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6746)


In this paper, we propose a system that facilitates the two dimension user-input as general mouse device for controlling applications. The method is based on hand movement analysis by applying image processing technique. The Haar-like with a cascade of boost classifiers is applied for hand detection, and then tracked with skin color using CamShift. Extracted hand features are computed and used for recognizing commands via a finite state machine. We evaluated the performance of system under real time constraint in real environment with demonstration application.


Hand detection Hand Tracking Command Recognition 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Du, W., Li, H.: Vision based gesture recognition system with single camera. In: 5th International Conference on ICSP, vol. 2, pp. 1351–1357 (2000)Google Scholar
  2. 2.
    Jojic, N., Brumitt, B., Meyers, B., Harris, S., Huang, T.: Detection and estimation of pointing gestures in dense disparity maps. In: Fourth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 468–475Google Scholar
  3. 3.
    Wachs, J., Stern, H., Edan, Y., Gillam, M., Feied, C., Smith, M., Handler, J.: A Real-Time Hand Gesture System Based on Evolutionary Search. Vision 22(3) (October 2006)Google Scholar
  4. 4.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the IEEE CVPR, vol. 1, pp. I-511– I-518 (2001)Google Scholar
  5. 5.
    Lienhart, R., Maydt, J.: An extended set of Haar-like features for rapid object detection. In: International Conference on Image Processing, vol. 1, pp. I-900–I-903 (2002)Google Scholar
  6. 6.
    Bradski, G.R.: Computer vision face tracking for use in a perceptual user interface. Intel Technology Journal Q2 (1998)Google Scholar
  7. 7.
    Welch, G., Bishop, G.: An Introduction to the Kalman Filter. In: Annual Conference on Computer Graphics & Interactive Techniques, August 12-17, ACM Press, Addison-Wesley, Los Angeles, CA (2001); SIGGRAPH 2001 course pack editionGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Kittasil Silanon
    • 1
  • Nikom Suvonvorn
    • 1
  1. 1.Department of Computer Engineering Faculty of EngineeringPrince of Songkla UniversityHat YaiThailand

Personalised recommendations