Head Gesture Recognition Using Feature Interpolation

  • Yeon Gu Kang
  • Phill Kyu Rhee
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4251)


This paper addresses a technique of recognizing a head gesture. The proposed system is composed of eye tracking and head motion decision. The eye tracking step is divided into face detection, eye location and eye feature interpolation. Face detection obtains the face region using integrated feature space. Multiple Bayesian classifiers are employed for selection of face candidate windows on integrated feature space. Eye location extracts the location of eyes from the detected face region. Eye location is performed at the region close to a pair of eyes for real-time eye tracking. If a pair of eyes is not located, the system can estimate feature vector using mean velocity measure(MVM). After eye tracking, the coordinates of the detected eyes are transformed into the normalized vector of the x-coordinate and the y-coordinate. Head gesture recognition using HMMs. Head gesture can be recognized by HMMs those are adapted by a directional vector. The directional vector represents the direction of head movement. The HMMs vector can also be used to determine neutral as well as positive and negative gesture. The experimental results are reported. These techniques are implemented on a lot of images and a notable success is notified.


Face Detection Feature Extraction Method Vector Code Sinusoid Pattern Head Gesture 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ekman, P., Huang, T., Sejnowski, T., Hager, J.: Final Report to NSF of the planning Workshop on Facial Expression Understanding, Technical report, National Science Foundation, Human Interaction Lab, UCSF, CA 94143 (1993)Google Scholar
  2. 2.
    Morimoto, C., et al.: Recognition of head gestures using hidden markov models. In: Proc. of IEEE Int. Conf. on Pattern Recognition (1996)Google Scholar
  3. 3.
    Davis, J., et al.: A perceptual user interface for recognizing head gesture acknowledgements. In: WS on Perceptive User Interfaces (PUI 2001) (2001)Google Scholar
  4. 4.
    Cascia, M.L., Isidoro, J., Sclaroff, S.: Head Tracking via Robust Registration in Texture Map Images. In: IEEE Computer Sociey Conference on Computer Vision and Pattern Recognition, Santa Barbara, California, June 1998, pp. 508–514 (1998)Google Scholar
  5. 5.
    Tang, J., Nakatsu, R.: A Head Gesture Recognition Algorithm. In: Tan, T., Shi, Y., Gao, W. (eds.) ICMI 2000. LNCS, vol. 1948, pp. 72–80. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  6. 6.
    Kapoor, A., Picard, R.W.: A Real-Time Head Nod and Shake Detector. In: Proceedings from the Workshop on Perceptive User Interfaces (November 2001)Google Scholar
  7. 7.
    Tan, W., Rong, G.: A real-time head nod and shake detector using HMMs. Expert Systems with Applications 25, 461–466 (2003)CrossRefGoogle Scholar
  8. 8.
    Nam, M.Y., Rhee, P.K.: An Efficient Face Location using Integrated Feature Space. In: Khosla, R., Howlett, R.J., Jain, L.C. (eds.) KES 2005. LNCS (LNAI), vol. 3681, pp. 327–335. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  9. 9.
    Pitas, I.: Digital image processing algorithms. Prentice-Hall, Englewood Cliffs (1993)Google Scholar
  10. 10.
    Lumina, R.L., Shapiro, G., Zuniga, O.: A New Connected Components Algorithm for Virtual Memory Computers. Computer Vision, Graphics, and Image Processing 22, 287–300 (1983)CrossRefGoogle Scholar
  11. 11.
    Baum, L., Petrie, T., G, S., Weiss, N.: A maximization techniques occurring in the statistical analysis of probabilistic functions of Markov chains. Ann. Math. Stat. 41(1), 164–171 (1970)MATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Yeon Gu Kang
    • 1
  • Phill Kyu Rhee
    • 1
  1. 1.Dept. of Computer Science & Engineering Inha UniversityIncheonSouth Korea

Personalised recommendations