An appearance-based approach to gesture-recognition

  • Jérôme Martin
  • James L. Crowley
Session 10: Recognition & Reconstruction
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1311)


This paper describes techniques for the design of a system able to interact with the user by visual recognition of hand gestures. The system is composed of three modules including tracking, posture classification and gesture recognition. A description of each module is given. In order to increase the robustness and the precision of the tracking, several complementary tracking processes are coupled. A classification process is presented for recognizing hand posture using distance in an eigenspace. The classification of hand posture leads to the gesture recognition by a set of finite state machines.


Finite State Machine Hand Posture Gesture Recognition Hand Gesture Hand Gesture Recognition 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    T. Baudel and M. Beaudouin-Lafon. Charade: Remote control of objects using free-hand gestures. Communication of the ACM, 36(7):29–35, July 1993.CrossRefGoogle Scholar
  2. 2.
    T. Baudel and A. Braffort. Reconnaissance de gestes de la main en environnement réel. In Actes de “Informatique'93”, Interface des modees réels et virtuels, pages 207–216, Montpellier, 1993.Google Scholar
  3. 3.
    F. Bérard. Vision par ordinateur pour la réalité augmentée: Application au bureau numérique. Master's thesis, Université Joseph Fourier-INP Grenoble, June 1994.Google Scholar
  4. 4.
    A. Braffort. Reconnaissance et Compréhension de gestes, application à la langue des signes. PhD thesis, Université Paris-XI Orsay, Juin 1996.Google Scholar
  5. 5.
    T.F. Cootes, C.J. Taylor, D.H. Cooper, and J. Graham. Training models of shape from sets of examples. In David Hogg and Roger Boyle, editors, British Machine Vision Conference, pages 9–18. Springer-Verlag, 1992.Google Scholar
  6. 6.
    J. Coutaz, F. Berard, and J.L. Crowley. Coordination of perceptual process for computer mediated communication. In Second International Conference on Automatic Face-and Gesture-Recognition, Killington, Vermont, USA, October 1996.Google Scholar
  7. 7.
    J.L. Crowley and J.M. Bedrune. Integration and control of reactive visual processes. In European Conference on Computer Vision, (ECCV'94), Stockholm, May 1994.Google Scholar
  8. 8.
    P. Dauchy, C. Mignot, and C. Valot. Joint speech and gesture analysis — some experimental results on multimodal interface. Technical Report CRIN 93-R-121, Centre de Recherche en Informatique de Nancy, September 1993.Google Scholar
  9. 9.
    B. Dorner. Hand shape identification and tracking for sign language interpretation. In 'Looking At People’: Recognition and Interpretation of Human Action, 13th International Joint Conference on Artificial Intelligence, Chambery, France, 1993.Google Scholar
  10. 10.
    J.D. Foley. Interfaces for advanced computing. Scientific American, pages 83–90, October 1987.Google Scholar
  11. 11.
    M.W. Krueger. Artificial Reality II. Addison-Wesley, 1991.Google Scholar
  12. 12.
    J. Martin. Interprétation de gestes par modèle de distribution de points. Master's thesis, Magistère Université Joseph Fourier, September 1995.Google Scholar
  13. 13.
    I. Martin. Suivi et intérpretation de geste: Application de la vision par ordinateur à l'interaction homme-machine. Master's thesis, DEA Université Joseph Fourier-Institut National Polytechnique de Grenoble, 1995.Google Scholar
  14. 14.
    J. Martin and J. L. Crowley. Comparison of correlation techniques. In U. Rembold et al., editor, Intelligent Autonomous Systems — IAS-4, pages 86–93, Karlsruhe, Germany, March 27–30 1995.Google Scholar
  15. 15.
    J.M. Rehg and T. Kanade. Digiteyes:vision-based human hand tracking. Technical Report CMU-CS-93-220, Carnegi Mellon University, 1993.Google Scholar
  16. 16.
    B. Schiele and A. Waibel. Estimation of the head orientation based on a face-color-intensifier. In 3rd International Symposium on Intelligent Robotic Systems '95, 10–14 July 1995.Google Scholar
  17. 17.
    N. Shimada, Y. Shirai, and Y. Kuno. Hand gestures recognition using computer vision based on model mathcing method. In Symbiosis of Human and Artifact, 1995.Google Scholar
  18. 18.
    I. Sirovich and M. Kirby. Low-dimensional procedure for the caracterization of human faces. Journal of Optical Society of America A, 4(3):519–524, March 1987.Google Scholar
  19. 19.
    T. Takahashi and F. Kishino. Hand gesture coding on experiments using a hand gesture interface device. SIGCHI Bulletin, 23(2):67–73, April 1991.Google Scholar
  20. 20.
    M. Turk and A. Pentland. Eigenfaces for recognition. Journal of Neuroscience, 3(1):71–86, 1991.Google Scholar
  21. 21.
    P. Wellner. The digitaldesk calculator: Tactile manipulation on a desktop. In ACM Symposium, on User Interface Software and Terchnology, pages 27–33, November 1991.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1997

Authors and Affiliations

  • Jérôme Martin
    • 1
  • James L. Crowley
    • 1
  1. 1.GRAVIR - IMAGGrenobleFrance

Personalised recommendations