Gesture recognition of the upper limbs — From signal to symbol

  • Martin Fröhlich
  • Ipke Wachsmuth
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1371)


To recognise gestures performed by people without disabilities during verbal communication —so-called coverbal gestures —a flexible system with task-oriented design is proposed. The issue of flexibility is addressed via different kinds of modules —grasped as agents —, which are grouped in different levels. They can be easily reconfigured or rewritten to suit another application. This system of layered agents uses an abstract body-model to transform the up-taken data from the sixdegree-of-freedom-sensors, and the data gloves, to a first-level symbolic description of gesture features. In a first integration step the first-level symbols are integrated to second-level symbols describing a whole gesture. Second-level symbolic gesture descriptions are the entities which can be integrated with speech tokens to form multi-modal utterances.


Gesture Recognition User Datagram Protocol Sensor Space Virtual Reality Application Data Glove 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Douglas E. Comer and David L. Stevens. Internetworking with TCP/IP: Client-Server Programming and Applications; BSD socket version, volume III. Prentice-Hall International., Englewood Cliffs, NJ, 1993.Google Scholar
  2. 2.
    Renato Contini. Body segment parameters, part ii. Artificial Limbs, 16(1):1–19, Spring 1972.Google Scholar
  3. 3.
    James L. Crowley and JoËlle Coutaz. Vision for man machine interaction. In Proceedings of Engineering Human Computer Interaction (EHCI’95 Grand Targhee, August 1995), pages 28–45, Chapman and Hall, London, August 1995.Google Scholar
  4. 4.
    H. Cruse and U. Steinkühler. Solutions of the direct and inverse kinematic problems by a common algorithm based on the mean of multiple computations. Biological Cybernetics, 69:345–351, 1993.CrossRefGoogle Scholar
  5. 5.
    J. Denavit and R. S. Hartenberg. A kinematic notation for lower-pair mechanisms based on matrices. ASME Journal of Applied Mechanics, 77:215–221, 1955.MathSciNetGoogle Scholar
  6. 6.
    Philip A. Harling and Alistair D. N. Edwards. Hand tension as a gesture segmentation cue. In Philip A. Harling and Alistair D. N. Edwards, editors, Progress in Gestural Interaction: Proceedings of Gesture Workshop ’96, pages 75–87, Springer, Berlin et al., 1997.Google Scholar
  7. 7.
    Hyeongseok Ko. Kinematic and Dynamic Techniques for Analysing, Predicting, and Animating Human Locomotion. PhD thesis, University of Pennsylvania, 1994. 8. Marc Erich Latoschik and Ipke Wachsmuth. Exploiting distant pointing gestures for object selection in a virtual environment. same volume.Google Scholar
  8. 9.
    Jardan Lenarčič and Andreja Umek. Simple model of human arm reachable workspace. IEEE Transactions on Systems, Man, and Cybernetics, 24(8):1239–1246, August 1994.CrossRefGoogle Scholar
  9. 10.
    Marvin Lee Minsky. The Society of Mind. Simon and Schuster, New York, NY, 1985.Google Scholar
  10. 11.
    NASA: U.S. National Aeronautics and Space Administration, Lyndon B. Johnson Space Center, Houston, TX Man-System Integration Standards (MSIS): NASA-STD-3000 I-III Revision B, August 1994.Google Scholar
  11. 12.
    Richard P. Paul. Robot Manipulators. MIT Press, Cambridge, MA, 1981.Google Scholar
  12. 13.
    Ernst Pöppel. A hierarchical model of temporal perception. Trends in Cognitive Sciences, 1(2):56–61, May 1997.CrossRefGoogle Scholar
  13. 14.
    Siegmund Prillwitz, Regina Leven, Heiko Zienert, Thomas Hamke, and Jan Henning. HamNoSys Version 2.0: Hamburg Notation System for Sign Languages: An Introductory Guide, volume 5 of International Studies on Sign Language and Communication of the Deaf. Signum Press, Hamburg, 1989.Google Scholar
  14. 15.
    Ulrich Steinkühler. MMC-Modelle zur Lösung kinematischer Aufgabenstellungen eines redundanten Manipulators. Dissertation, Universität Bielefeld, Fakultät für Mathematik, 1994.Google Scholar
  15. 16.
    W. Richard Stevens. The Protocols, volume 1 of TCP/IP Illustrated. Addison-Wesley, Reading, MA, 1994.Google Scholar
  16. 17.
    Tsuneo Yoshikawa. Foundations of Robotics: analysis and control. MIT Press, Cambridge, MA, 1990.Google Scholar

Copyright information

© Springer-Verlag 1998

Authors and Affiliations

  • Martin Fröhlich
    • 1
  • Ipke Wachsmuth
    • 1
  1. 1.Technische FakultätUniversität BielefeldBielefeldGermany

Personalised recommendations