LIPPS – A Virtual Teacher for Speechreading Based on a Dialog-Controlled Talking-Head

  • Hermann Gebert
  • Hans-Heinrich Bothe
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6179)


People with decreasing hearing ability are more dependent on alternative personal communication channels. To read the visible articulator movements of the conversation partner is one possible solution for understanding verbal statements. After giving an introduction to the principals of speech, visual speech & speechreading, we demonstrate the conception and implementation of a language laboratory for speechreading that is meant as an effective audio-visual complement and extension of classroom teaching. Further we show results of evaluation experiments and explain the functionality and interaction of the modules, the interaction between student, teacher, and virtual teacher and the structure of the pedagogical approach to teach speechreading with the help of a virtual teacher.


speechreading lipreading language tutor embodied conversational agent facial animation audio-visual training-aid hard-of-hearing deaf sudden deafness 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Flanagan, J.L.: Speech Analysis, Synthesis and Perception, 2nd edn. Springer, Heidelberg (1972)CrossRefGoogle Scholar
  2. 2.
    Blauert, J.: Kommunikationsakustik II: Audiokommunikation und virtuelle Realität. Lecture Notes at Institut für Kommunikationsakustik. Ruhr-University, Bochum (1994)Google Scholar
  3. 3.
    Lindner, G.: Absehen - der andere Weg zum Sprachverstehen. Luchterhand (1999)Google Scholar
  4. 4.
    Gehörlosen- und Schwerhörigen-Verband der DDR: Absehlehrgang für Schwerhörige und Spätertaubte. Letters for Teachers and Students (1998)Google Scholar
  5. 5.
    Eisenwort, B., Viehhauser, G.: Ablesetraining. J. Groos-Verlag, Heidelberg (1992)Google Scholar
  6. 6.
    Burnham, D., Dale, R., Stevens, K., Powers, D., Davis, C., Buchholz, J., Kuratate, K., Kim, J., Paine, G., Kitamura, C., Wagner, M., Möller, S., Black, A., Schultz, T., Bothe, H.: From Talking Heads to Thinking Heads: A Research Platform for Human Communication Science (December 2009),
  7. 7.
    Wallace, R.S.: A.L.I.C.E. Artificial Intelligence Foundation (December 2009),
  8. 8.
    Leitner, S.: So lernt man lernen (how to learn to learn). Freiburg im Breisgau (1972/2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Hermann Gebert
    • 1
  • Hans-Heinrich Bothe
    • 1
    • 2
  1. 1.Technische Universität BerlinBerlinGermany
  2. 2.Danmarks Tekniske UniversitetKgs. LyngbyDenmark

Personalised recommendations