Speech and Gesture Recognition-Based Robust Language Processing Interface in Noise Environment

  • Jung-Hyun Kim
  • Kwang-Seok Hong
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4224)


We suggest and implement WPS (Wearable Personal Station) and Web-based robust Language Processing Interface (LPI) integrating speech and sign language (the Korean Standard Sign Language; KSSL). In other word, the LPI is integration language recognition and processing system that can select suitable language recognition system according to noise degree in given noise environment, and it is extended into embedded and ubiquitous-oriented the next generation language processing system that can take the place of a traditional uni-modal language recognition system using only 1 sensory channel based on desk-top PC and wire communication net. In experiment results, while an average recognition rate of uni-modal recognizer using KSSL only is 92.58% and speech only is 93.28%, advanced LPI deduced an average recognition rate of 95.09% for 52 sentential recognition models. Also, average recognition time is 0.3 seconds in LPI.


Recognition Rate Hand Gesture Hand Gesture Recognition Average Recognition Rate Language Recognition 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Fuchs, M., Hejda, P., Slavík, P.: Architecture of Multi-modal Dialogue System. In: Sojka, P., Kopeček, I., Pala, K. (eds.) TSD 2000. LNCS (LNAI), vol. 1902, pp. 433–438. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  2. Wooldridge, M.J., Jennings, N.R.: Intelligent agents: Theory and practice. Know. Eng. Review 10(2), 115–152 (1995)CrossRefGoogle Scholar
  3. Fagin, R., Halpern, J.Y., Moses, Y., Vardi, M.Y.: Reasoning about Knowledge. MIT Press, Cambridge (1995)MATHGoogle Scholar
  4. Kim, S.-G.: Korean Standard Sign Language Tutor, 1st edn. Osung Publishing Company, Seoul (2000)Google Scholar
  5. Kim, J.-H., et al.: Hand Gesture Recognition System using Fuzzy Algorithm and RDBMS for Post PC. In: Wang, L., Jin, Y. (eds.) FSKD 2005. LNCS (LNAI), vol. 3614, pp. 170–175. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  6. Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. Wiley, New York (2001)MATHGoogle Scholar
  7. Paulus, D., Hornegger, J.: Applied Pattern Recognition, 2nd edn. Vieweg (1998)Google Scholar
  8. Schuermann, J.: Pattern Classification: A Unified View of Statistical and Neural Approaches. Wiley&Sons (1996)Google Scholar
  9. Relational DataBase Management System, http://www.auditmypc.com/acronym/RDBMS.asp
  10. Oracle 10g DW Guide, http://www.oracle.com
  11. Vasantha kandasamy, W.B.: Smaranda Fuzzy Algebra. American Research Press, Seattle (2003)Google Scholar
  12. Scott McGlashan et al.: Voice Extensible Markup Language (VoiceXML) Version 2.0. W3C Recommendation (1992), http://www.w3.org

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Jung-Hyun Kim
    • 1
  • Kwang-Seok Hong
    • 1
  1. 1.School of Information and Communication EngineeringSungkyunkwan UniversitySuwon, KyungKi-doKorea

Personalised recommendations