Skip to main content
SpringerLink
Log in

A Real-Time Large Vocabulary Continuous Recognition System for Chinese Sign Language

  • Conference paper
  • First Online:
Advances in Multimedia Information Processing — PCM 2001 (PCM 2001)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2195))

Included in the following conference series:

Abstract

In this paper, a real-time system designed for recognizing continuous Chinese Sign Language (CSL) sentences with a 4800 sign vocabulary is presented. The raw data are collected from two CyberGlove and a 3-D tracker. The worked data are presented as input to Hidden Markov Models (HMMs) for recognition. To improve recognition performance, some useful new ideas are proposed in design and implementation, including states tying, still frame detecting and fast search algorithm. Experiments were carried out, and for real-time continuous sign recognition, the correct rate is over 90%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. C. Charayaphan, A. Marble: Image processing system for interpreting motion in American Sign Language. Journal of Biomedical Engineering, 14(1992) 419--425.

    Google Scholar 

  2. T. Starner: Visual recognition of American Sign Language using hidden Markov models. Master’s thesis, MIT Media Laboratory, July. 1995.

    Google Scholar 

  3. S. S. Fels, G. Hinton: GloveTalk:A neural network interface between a DataDlove and a speech synthesizer. IEEE Transactions on Neural Networks 4(1993) 2–8.

    Article  Google Scholar 

  4. S. Sidney Fels: Glove-TalkII: Mapping hand gestures to speech using neural networks-An approach to building adaptive interfaces. PhD thesis, Computer Science Department, University of Torono, 1994.

    Google Scholar 

  5. Tomoichi Takahashi, Fumio Kishino: Gesture coding based in experiments with a hand gesture interface device. SIGCHI Bulletin (1991) 23(2) 67–73.

    Article  Google Scholar 

  6. Yanghee Nam, K. Y. Wohn: Recognition of space-time hand-gestures using hidden Markov model. To appear in ACM Symposium on Virtual Reality Software and Technology (1996).

    Google Scholar 

  7. R. H. Liang, M. Ouhyoung: A real-time continuous gesture recognition system for sign language. In Proceeding of the Third International Conference on Automatic Face and Gesture Recognition, Nara, Japan (1998) 558–565.

    Google Scholar 

  8. Kirsti Grobel, Marcell Assan: Isolated sign language recognition using hidden Markov models. In Proceedings of the International Conference of System, Man and Cybernetics (1996) 162–167.

    Google Scholar 

  9. Christian Vogler, Dimitris Metaxas: Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods. In Proceedings of the IEEE International Confference on Systems, Man and Cybernetics, Orlando, FL (1997) 156–161.

    Google Scholar 

  10. Christian Vogler, Dimitris Metaxas: ASL recognition based on a coupling between HMMs and 3D motion analysis. In Proceedings of the IEEE International Conference on Computer Vision, Mumbai, India (1998) 363–369.

    Google Scholar 

  11. Christian Vogler, Dimitris Metaxas: Toward scalability in ASL Recognition: Breaking Down Signs into Phonemes. In Proceedings of Gesture Workshop, Gif-sur-Yvette, France (1999) 400–404.

    Google Scholar 

  12. Wen Gao, Jiyong Ma, Jianggin Wu, Chunli Wang: Large Vocabulary Sign Language Recognition Based on HMM/ANN/DP. International Journal of Pattern Recognition and Artificial Intelligence, Vol. 14, No. 5 (2000) 587–602.

    Article  Google Scholar 

  13. Chunli Wang, Wen Gao, and Jiyong Ma. “A Real-Time Large Vocabulary Recognition System For Chinese Sign Language”, The 4th International Gesture and Sign Language based Human-Computer Interaction, London, April 18th-20th, 2001.

    Google Scholar 

  14. Vogler C. Metaxas D. Parallel Hidden Markov Models for American Sign Language recognition. Proceedings of the Seventh IEEE International Conference on Computer Vision. IEEE Comput. Soc. Part vol.1,1999, pp.116-22, Los Alamitos, CA, USA

    Google Scholar 

  15. L Rabiner, B. Juang: Fundamentals of Speech Recognition. Publishing Company of TsingHua University.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer, Dalian University of Technology, Dalian, 116023, China

    Chunli Wang

  2. Institute of Computing Technology, Chinese Academy of Science, Beijing, 100080, China

    Wen Gao

  3. Department of Computer Science, Harbin Institute of Technology, 150001, China

    Wen Gao

  4. Department of Management, Dalian University of Technology, Dalian, 116023, China

    Zhaoguo Xuan

Authors
  1. Chunli Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wen Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhaoguo Xuan
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Microsoft Research China, 5/F Beijing Sigma Center 49 Zhichung Road, Haidian District, Beijing, 100080, China

    Heung-Yeung Shum

  2. Institute of Information Science, Academia Sinica, Taiwan

    Mark Liao

  3. Department of Electrical Engineering, Columbia University, New York, NY, 10027, USA

    Shih-Fu Chang

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Wang, C., Gao, W., Xuan, Z. (2001). A Real-Time Large Vocabulary Continuous Recognition System for Chinese Sign Language. In: Shum, HY., Liao, M., Chang, SF. (eds) Advances in Multimedia Information Processing — PCM 2001. PCM 2001. Lecture Notes in Computer Science, vol 2195. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45453-5_20

Download citation

  • DOI: https://doi.org/10.1007/3-540-45453-5_20

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42680-6

  • Online ISBN: 978-3-540-45453-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation