Skip to main content

Sign Language Recognizer Using HMMs

  • Conference paper
  • First Online:
Information and Communication Technology for Intelligent Systems ( ICTIS 2020)

Abstract

In our day to day lives, we come across especially abled people who perform their daily chores with the aid of motivation that they get from self-confidence. There are many with hearing impairment. Sign language is the most expressed and natural way for them to communicate. Some chains of restaurants have, in fact, recruited deaf servers providing them with employment opportunities. Therefore, automatic Sign language recognition has become the crux of vision research. This paper is based on a project that builds a system that can recognize words communicated using the American Sign Language (ASL). Having been provided with a preprocessed dataset of tracked hand and nose positions extracted from the video, the set of Hidden Markov Models are trained. Using a part of this dataset, identification of individual words from test sequences is done. It provides them with the ability to communicate better, opening up a lot of opportunities.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Kim, T., Livescu, K., Shakhnarovich, G.: American sign language fingerspelling recognition with phonological feature-based tandem models (2012)

    Google Scholar 

  2. Liang, R.H., Ouhyoung, M.: A sign language recognition system using Hidden Markov model and context sensitive search

    Google Scholar 

  3. ElBadawy, M., Elons, A.S., Shedeed, H.A.: Arabic sign language recognition with 3D convolutional neural networks (2017)

    Google Scholar 

  4. Tolba, M.F., Elons, A.S.: Recent development in sign language recognition systems

    Google Scholar 

  5. Artificial intelligence, a modern approach by Stuart J Russel and Peter Norvig

    Google Scholar 

  6. Nicole, R.: Title of paper with only first word capitalized. J. Name Stand. Abbrev. (in press)

    Google Scholar 

  7. Olofsson, T.: Bayesian model selection for Markov, Hidden Markov and multinomial models (2007)

    Google Scholar 

  8. Anantha Rao, G., Syamala, K., Kishore, P.V.V.: Deep convolutional neural networks for sign language recognition (2018)

    Google Scholar 

  9. Dreuw, P., Rybach, D., Deselaers, T., Zahedi, M.: Spech recognition techniques for a sign language system. In: Interspeech (2007)

    Google Scholar 

  10. Liwicki, S., Everingham, M.: Automatic recognition of fingerspelled words in British sign language. In: CVPR (2009)

    Google Scholar 

  11. Fang, Y., et al.: A real time hand gesture recognition method. In: Proceedings International Conference on Multimedia Expo (2007)

    Google Scholar 

  12. Bowden, R., Windridge, D., Kadir, T., Zisserman, A., Brady, M.: A linguistic feature vector for the visual interpretation of sign language. In: ECCV (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Venkata Sai Rishita Middi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Middi, V.S.R., Raju, M.A. (2021). Sign Language Recognizer Using HMMs. In: Senjyu, T., Mahalle, P.N., Perumal, T., Joshi, A. (eds) Information and Communication Technology for Intelligent Systems. ICTIS 2020. Smart Innovation, Systems and Technologies, vol 195. Springer, Singapore. https://doi.org/10.1007/978-981-15-7078-0_71

Download citation

Publish with us

Policies and ethics