Skip to main content
SpringerLink
Log in

ASL Recognition and Conversion to Speech

  • Conference paper
  • First Online:
Second International Conference on Computer Networks and Communication Technologies (ICCNCT 2019)

Part of the book series: Lecture Notes on Data Engineering and Communications Technologies ((LNDECT,volume 44))

Abstract

The deaf & dumb (or the Mute community) find it a tedious task to converse with ordinary people through sign language. This stands as a hindrance in even the most basic of their activities. It affects their personal development, interpersonal relations and limits the contributions they could otherwise make to society. The prime motive of this project is to provide an easy to use platform for the hard of hearing people to express themselves despite the sign language barrier. We aim to achieve this motive through gesture recognition. Using gesture recognition, we compute the mathematical interpretation of human hand gestures to recognize the signs conveyed by American Sign Language. The system enables real-time hand gesture and speech recognition and provides an innovative and simpler mode of communication for the mute people.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Hussain, I., Talukdar, A.K., Sarma, K.K.: Hand gesture recognition system with real-time palm tracking. In: 11th IEEE India Conference: Emerging Trends and Innovation in Technology, INDICON 2014. Institute of Electrical and Electronics Engineers Inc. (2014)

    Google Scholar 

  2. Elmahgiubi, M., Ennajar, M., Drawil, N., Elbuni, M.S.: Sign language translator and gesture recognition. In: 2015 Global Summit on Computer & Information Technology (GSCIT), pp. 1–6 (2015)

    Google Scholar 

  3. Loke, P., et al.: Indian sign language converter system using an android app. In: Proceedings of the International Conference on Electronics, Communication and Aerospace Technology, ICECA, January 2017. Institute of Electrical and Electronics Engineers Inc., pp. 436–439 (2017)

    Google Scholar 

  4. Gupta, M., Meha, G., Prateek, D.: Sign language to speech converter using neural networks. Int. J. Comput. Sci. Emerg. Technol. 14(3) 2044–6004 (2010)

    Google Scholar 

  5. Butte, A., Jadhav, S., Meher, S.: Hand Gestures And Speech Recognition System For Deaf-Dumb (2018)

    Google Scholar 

  6. About American Sign Language. https://www.startasl.com/american-sign-language, August 2016

  7. Sign Language Recognition. https://github.com/Evilport2/Sign-Language (2018)

  8. Background subtraction. https://gogul09.github.io/software/hand-gesture-recognition-p1. Accessed 06 April 2017

  9. OpenCV documentation. https://docs.opencv.org/4.0.0/

  10. CNN Keras. https://www.tensorflow.org/guide/keras

  11. Gonzales, R.C., Woods, R.E.: Digital Image Processing

    Google Scholar 

  12. Raschka, S.: Python Machine Learning (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Engineering, Pune, India

    Simran Kharpude, Vaishnavi Hardikar, Gautam Munot, Omkar Lonkar & Vanita Agarwal

Authors
  1. Simran Kharpude
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vaishnavi Hardikar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gautam Munot
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Omkar Lonkar
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Vanita Agarwal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Simran Kharpude .

Editor information

Editors and Affiliations

  1. Department of Computer Science Engineering, RVS Technical Campus, Coimbatore, Tamil Nadu, India

    S. Smys

  2. University of the Ryukyus, Okinawa, Japan

    Tomonobu Senjyu

  3. Department of Telecommunication Engineering, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic

    Pavel Lafata

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kharpude, S., Hardikar, V., Munot, G., Lonkar, O., Agarwal, V. (2020). ASL Recognition and Conversion to Speech. In: Smys, S., Senjyu, T., Lafata, P. (eds) Second International Conference on Computer Networks and Communication Technologies. ICCNCT 2019. Lecture Notes on Data Engineering and Communications Technologies, vol 44. Springer, Cham. https://doi.org/10.1007/978-3-030-37051-0_53

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-37051-0_53

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-37050-3

  • Online ISBN: 978-3-030-37051-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation