Skip to main content

Sign Language to Text Conversion Using Deep Learning

  • Conference paper
  • First Online:
Inventive Communication and Computational Technologies

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 145))

Abstract

Sign Languages also popularly called Signed Languages. This is the only language by which deaf and dumb can communicate with each other and one of the most unexplored areas. So the proposed paper represents a model that can be used to translate given sign language to simple English text so that it could be used for dumb people. By late proceedings in the field of profound learning, there exist many applications that neural network systems can solve one such problem is this sign language. To meet the requirements, the proposed model uses deep learning techniques to solve the problem. One such technique is Convolutional Neural Networks for image depiction and classification. The model designed in the proposed paper has a dataset that consists of 87,002 images. The dataset has been split into training data and test data in the ratio of 9:1. The proposed model was trained on 78,300 images and the testing was performed on 8700 images which were classified in 29 classes. The model has produced a training accuracy of 98.67%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Agarwal A, Thakur M (2013) Sign language recognition using microsoft kinect. In: IEEE international conference on contemporary computing

    Google Scholar 

  2. Bheda V and Dianna Radpour N (2017) Using deep convolutional networks for gesture recognition in american sign language. CoRR, abs/1710.06836

    Google Scholar 

  3. Dias J, Patil D, Raut P, Lopes M (2019) Sign language interpretation using deep learning (IOSRJEN)

    Google Scholar 

  4. Beena MV, Agnisarman Namboodiri MN (2017) Automatic sign language finger spelling using convolution neural network: analysis. Int J Pure Appl Math 117(20):9–15

    Google Scholar 

  5. . http://deeplearning.net/software/theano/

  6. Bantupalli K. Xie Y (2018) American sign language recognition using machine learning and computer vision. In: IEEE international conference on big data

    Google Scholar 

  7. Sharma M, Pal R, Sahoo AK (2014) Indian sign language using neural networks and kNN classification techniques. J Eng Appl Sci 9(8):1255–1259

    Google Scholar 

  8. Islam MZ, Hossain MS, Ul Islam R, Andersson K (2019) Static hand gesture recognition using convolutional neural network with data augmentation. In: 8th International conference on informatics, electronics & vision (ICIEV), At Washington, USA

    Google Scholar 

  9. Suresh R, Prakash P (2018) Deep learning based image classification on amazon web service. J Adv Res Dyn Control Syst 10:1000–1003

    Google Scholar 

  10. Dataset. https://www.kaggle.com/grassknoted/asl-alphabet/data#G1006.jpg

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to P. Prakash .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kartik, P.V.S.M.S., Sumanth, K.B.V.N.S., Ram, V.N.V.S., Prakash, P. (2021). Sign Language to Text Conversion Using Deep Learning. In: Ranganathan, G., Chen, J., Rocha, Á. (eds) Inventive Communication and Computational Technologies. Lecture Notes in Networks and Systems, vol 145. Springer, Singapore. https://doi.org/10.1007/978-981-15-7345-3_18

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-7345-3_18

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-7344-6

  • Online ISBN: 978-981-15-7345-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics