Skip to main content
SpringerLink
Log in

Intelligent Indian Sign Language Recognition Systems: A Critical Review

  • Conference paper
  • First Online:
ICT Systems and Sustainability

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 321))

Abstract

Sign language (SL) is an alternative way of communication for hearing/speech impaired people. SL varies from country to country. Thus, different SLs came into existence such as American Sign Language (ASL), Chinese Sign Language (CSL), British Sign Language (BSL) and so on. In India, people use Indian Sign Language (ISL) as an alternative communication medium. Approximately, 2.7 million Indian people are deaf/dumb, out of which 98% population uses ISL for communication. But human interpreters are not available or affordable for identifying ISL. Thus, researchers are focussing on Sign Language Recognition System (SLRS) for the identification of ISL. But designing an SLRS for ISL is very difficult in comparison with other SL. ISL is very complex as it consists of single- and double-handed gesture and has an extensive vocabulary with similar gestures. This paper aims to provide a thorough study of ISL, its syntax/vocabulary and different trending techniques for designing an ISL recognition system. This paper also discusses various feature extraction techniques, classification methods used in ISL recognition and points out some challenges researchers face while developing an ISL recognition system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Davis JE (2005) Working with sign language interpreters in human service settings in national organization for human service (NOHS). 25(1):41–52

    Google Scholar 

  2. Dudhal A, Mathkar H, Jain A, Kadam O, Shirole M (2018) Hybrid SIFT feature extraction approach for indian sign language recognition system based on CNN. In: Proceedings of the international conference on ISMAC in computational vision and bioengineering (ISMAC-CVB), Springer, pp 727–738

    Google Scholar 

  3. Shukor AZ, Miskon MF, Jamaluddin MH, Bin F (2015) A new data glove approach for malaysian sign language detection. Proc Comput Sci 76(1):60–67

    Google Scholar 

  4. Kumar A, Thankachan K, Dominic MM (2016) Sign language recognition. In: 3rd international conference on recent advances in information technology (RAIT), IEEE, Dhanbad, pp 422–428

    Google Scholar 

  5. Chandra MM, Rajkumar S, Kumar LS (2019) Sign languages to speech conversion prototype using the SVM classifier. In: IEEE Region 10 conference (TENCON), Kochi, pp 1803–1807

    Google Scholar 

  6. Gupta B, Shukla P, Mittal A (2016) K-nearest correlated neighbor classification for Indian sign language gesture recognition using feature fusion. In: International conference on computer communication and informatics (ICCCI), IEEE, Coimbatore

    Google Scholar 

  7. Sadik F, Subah MR, Dasider AG, Moon SA, Ahbab SS, Fattah SA (2019) Bangla sign language recognition with skin segmentation and binary masking. In: International WIE conference on electrical and computer engineering (WIECON-ECE), IEEE, Bangalore, pp 1–5

    Google Scholar 

  8. Aly S, Aly W (2020) DeepArSLR: a novel signer-independent deep learning framework for isolated arabic sign language gestures recognition. IEEE Access 8(1):83199–83212

    Google Scholar 

  9. Sreenivas A, Maheshwari M, Jain S, Choudhary S, Vadivu G (2020) Indian sign language communicator using convolutional neural network. Int J Adv Sci Technol 29(3):11015–11031

    Google Scholar 

  10. Hasan MM, Srizon AY, Mehedi Hasan MA (2020) Classification of Bengali sign language characters by applying a novel deep convolutional neural network. In: IEEE region 10 symposium (TENSYMP), Dhaka, pp 1303–1306

    Google Scholar 

  11. Sajanraj TD, Beena MV (2018) Indian sign language numeral recognition using region of interest convolutional neural network. In: Second international conference on inventive communication and computational technologies (ICICCT), IEEE, Coimbatore, pp 636–640

    Google Scholar 

  12. Dasgupta T, Dandpat S, Basu A (2008) Prototype machine translation system from text to-Indian sign language. In: Proceedings of the IJCNLP-08 workshop on NLP for less privileged languages, ACM, Hyderabad

    Google Scholar 

  13. Kumar SP, Kaur S (2020) Sign language generation system based on indian sign language grammar. ACM Trans Asian and Low-Resour Lang Info Process 19(4):1–26

    Google Scholar 

  14. Gupta R, Ranjan S (2020) Comparative analysis of convolution neural network models for continuous indian sign language classification. Proc Comput Sci 171(1):1542–1550

    Google Scholar 

  15. Yarisha Heera S, Murthy MK, Sravanti VS, Salvi S (2017) Talking Hands—an indian sign language to speech translating gloves. In: International conference on innovative mechanisms for industry applications (ICIMIA), IEEE, Bengaluru, pp 746–751

    Google Scholar 

  16. Deora D, Bajaj N (2012) Indian sign language recognition. In: 1st international conference on emerging technology trends in electronics, communication and networking, IEEE, Surat

    Google Scholar 

  17. Divya B, Delpha J, Badrinath S (2017) Public speaking words (Indian Sign Language) recognition using EMG. In: International conference on smart technologies for smart nation (SmartTechCon), IEEE, Bengaluru, pp 798–800

    Google Scholar 

  18. Chavan P, Ghorpade T, Padiya P (2016) Indian sign language to forecast text using leap motion sensor and RF classifier. In: Symposium on colossal data analysis and networking (CDAN), IEEE, Indore

    Google Scholar 

  19. Tripathi K, Baranwal N, Nandi GC (2015) Continuous Indian sign language gesture recognition and sentence formation. In: Eleventh international multi-conference on information processing (IMCIP), vol 54. Elsevier, Allahabad, pp 523-531

    Google Scholar 

  20. Sridhar A, Ganesan RG (2020) Include: a large scale dataset for indian sign language recognition. In: MM ‘20: Proceedings of the 28th ACM international conference on multimedia, ACM, USA, pp 1366–1375

    Google Scholar 

  21. Ananth Rao G, Kishore PVV (2018) Selfie video based continuous Indian sign language recognition system. Ain Shams Eng J 9(4):1929–1939

    Google Scholar 

  22. Itkarkar RR, Nandi A, Mane B (2017) Contour-based real-time hand gesture recognition for indian sign language. In: Computational intelligence in data mining, vol 556. Springer, Pune, pp 683-691

    Google Scholar 

  23. Sahoo AK, Sarangi PK, Goyal P (2020) Indian sign language recognition using soft computing techniques. Machine Vision Inspection Syst 1(1):37–65

    Google Scholar 

  24. Badhe PC, Kulkarni V (2020) Artificial neural network based indian sign language recognition using hand crafted features. In: 11th International conference on computing, communication and networking technologies (ICCCNT), IEEE, Kharagpur

    Google Scholar 

  25. Jayadeep G, Vishnupriya NV, Venugopal V, Vishnu S, Geetha M (2020) Mudra: convolutional neural network based indian sign language translator for banks. In: International conference on intelligent computing and control systems (ICICCS), IEEE, Madurai, pp 1228–1232

    Google Scholar 

  26. Bhagat NK, Vishnusai Y, Rathna GN (2019) Indian sign language gesture recognition using image processing and deep learning. In: Digital image computing: techniques and applications (DICTA), IEEE, Perth

    Google Scholar 

  27. Raghuveera T, Deepthi R, Mngalashri R, Akshaya R (2020) A depth-based Indian sign language recognition using microsoft kinect. Indian Acad Sci 46(2):33–46

    Google Scholar 

  28. Agarwal SR, Agrawal SB, Latif AM (2015) Sentence formation in NLP engine on the basis of indian sign language using hand gestures. Int J Comput Appl 116(17):18–22

    Google Scholar 

  29. Gangadia D, Chamaria V, Doshi V, Gandhi J (2020) Indian sign language interpretation and sentence formation. In: IEEE international conference (PuneCon), Pune, pp 71–76

    Google Scholar 

  30. Athira PK, Sruthi CJ, Lijiya A (2019) A signer independent sign language recognition with co-articulation elimination from live videos: an indian scenario. J King Saud Univer –Comput Infor Sci 31(2):1–11

    Google Scholar 

  31. Dutta KK, Bellary SAS (2017) Machine learning techniques for indian sign language recognition. In: International conference on current trends in computer, electrical, electronics and communication (ICCTCEEC), IEEE, Mysore, pp 333–336

    Google Scholar 

  32. Choudhury A, Talukdar AK, Sarma KK(2014) A conditional random field based indian sign language recognition system under complex background. In: Fourth international conference on communication systems and network technologies, IEEE, Bhopal, pp 900–904

    Google Scholar 

  33. Raheja JL, Mishra A, Chaudhary A (2016) Indian sign language recognition using SVM. Pattern Recog Image Anal 26(2):434–441

    Google Scholar 

  34. Mittal A, Kumar P, Roy PP, Balasubramanian R, Chaudhuri BB (2019) A modified-LSTM model for continuous sign language recognition using leap motion. IEEE Sens J 19(16):1–8

    Google Scholar 

  35. Suri K, Gupta R (2019) Continuous sign language recognition from wearable IMUs using deep capsule networks and game theory. Comput Electri Eng 78(1):493–503

    Google Scholar 

  36. Likhar P,  Bhagat NK,  Rathna GN (2020) Deep learning methods for indian sign language recognition. In: 10th International conference on consumer electronics (ICCE), IEEE, Berlin

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. NIT Silchar, Fakiratilla, Silchar, Assam, 788010, India

    Soumen Das, Saroj Kr. Biswas, Manomita Chakraborty & Biswajit Purkayastha

Authors
  1. Soumen Das
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Saroj Kr. Biswas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Manomita Chakraborty
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Biswajit Purkayastha
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Soumen Das .

Editor information

Editors and Affiliations

  1. Singidunum University, Belgrade, Serbia

    Milan Tuba

  2. ITM University, Gwalior, Madhya Pradesh, India

    Shyam Akashe

  3. Global Knowledge Research Foundation, Ahmedabad, Gujarat, India

    Amit Joshi

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Das, S., Biswas, S.K., Chakraborty, M., Purkayastha, B. (2022). Intelligent Indian Sign Language Recognition Systems: A Critical Review. In: Tuba, M., Akashe, S., Joshi, A. (eds) ICT Systems and Sustainability. Lecture Notes in Networks and Systems, vol 321. Springer, Singapore. https://doi.org/10.1007/978-981-16-5987-4_71

Download citation

Publish with us

Policies and ethics

Search

Navigation