Skip to main content

Wireless Wearable for Sign Language Translator Device with Android-Based App

Part of the Lecture Notes in Networks and Systems book series (LNNS,volume 67)

Abstract

Sign language translator device is an assistive device that helps hearing impaired and normal people communicate with each other. The device can be either a camera vision-based or wearable glove-based system that translates hand gestures into text or voice. However, vision-based devices are susceptible to low light conditions and expensive. In contrast, glove-based devices are popular and low cost, but many designs utilized cable system that limits hand motions. The main focus of this work is to develop a wireless wearable sign language translator device, so that free-hand motions can be achieved. An Android-based smartphone application (app) has been developed to receive and display translated gestures from the wearable device in text form. The usage of smartphone app significantly reduces development cost, simplifies the design and improves the ease-of-use for hearing impaired communities. In this article, the developed hardware, circuit diagrams, app development as well as experimental results are presented.

Keywords

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Acute shortage of sign language interpreters in M’sia. Retrieved from https://www.malaysiakini.com/news/376165

  2. Mohid SZ, Zin NAM (2011) Accessible courseware for kids with hearing impaired (MudahKiu): a preliminary analysis. In: Proceedings of 2011 international conference on pattern analysis and intelligent robotics ICPAIR 2011, vol 2, pp 197–202

    Google Scholar 

  3. Igari S, Fukumura N (2016) Recognition of Japanese sign language words represented by both arms using multi-stream HMMs. In: Proceedings of IMCIC-ICSIT, pp 157–162

    Google Scholar 

  4. Dong C, Yin Z, Leu MC (2015) American sign language alphabet recognition using microsoft kinect. In: IEEE conference on computer vision and pattern recognition workshops, pp 44–52

    Google Scholar 

  5. Hai PT et al (2018) Automatic feature extraction for Vietnamese sign language recognition using support vector machine. In: 2018 2nd international conference on recent advances in signal processing telecommunications and computing (SigTelCom), pp 146–151

    Google Scholar 

  6. Rishikanth C et al (2014) Low-cost intelligent gesture recognition engine for audio-vocally impaired individuals. In: 2014 IEEE global humanitarian technology conference (GHTC), pp 628–634

    Google Scholar 

  7. Gałka J et al (2016) Inertial motion sensing glove for sign language gesture acquisition and recognition. IEEE Sens J 16(16):6310–6316

    Article  Google Scholar 

  8. Ambar R et al (2018) Preliminary design of a dual-sensor based sign language translator device. In: Ghazali R, Deris M, Nawi N, Abawajy J (eds) Recent advances on soft computing and data mining. SCDM 2018. Advances in intelligent systems and computing, vol 700. Springer, Cham

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank the Research Management Center (RMC), UTHM and Ministry of Higher Education for sponsoring the research under Tier 1 Research Grant (H161).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Radzi Ambar .

Editor information

Editors and Affiliations

Ethics declarations

Ethical Approval. All procedures performed in studies involving human participants were in accordance with the ethical standards of the Human Research Ethics Committee of Universiti Tun Hussein Onn Malaysia (UTHM).

Informed Consent. Informed consent was obtained from all individual participants included in the study.

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Phing, T.C., Ambar, R., Choon, C.C., Wahab, M.H.A. (2019). Wireless Wearable for Sign Language Translator Device with Android-Based App. In: Piuri, V., Balas, V., Borah, S., Syed Ahmad, S. (eds) Intelligent and Interactive Computing. Lecture Notes in Networks and Systems, vol 67. Springer, Singapore. https://doi.org/10.1007/978-981-13-6031-2_27

Download citation

Publish with us

Policies and ethics