Skip to main content
SpringerLink
Log in
Book cover

Computational Science and Technology pp 533–543Cite as

Wireless Wearable for Sign Language Translator Device using Intel UP Squared (UP2) Board

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 481))

Abstract

Sign language translator devices translate hand gestures into text or voice that allow interactive communication between deaf and hearing people without the reliance on human interpreters. The main focus of this work is the development of a wireless wearable device for a sign language translator using an Intel UP Squared (UP2) board. The developed device is consists of a wearable glove-based wearable and a display device using an Intel UP2 board. When hand gestures have been created by a user, the accelerometer and flex sensors in the wearable are able to measure the gestures and conveyed the data to an Arduino Nano microcontroller. The microcontroller translates the gestures into text, and then transmits it wirelessly to the UP2 board, subsequently displays the text on an LCD. In this article, the developed hardware, circuit diagrams as well as the preliminary experimental results are presented, showing the performance of the device, while demonstrating how the Intel UP2 board can be connected to a low-cost Arduino microcontroller wirelessly via Bluetooth communication.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   279.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. World Federation of the deaf (2016). Sign Language. https://www.malaysiakini.com/news/376165

  2. Acute shortage of sign language interpreters in M’sia. https://www.malaysiakini.com/news/376165

  3. MFD: Massive shortage of sign language interpreters. https://www.thestar.com.my/news/nation/2013/09/20/more-interpreters-needed/

  4. Mohid, S. Z., Zin, N. A. M. (2011) Accessible courseware for kids with hearing impaired (MudahKiu): A preliminary analysis. Proc. 2011 Int. Conf. Pattern Anal. Intell. Robot. ICPAIR 2011, vol. 2, no. June, pp. 197–202

    Google Scholar 

  5. Simons, G.F., and Fennig, C.D. Ethnologue: Languages of the World, Twentieth edition. Dallas, Texas: SIL International. http://www.ethnologue.com.

  6. Igari, S., Fukumura, N. (2016) Recognition of Japanese Sign Language Words Represented by Both Arms using Multi-Stream HMMs. In Proceedings of IMCIC-ICSIT, pp.157–162

    Google Scholar 

  7. Bauer, B., Kraiss, K. F. (2002) Video-Based Sign Recognition Using Self-Organizing Subunit. In Proceedings of Int. Conf. on Pattern Recognition, vol. 2, pp. 434–437

    Google Scholar 

  8. Dreuw, P. et al. (2007) Speech Recognition Techniques for a Sign Language Recognition System. InterSpeech-2007, pp. 2513–2516

    Google Scholar 

  9. Bui, T. D., Nguyen, L. T. (2007) Recognizing Postures in Vietnamese Sign Language With MEMS Accelerometers. IEEE Sensors Journal, vol. 7, no. 5, pp. 707–712

    Google Scholar 

  10. Jingqiu, W., Ting, Z. (2014) An ARM-Based Embedded Gesture Recognition System Using a Data Glove. The 26th Chinese Control and Decision Conference, pp. 1580-1584

    Google Scholar 

  11. Rishikanth, C. et al. (2014) Low-cost intelligent gesture recognition engine for audio-vocally impaired individuals. 2014 IEEE Global Humanitarian Technology Conference (GHTC), pp. 628-634

    Google Scholar 

  12. Gałka, J. et al. (2016) Inertial Motion Sensing Glove for Sign Language Gesture Acquisition and Recognition.IEEE Sensors Journal, Vol. 16, No. 16, pp. 6310-6316

    Google Scholar 

  13. Ambar, R. et al. (2018) Preliminary Design of a Dual-Sensor Based Sign Language Translator Device. In: Ghazali R., Deris M., Nawi N., Abawajy J. (eds) Recent Advances on Soft Computing and Data Mining. SCDM 2018. Advances in Intelligent Systems and Computing, vol. 700, pp. 353-362

    Google Scholar 

  14. UP² (UP Squared) Unveiled On Kickstarter. http://www.up-board.org/up/press-release/up%C2%B2-up-squared-unveiled-on-kickstarter/

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia, Batu Pahat, Johor, Malaysia

    Tan Ching Phing, Radzi Ambar, Hazwaj Mhd Poad & Mohd Helmy Abd Wahab

  2. Faculty of Computing and Informatics, Universiti Malaysia Sabah, Kota Kinabalu, Malaysia

    Aslina Baharum

Authors
  1. Tan Ching Phing
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Radzi Ambar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Aslina Baharum
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hazwaj Mhd Poad
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mohd Helmy Abd Wahab
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Radzi Ambar .

Editor information

Editors and Affiliations

  1. Knowledge Technology Research Unit, Faculty of Computing and Informatics, Universiti Malaysia Sabah, Kota Kinabalu, Malaysia

    Rayner Alfred

  2. School of Information Science, Security and Networks Area, Japan Advanced Institute of Science and Technology, Ishikawa, Japan

    Yuto Lim

  3. Faculty of Computing and Informatics, Universiti Malaysia Sabah Faculty of Computing and Informatics, Kota Kinabalu, Sabah, Malaysia

    Ag Asri Ag Ibrahim

  4. Lincoln University , Christchurch, New Zealand

    Patricia Anthony

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Phing, T.C., Ambar, R., Baharum, A., Poad, H.M., Wahab, M.H.A. (2019). Wireless Wearable for Sign Language Translator Device using Intel UP Squared (UP2) Board. In: Alfred, R., Lim, Y., Ibrahim, A., Anthony, P. (eds) Computational Science and Technology. Lecture Notes in Electrical Engineering, vol 481. Springer, Singapore. https://doi.org/10.1007/978-981-13-2622-6_52

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-2622-6_52

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-2621-9

  • Online ISBN: 978-981-13-2622-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation