GyGSLA: A Portable Glove System for Learning Sign Language Alphabet
The communication between people with normal hearing with those having hearing or speech impairment is difficult. Learning a new alphabet is not always easy, especially when it is a sign language alphabet, which requires both hand skills and practice. This paper presents the GyGSLA system, standing as a completely portable setup created to help inexperienced people in the process of learning a new sign language alphabet. To achieve it, a computer/mobile game-interface and an hardware device, a wearable glove, were developed. When interacting with the computer or mobile device, using the wearable glove, the user is asked to represent alphabet letters and digits, by replicating the hand and fingers positions shown in a screen. The glove then sends the hand and fingers positions to the computer/mobile device using a wireless interface, which interprets the letter or digit that is being done by the user, and gives it a corresponding score. The system was tested with three completely inexperience sign language subjects, achieving a 76 % average recognition ratio for the Portuguese sign language alphabet.
KeywordsHCI Gesture recognition Sign Language Assistive technologies
This work was partially supported by the Portuguese Foundation for Science and Technology (FCT) project PEst-OE/EEI/LA0009/2013.
- 2.Vivendo em Silencio: Dactiologia portuguesa. https://vivendoemsilencio.files.wordpress.com/2010/07/dactl-lgp.jpg (2015). Accessed 15 June 2015
- 3.Fujitsu: Fujitsu glove-style wearable device. http://vandrico.com/wearables/device/fujitsu-glove-style-wearable-device (2015). Accessed 14 Dez 2015
- 4.Invensense: InvenSense. http://www.invensense.com/ (2015). Accessed 15 June 2015
- 6.Kinect.: Kinect for Windows. http://goo.gl/fGZT8X (2014). Accessed 10 Nov 2014
- 7.Mehdi, S.A., Khan, Y.N.: Sign language recognition using sensor gloves. In: Proceedings of the 9th International Conference on Neural Information Processing, vol. 5, pp. 2204–2206. IEEE (2002)Google Scholar
- 8.Motion, L.: Leap motion. https://www.leapmotion.com/ (2014). Accessed 10 Nov 2014
- 10.Praveen, N., Naveen Karanth, M.S., Megha.: Sign language interpreter using a smart glove. In: International Conference on Advances in Electronics, Computers and Communications, pp. 1–5. IEEE (2014)Google Scholar
- 11.Structure: Structure sensor. http://structure.io/ (2014). Accessed 10 Nov 2014
- 12.Unity: Unity 3D. https://unity3d.com/pt (2014). Accessed 10 Nov 2014