Skip to main content
SpringerLink
Log in

Proposal for an Interactive Software System Design for Learning Mexican Sign Language with Leap Motion

  • Conference paper
  • First Online:
HCI International 2020 – Late Breaking Papers: Universal Access and Inclusive Design (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12426))

Included in the following conference series:

Abstract

The main objective of this work is to carry out a proposal of an interactive software system (ISS) design that makes use a Hardware device (Hw) “Leap Motion” and is centered average users as an interactive solution for communication with deaf people is feasible.

With this proposal we hoped to achieve a natural recognition of hand movements, in this way will be obtained a support system for the average user in the learning of Mexican Sign Language (MSL) and, through gamification techniques applied to the ISS, the user can learn and communicate with a person with hearing impairment.

To carry out this proposal we review the literature, in general we can observed that several of the papers consider another type of sign language or another technique for the recognition of signs, therefore, the number of papers that specifically focus on the “Mexican Sign Language” learning and that use the Hw of “Leap Motion” is considerably reduced.

Which allows us to conclude that the proposal for the design of an ISS for training in the learning of Mexican Sign Language for average people is feasible not only by using an Hw tool that allows communication and interpretation of MSL and gamification techniques, It also has the support of related papers which guarantee that the “Leap Motion” is a tool that can be used for such action.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. SEDESOL-CONADIS La Sordoceguera en México: datos por el 27 de junio, día internacional de la sordoceguera. https://www.gob.mx/conadis/es/articulos/la-sordoceguera-en-mexico-datos-por-el-27-de-junio-dia-internacional-de-la-sordoceguera?idiom=es. Accessed 6 Jan 2020

  2. SIPSE En México se hacen ciegos ante los sordos. https://sipse.com/mexico/sordos-discapacidad-gobierno-mexico-224324.html. Accessed 6 Jan 2020

  3. Wadhawan, A., Kumar, P.: Sign language recognition systems: a decade systematic literature review. Arch. Comput. Methods Eng. 1–29 (2019)

    Google Scholar 

  4. Gobierno de México. https://www.gob.mx/conadis/articulos/lengua-de-senas-mexicana-lsm?idiom=es. Accessed 6 Jan 2020

  5. Trujillo-Romero, F., Caballero-Morales, S.-O.: 3D data sensing for hand pose recognition. In: CONIELECOMP 2013, 23rd International Conference on Electronics, Communications and Computing, pp. 109–113. IEEE (2013)

    Google Scholar 

  6. Sosa-Jímenez, C., Ríos-Figueroa, H., Rechy-Ramírez, E., Marin-Hernandez, A., González-Cosío, A.: Real-time Mexican Sign Language recognition. In: 2017 IEEE International Autumn Meeting on Power, Electronics and Computing (ROPEC), pp. 1–6. IEEE (2017)

    Google Scholar 

  7. Luis-Pérez, F.E., Trujillo-Romero, F., Martínez-Velazco, W.: Control of a service robot using the Mexican sign language. In: Batyrshin, I., Sidorov, G. (eds.) MICAI 2011. LNCS (LNAI), vol. 7095, pp. 419–430. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-25330-0_37

    Chapter  Google Scholar 

  8. Solís, J.-F., Toxqui-Quitl, C., Martínez-Martínez, D., Margarita, H.-G.: Mexican sign language recognition using normalized moments and artificial neural networks. In: Optics and Photonics for Information Processing VIII, pp. 92161A. ISOP (2014)

    Google Scholar 

  9. Galicia, R., Carranza, O., Jiménez, E.-D., Rivera, G.-E.: Mexican sign language recognition using movement sensor. In: 2015 IEEE 24th International Symposium on Industrial Electronics (ISIE), pp. 573–578. IEEE (2015)

    Google Scholar 

  10. López, E., Velásquez, J., Eleuterio, R., Gil, L.: Interfaz de reconocimiento de movimientos para el lenguaje de señas mexicano implementando el Kinect. Revista Aristas: Investigación Básica y Aplicada 4(7), 130–133 (2015)

    Google Scholar 

  11. Solís, F., Martínez, D., Espinoza, O.: Automatic Mexican sign language recognition using normalized moments and artificial neural networks. Engineering 8(10), 733–740 (2016)

    Article  Google Scholar 

  12. Jimenez, J., Martin, A., Uc, V., Espinosa, A.: Mexican sign language alphanumerical gestures recognition using 3D Haar-like features. IEEE Latin Am. Trans. 15(10), 2000–2005 (2017)

    Article  Google Scholar 

  13. Wang, Q., Wang, Y., Liu, F., Zeng, W.: Hand gesture recognition of Arabic numbers using leap motion via deterministic learning. In: 2017 36th Chinese Control Conference (CCC), pp. 10873–10828. IEEE (2017)

    Google Scholar 

  14. Li, W.-J., Hsieh, C.-Y., Lin, L.-F., Chu, W.-C.: Hand gesture recognition for post-stroke rehabilitation using leap motion. In: 2017 International Conference on Applied System Innovation (ICASI), pp. 386–388. IEEE (2017)

    Google Scholar 

  15. Morando, M., Ponte, S., Ferrara, E., Dellepiane, S.: Biophysical and motion features extraction for an effective home-based rehabilitation. In: Proceedings of the International Conference on Bioinformatics Research and Applications 2017, pp. 79–85. ACM (2017)

    Google Scholar 

  16. Nicola, S., Stoicu-Tivadar, L., Virag, I., Crişan-Vida, M.: Leap motion supporting medical education. In: 2016 12th IEEE International Symposium on Electronics and Telecommunications (ISETC), pp. 153–156. IEEE (2016)

    Google Scholar 

  17. Dzikri, A., Kurniawan, D.-E.: Hand gesture recognition for game 3D object using the leap motion controller with backpropagation method. In: 2018 International Conference on Applied Engineering (ICAE), pp. 1–5. IEEE (2018)

    Google Scholar 

  18. Zhi, D., de Oliveira, T.-E.-A., da Fonseca, V.-P., Petriu, E.-M.: Teaching a robot sign language using vision-based hand gesture recognition. In: 2018 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), pp. 1–6. IEEE (2018)

    Google Scholar 

  19. Mapari, R., Kharat, G.: American static signs recognition using leap motion sensor. In: Proceedings of the Second International Conference on Information and Communication Technology for Competitive Strategies, p. 67. ACM (2016)

    Google Scholar 

  20. Kotsidou, D., Angelis, C., Dragoumanos, S., Kakarountas, A.: Computer assisted gesture recognition for the Greek sign language/fingerspelling. In: Proceedings of the 19th Panhellenic Conference on Informatics, pp. 241–242. ACM (2015)

    Google Scholar 

  21. Chavan, P., Ghorpade, T., Padiya, P.: Indian sign language to forecast text using leap motion sensor and RF classifier. In: 2016 Symposium on Colossal Data Analysis and Networking (CDAN), pp. 1–5. IEEE (2016)

    Google Scholar 

  22. Anwar, A., Basuki, A., Sigit, R., Rahagiyanto, A., Zikky, M.: Feature extraction for Indonesian sign language (SIBI) using leap motion controller. In: 2017 21st International Computer Science and Engineering Conference (ICSEC), pp. 1–5. IEEE (2017)

    Google Scholar 

  23. Ultraleap. https://www.ultraleap.com/product/leap-motion-controller/. Accessed 13 Jan 2020

  24. Ameur, S., Khalifa, A.-B., Bouhlel, M.-S.: A comprehensive leap motion database for hand gesture recognition. In: 2016 7th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT), pp. 514–519. IEEE (2016)

    Google Scholar 

  25. Sharma, A., Yadav, A., Srivastava, S., Gupta, R.: Analysis of movement and gesture recognition using leap motion controller. Procedia Comput. Sci. 132, 551–556 (2018)

    Article  Google Scholar 

  26. Zeng, W., Wang, C., Wang, Q.: Hand gesture recognition using leap motion via deterministic learning. Multimedia Tools Appl. 77(21), 28185–28206 (2018). https://doi.org/10.1007/s11042-018-5998-1

    Article  Google Scholar 

  27. Chaudhary, A., Raheja, J.-L., Das, K., Raheja, S.: Intelligent approaches to interact with machines using hand gesture recognition in natural way: a survey. arXiv preprint arXiv:1303.2292 (2013)

  28. Yamakami, T.: A four-stage gate-keeper model of social service engineering: lessons from golden rules of mobile social game design. In: 2012 9th International Conference on Ubiquitous Intelligence and Computing and 9th International Conference on Autonomic and Trusted Computing, pp. 159–163. IEEE (2012)

    Google Scholar 

Download references

Acknowledgement

I want to thank E. Girard for support in the revision/correction of this paper and in the case of A. Cruz for making all the convenient reviews to improve it.

Author information

Authors and Affiliations

  1. Universidad Autónoma de Baja California Sur, Sur KM5.5, 23080, La Paz, Mexico

    Teresita Alvarez-Robles & Mónica Carreño-León

  2. Universidad Autónoma de Aguascalientes, Av. Universidad 940, 20131, Aguascalientes, Mexico

    Francisco Álvarez

Authors
  1. Teresita Alvarez-Robles
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Francisco Álvarez
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mónica Carreño-León
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Teresita Alvarez-Robles .

Editor information

Editors and Affiliations

  1. University of Crete and Foundation for Research and Technology – Hellas (FORTH), Heraklion, Greece

    Constantine Stephanidis

  2. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Greece

    Margherita Antona

  3. Tsinghua University, Beijing, China

    Qin Gao

  4. Chongqing University, Chongqing, China

    Jia Zhou

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Alvarez-Robles, T., Álvarez, F., Carreño-León, M. (2020). Proposal for an Interactive Software System Design for Learning Mexican Sign Language with Leap Motion. In: Stephanidis, C., Antona, M., Gao, Q., Zhou, J. (eds) HCI International 2020 – Late Breaking Papers: Universal Access and Inclusive Design. HCII 2020. Lecture Notes in Computer Science(), vol 12426. Springer, Cham. https://doi.org/10.1007/978-3-030-60149-2_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-60149-2_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-60148-5

  • Online ISBN: 978-3-030-60149-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation