Abstract
The communication gap between deaf and hearing people remains a significant issue today, as the language used by both parts creates barriers affecting multiple aspects on people’s lifes. To address this, we propose a system for translation of text and audio into Colombian Sign Language using an accessible and user-friendly mobile application to facilitate communication between both parties. For this prototype, 76 phrases and words that represent signs were selected for the system. Pre-recorded videos of a sign language interpreter were employed to perform translations based on the previously established vocabulary. The service works via video concatenation based on the client’s text or audio request, using a Whisper AI model for audio transcription. In the context of an undergraduate thesis project, a mobile application prototype that translate text and audio into Colombian Sign Language was successfully developed. This project contributes to bridging the communication gap between deaf individuals and the hearing community.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
César, C.A.S.: Boletines Poblacionales: Personas con Discapacidad -PCD1 Oficina de Promoción Social. p. 15 (2020)
INSOR. Plan estratégico de tecnologías de información-PETI-2018-2022.pdf. https://www2.sgc.gov.co/ControlYRendicion/planes-presupuesto-gestion/Indicadores/Plan%20estrat%C3%A9gico%20de%20tecnolog%C3%ADas%20de%20informaci%C3%B3n%E2%80%93PETI-2018%E2%80%932022.pdf
López-Ludeña, V., San-Segundo, R., Morcillo, C.G., López, J.C., Muñoz, J.M.P.: Increasing adaptability of a speech into sign language translation system. Expert Syst. Appl. 40(4), 1312–1322 (2013)
Glauert, J.R., Elliott, R., Cox, S.J., Tryggvason, J., Sheard, M.: Vanessa—a system for communication between deaf and hearing people. Technol. Disabil. 18(4), 207–216 (2006)
Wang, F., Sun, S., Liu, Y.: A bi-directional interactive system of sign language and visual speech based on portable devices. In: Proceedings of the IEEE International Conference on Robotics and Biomimetics ROBIO 2019, pp. 1071–1076 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Fernández Becerra, S., Olarte Vargas, F.A., Rosero Quenguan, J.M., Vásquez Rendón, A.F., Rueda-Olarte, A. (2024). Automatic Translation of Text and Audio to Colombian Sign Language. In: Tabares, M., Vallejo, P., Suarez, B., Suarez, M., Ruiz, O., Aguilar, J. (eds) Advances in Computing. CCC 2023. Communications in Computer and Information Science, vol 1924. Springer, Cham. https://doi.org/10.1007/978-3-031-47372-2_11
Download citation
DOI: https://doi.org/10.1007/978-3-031-47372-2_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-47371-5
Online ISBN: 978-3-031-47372-2
eBook Packages: Computer ScienceComputer Science (R0)