Abstract
Sign languages appear to be the major communication tool for the deaf community. As a minor community, Vietnamese deaf people often have to rely on a small numbers of interpreters who are hearing people knowing sign language in order to communicate with hearing people. It would be very beneficial for deaf as well as hearing people to develop an automated translation system between spoken/written languages and sign language. In this paper, we present our attempt to graphically decompose the gestures in Vietnamese Sign Language so that they can be easily synthesized in a 3D conversational agent. In order to describe the signs in Vietnamese Sign Language, we proposed an animation-level markup language. Based on this, we presented our 3D conversational agent for presenting multi-modal information for deaf people. The 3D agent can assist deaf people easier and in a more natural way.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bangham, J.A., Cox, S.J., Elliott, R., Glauert, J.R.W., Marshall, I., Rankov, S., Wells, M.: Virtual signing: Capture, animation, storage and transmission - an overview of the visicast project. In: IEE Seminar on Speech and language processing for disabled and elderly people (2000)
Bonow Boeira, V., Volz de Oliveira, L.R., Souza Madeira, D., da Rocha Costa, A.C.: Using signwriting as a phonetic notation system. In: Braffort, A., et al. (eds.) Atelier traitement automatique des langues des signes: TALS 2005 (2005)
Bui, T.D.: Emotion and Facial Expressions in Creating Embodied Agents. PhD thesis, University of Twente, The Netherlands (2004)
Inclusive Education For Hearing Impaired Children in VietNam. Signs of the Deaf in VietNam (1997)
Marshall, I., Pezeshkpour, F., Bangham, J.A., Wells, M., Hughes, R.: On the real time elision of text. In: RIFRA 1998 - Proc. Int. Workshop on Extraction, Filtering and Automatic Summarization (1998)
Neidle, C., Kegl, J., MacLaughlin, D., Bahan, B., Lee, R.G.: The syntax of American Sign Language: functional categories and hierarchical structure. MIT Press, Cambridge (2000)
Pezeshkpour, F., Marshall, I., Elliott, R., Bangham, J.A.: Development of a legible deaf-signing virtual human. In: Proc. IEEE Conf. Multi-Media (1999)
Prillwitz, S., Leven, R., Zienert, H., Hanke, T., Henning, J., et al.: Hamburg notation system for sign languages - an introductory guide. In: International Studies on Sign Language and the Communication of the Deaf, vol. 5 (1989)
Sacks, O.: Seeing Voices – A Journey into the World of the Deaf. The University of California Press (1989)
Stokoe, W., Kuschel, R.: For Sign Language Research. Linstock Press (1978)
Thetos: Text into sign language automatic translator for polish, http://sun.iinf.polsl.gliwice.pl/sign/
Wells, M., Pezeshkpour, F., Marshall, I., Tutt, M., Bangham, J.A.: Simon: an innovative approach to signing on television. In: Proc. Int. Broadcasting Convention (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Phan, D.P., Nguyen, T.N.T., Bui, T.D. (2009). A 3D Conversational Agent for Presenting Digital Information for Deaf People. In: Ghose, A., Governatori, G., Sadananda, R. (eds) Agent Computing and Multi-Agent Systems. PRIMA 2007. Lecture Notes in Computer Science(), vol 5044. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01639-4_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-01639-4_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01638-7
Online ISBN: 978-3-642-01639-4
eBook Packages: Computer ScienceComputer Science (R0)