Abstract
In order to improve communication environments among the hearing impaired and the hearing people, the authors are developing a system translating Japanese into Japanese Sign Language (JSL) and vice versa. We represent the results of translation from Japanese by sign animations. Although JSL is multimodal, the roles of non-manual actions such as facial and head movements are not well known. We analyzed non-manual gestures spoken by a female sign interpreter, and we concluded that facial and head movements conveyed linguistic information on JSL. We carried out an experiment for evaluation of facial and head movements introduced into sign animations. The facial and head movements introduced into the animations had positive effects on recognition of JSL words.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kurokawa, T., Morichi, T., Watanabe, S.: Bidirectional translation between sign language and Japanese for communication with deaf-mute people. Advances in Human Factors/ Ergonomics 19B, 1109–1114 (1993)
Watanabe, S., Izuchi, T., Fujishige, E., Kurokawa, T.: Sign language animation using a synthesis-by-rule method. In: Proc. 9th Symp. on Human Interface, pp. 385–390 (1993)
Adachi, H., Yosizawa, S., Fujita, M., Matsumoto, T., Kamata, K.: Analysis of news sentences with sign language and sign translation processing. Rept. of JIPS Technical Meeting, 92, 24, NLC92-5, 17–24 (1992)
Demura, T., Itou, T., Fujishige, E., Kurokawa, T.: Building a database of Japanese Sign Language sentences and Its application to analysis of JSL grammar. In: Proc. of the Human Interface Symp. 2000, pp. 185–188 (2000a)
Demura, T., Itou, T., Fujishige, E., Kurokawa, T.: Analysis of Deictics in Japanese Sign Language by using a database of JSL sentences. Rept. of 3rd IEICE Technical Meeting for Sign Language Informatics, 37–40 (2000b)
Kawano, S., Takahashi, Y., Kurokawa, T.: An analysis of blinking, gazing, nodding and their meanings in sign language interpretation of TV news. Human Interface News and Report, 11, 435–440 (1996)
Kurokawa, T., Senba, K., Kawano, S.: Synthesis of facial movement images for sign language animation and their effects. Advances in Human Factors/Ergonomics 21, 5–8 (1997)
Kawano, S., Kurokawa, T.: The effects of facial expression on understanding Japanese sign language animation. Human-Computer Interaction 1, 783–787 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kawano, S., Kurokawa, T. (2004). Facial and Head Movements of a Sign Interpreter and Their Application to Japanese Sign Animation. In: Miesenberger, K., Klaus, J., Zagler, W.L., Burger, D. (eds) Computers Helping People with Special Needs. ICCHP 2004. Lecture Notes in Computer Science, vol 3118. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-27817-7_172
Download citation
DOI: https://doi.org/10.1007/978-3-540-27817-7_172
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22334-4
Online ISBN: 978-3-540-27817-7
eBook Packages: Springer Book Archive