Abstract
In this paper, we present a Web-based framework for interactive Sign Language using virtual signing agents. The main feature of this framework is that it is a full DOM-Integrated architecture. Firstly, we discuss the advantages and the constraints raised by the implementation of proper interactive Virtual Signers within this full DOM-integrated approach. Secondly, we discuss an experimental study about Web-based Virtual Signers that take advantage of the specific interactivity provided by our framework. This study deals with a structure of Sign Language utterances that requires dynamic handling of spatio-temporal variability and coarticulation stances in the sign generation phase.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Losson, O., Cantegrit, B.: An assistive interface for learning lexical corpus employing a virtual signer. Technology and Accessibility 13(2), 83–94 (2000)
Braffort, A., Dalle, P.: Sign language applications: preliminary modeling. International journal “Universal Access in the Information Society” (UAIS), Special issue 6/4 “Emerging Technologies for Deaf Accessibility in the Information Society”. Springer, Heidelberg (2007)
Liddell, S.: Grammar, gesture and meaning in American Sign Language. Cambridge University Press, Cambridge (2003)
Cuxac, C.: La Langue des Signes Française (LSF): les voies de l’iconicité. Faits de langues 15-16, Ophrys (2000)
ScienceSign URL, the online BSL/English glossary for science education, http://www.sciencesigns.ac.uk
Adamo-Villani, N., Benes, B., Brisbin, M.: A natural interface for sign language mathematics. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Remagnino, P., Nefian, A., Meenakshisundaram, G., Pascucci, V., Zara, J., Molineros, J., Theisel, H., Malzbender, T. (eds.) ISVC 2006. LNCS, vol. 4291, pp. 70–79. Springer, Heidelberg (2006)
Heloir, A., Gibet, S., Multon, F., Courty, N.: Captured Motion Data Processing for Real Time Synthesis of Sign Language. In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS (LNAI), vol. 3881, pp. 168–171. Springer, Heidelberg (2006)
Elliott, R., Glauert, J., Jennings, V., Kennaway, J.R.: An Overview of the SiGML Notation and SiGML Signing Software System. In: Fourth International Conference on Language Resources and Evaluation, LREC 2004, pp. 98–104 (2004)
Prillwitz, S., Leven, R., Zienert, H., Hanke, T., Henning, J., et al.: Hamburg notation system for sign languages: An introductory guide, Institute of German Sign Language and Communication of the Deaf, University of Hamburg. International Studies on Sign Language and the Communication of the Deaf, vol. 5 (1989)
Avatar Signing Dictionary: Scottish BSL, http://www2.cmp.uea.ac.uk/~jrwg/Dictionary094/
Signing Science Dictionary (SSD), http://signsci.terc.edu/
Maes, P.: Agents that reduce work and information overload. CACM 37(7), 30–40 (1994)
Randall, N., Pedersen, I.: Who exactly is trying to help us? The ethos of help systems in popular computer applications. In: 16th Annual Int. Conf. on Computer Documentation, pp. 63–69. ACM, New York (1998)
Lester, J., Converse, S., et al.: The Persona Effect: Affective Impact of Animated Pedagogical Agents. In: CHI 1997 (1997)
Prendinger, H., Mayer, S., Mori, J., Ishizyka, M.: Persona Effect revisited: Using bio-signals to measure and reflect the impact of character-based interfaces. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds.) IVA 2003. LNCS (LNAI), vol. 2792, pp. 283–291. Springer, Heidelberg (2003)
Sansonnet, J.-P., Leray, D., Martin, J.-C.: Architecture of a Framework for Generic Assisting Conversational Agents. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 145–156. Springer, Heidelberg (2006)
Buisine, S., Abrilian, S., Rendu, C., Martin, J.-C.: Towards Experimental Specification and Evaluation of Lifelike Multimodal Behavior. In: Workshop on Embodied Conversational Agents at AAMAS (2002)
Segouat, J.: A study of sign language coarticulation. ACM SIGACCESS Accessibility and Computing (93), 31–38 (2009)
LIMSI Gestural Agents Home Page, http://www.limsi.fr/Individu/jps/online/diva/geste/geste.main.htm
Sansonnet, J.-P., Braffort, A., Segouat, J., Verrecchia, C.: SL Teacher: a Framework for teaching LSF on the Web. In: Second International Conference on ICT and Accessibility (2009)
Elliott, R., Glauer, J.R.W., Kennaway, J.R., Marshall, I., Safar, E.: Linguistic modeling and language-processing technologies for Avatar-based sign language presentation. In: Universaal Access in the Information Society, 6/4. Springer, Heidelberg (2008)
Huenerfauth, M.: Spatial, Temporal, and Semantic Models for American Sign Language Generation: Implications for Gesture Generation. Int. J. Semantic Computing 2(1), 21–45 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sansonnet, JP., Braffort, A., Verrecchia, C. (2010). Towards Interactive Web-Based Virtual Signers: First Step, a Platform for Experimentation Design. In: Kopp, S., Wachsmuth, I. (eds) Gesture in Embodied Communication and Human-Computer Interaction. GW 2009. Lecture Notes in Computer Science(), vol 5934. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12553-9_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-12553-9_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-12552-2
Online ISBN: 978-3-642-12553-9
eBook Packages: Computer ScienceComputer Science (R0)