Abstract
We introduce an approach to multimodal generation of verbal and nonverbal contributions for virtual characters in a multiparty dialogue scenario. This approach addresses issues of turn-taking, is able to synchronize the different modalities in real-time, and supports fixed utterances as well as utterances that are assembled by a full-fledged tree-based text generation algorithm. The system is implemented in a first version as part of the second VirtualHuman demonstrator.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Becker, T.: Natural Language Generation with Fully Specified Templates. In: Wahlster, W. (ed.) SmartKom: Foundations of Multimodal Dialogue Systems. Springer, Heidelberg (2006)
Engel, R.: SPIN: Language Understanding for Spoken Dialogue Systems Using a Production System Approach. In: Proc. of 7th ICSLP, Denver (2002)
Kempe, B.: PATE - a Production Rule System based on Activation and Typed Feature Structure Elements, Bachelor Thesis, Saarland University, Saarbrücken (2004)
Löckelt, M.: Action Planning for Virtual Human Performances. In: Subsol, G. (ed.) ICVS-VirtStory 2005. LNCS, vol. 3805, pp. 53–62. Springer, Heidelberg (2005)
Pfleger, N.: FADE - An Integrated Approach to Multimodal Fusion and Discourse Processing. To appear in Proceedings of the Doctoral Spotlight Session of ICMI (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kempe, B., Pfleger, N., Löckelt, M. (2005). Generating Verbal and Nonverbal Utterances for Virtual Characters. In: Subsol, G. (eds) Virtual Storytelling. Using Virtual Reality Technologies for Storytelling. ICVS 2005. Lecture Notes in Computer Science, vol 3805. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11590361_8
Download citation
DOI: https://doi.org/10.1007/11590361_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30511-8
Online ISBN: 978-3-540-32285-6
eBook Packages: Computer ScienceComputer Science (R0)