Abstract
The Information State Update (ISU) Model describes an approach to dialog management that was predominantly applied to single user scenarios using voice as the only modality. Extensions to multimodal interaction with multiple users are rarely considered and, if presented, hard to operationalize. In this paper we describe our approach of dialog modeling based on ISU in multiuser dialog settings employing multiple modalities, including nonverbal communication.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bohus, D., Horvitz, E.: Facilitating multiparty dialog with gaze, gesture, and speech. In: International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, p. 5. ACM (2010)
Bos, J., Klein, E., Lemon, O., Oka, T.: Dipper: Description and formalisation of an information-state update dialogue system architecture. In: 4th SIGdial Workshop on Discourse and Dialogue, pp. 115–124 (2003)
Bunt, H.: Dynamic interpretation and dialogue theory. The Structure of Multimodal Dialogue 2, 1–8 (1999)
Fodor, P., Huerta, J.M.: Planning and logic programming for dialog management. In: Spoken Language Technology Workshop, pp. 214–217. IEEE (2006)
Ginzburg, J., Fernández, R.: Action at a distance: the difference between dialogue and multilogue. Proceedings of DIALOR 5 (2005)
Honold, F., Schussel, F., Weber, M., Nothdurft, F., Bertrand, G., Minker, W.: Context models for adaptive dialogs and multimodal interaction. In: 2013 9th International Conference on Intelligent Environments (IE), pp. 57–64. IEEE (2013)
Kronlid, F., Lager, T.: Implementing the information-state update approach to dialogue management in a slightly extended scxml. In: Proceedings of the 11th International Workshop on the Semantics and Pragmatics of Dialogue (DECALOG), pp. 99–106 (2007)
Kronlid, F.: Steps towards Multi-Party Dialogue Management. Ph.D. thesis, Göteborgs Universitet (April 2008)
Larsson, S., Traum, D.: Information state and dialogue management in the TRINDI dialogue move engine toolkit. Natural Language Engineering 6(3&4), 323–340 (2000)
Radomski, S., Schnelle-Walka, D., Radeck-Arneth, S.: A Prolog Datamodel for State Chart XML. In: SIGdial Workshop on Discourse and Dialogue (2013) (pre-print)
Sacks, H., Schegloff, E.A., Jefferson, G.: A simplest systematics for the organization of turn-taking for conversation. Language, 696–735 (1974)
Strauß, P.M., Minker, W.: Fundamentals. In: Proactive Spoken Dialogue Interaction in Multi-Party Environments, pp. 17–49. Springer (2010)
Traum, D., Rickel, J.: Embodied agents for multi-party dialogue in immersive virtual worlds. In: Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems: Part 2, pp. 766–773. ACM (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Schnelle-Walka, D., Radomski, S., Radeck-Arneth, S., Mühlhäuser, M. (2014). Towards an Information State Update Model Approach for Nonverbal Communication. In: Miesenberger, K., Fels, D., Archambault, D., Peňáz, P., Zagler, W. (eds) Computers Helping People with Special Needs. ICCHP 2014. Lecture Notes in Computer Science, vol 8547. Springer, Cham. https://doi.org/10.1007/978-3-319-08596-8_36
Download citation
DOI: https://doi.org/10.1007/978-3-319-08596-8_36
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08595-1
Online ISBN: 978-3-319-08596-8
eBook Packages: Computer ScienceComputer Science (R0)