Abstract
The paper presents the cognitive-model-based approach of abductive interpretation of emotions that it is used in the multi-modal dialog system SmartKom. The approach is based on the OCC model of emotions, that explains emotions by matches or mismatches of the attitudes of an agent with the state of affairs in the relevant situation. It is explained how eliciting conditions, i.e. abstract schemata for the explanation of emotions, can be instantiated with general or abstract concepts for attitudes and actions, and further enhanced with conditions and operators for generating reactions, which allow for abductive inference of explanations of emotional states and determination of reactions. During this process concepts that are initially abstract are made concrete. Emotions may work as a self-contained dialog move. They show a complex relation to explicit communication. Additionally we present our approach of analyzing indicators of emotions and user state, that come from different sources.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Picard, R. (ed.): Affective Computing. The MIT Press, Cambridge (1997)
Cornelius, R.R.: Theoretical Approaches to Emotion. In: Cowie, R., Douglas-Cowie, E., Schröder, M. (eds.) Proc. ISCA Workshop on Speech and Emotion, Newcastle, Northern Ireland, pp. 3–10 (2000)
Batliner, A., Fischer, K., Huber, R., Spilker, J., Nöth, E.: How to Find Trouble in Communication. Speech Communication 40, 117–143 (2003)
Batliner, A., Zeissler, V., Frank, C., Adelhardt, J., Shi, R.P., Nöth, E.: We are not amused - but how do you know? User states in a multi-modal dialogue system. In: Proc. European Conf. on Speech Communication and Technology, Geneva, Switzerland, vol. 1, pp. 733–736 (2003)
Batliner, A., Hacker, C., Steidl, S., Nöth, E., Haas, J.: User States, User Strategies, and System Performance: How to Match the One with the Other. In: Proc. of an ISCA tutorial and research workshop on error handling in spoken dialogue systems, Chateau d’Oex, ISCA, pp. 5–10 (2003)
Ortony, A., Clore, G., Collins, A. (eds.): The Cognitive Structue of Emotions. Cambridge University Press, Cambridge (1988)
Ang, J., Dhillon, R., Krupski, A., Shriberg, E., Stolcke, A.: Prosody-based automatic detection of annoyance and frustration in human-computer dialog. In: Proc. ICSLP 2002, pp. 2037–2040 (2002)
Adelhardt, J., Shi, R., Frank, C., Zeißler, V., Batliner, A., Nöth, E., Niemann, H.: Multimodal User State Recognition in a Modern Dialogue System. In: Günter, A., Kruse, R., Neumann, B. (eds.) KI 2003. LNCS (LNAI), vol. 2821, pp. 591–605. Springer, Heidelberg (2003)
Frank, C., Nöth, E.: Optimizing Eigenfaces by Face Masks for Facial Expression Recognition. In: Petkov, N., Westenberg, M.A. (eds.) CAIP 2003. LNCS, vol. 2756, pp. 1–13. Springer, Heidelberg (2003)
Wahlster, W.: SmartKom: Symmetric multimodality in an adaptive an reusable dialog shell. In: Proc. Human Computer Interaction Status Conference, Berlin (2003)
Portele, T.: Interaction Modeling in the SmartKom system. In: Proc. of an ISCA tutorial and research workshop on error handling in spoken dialogue systems, Chateau d’Oex, ISCA (2003)
Streit, M.: Context Dependend Error Handling by a three Layered Processing Model. In: Proc. of an ISCA tutorial and research workshop on error handling in spoken dialogue systems, Chateau d’Oex, ISCA (2003)
Prendinger, H., Descamps, S., Ishizuka, M.: Scripting affective Communication With Life-Like Characters in Web-Based Interaction Systems. Speech Communication 16, 519–553 (2002)
Peirce, C.: Abduction and Induction. In: Philo- sophical Writings of Pierce, pp. 150–156. Springer, Heidelberg (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Streit, M., Batliner, A., Portele, T. (2004). Cognitive-Model-Based Interpretation of Emotions in a Multi-modal Dialog System. In: André, E., Dybkjær, L., Minker, W., Heisterkamp, P. (eds) Affective Dialogue Systems. ADS 2004. Lecture Notes in Computer Science(), vol 3068. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24842-2_7
Download citation
DOI: https://doi.org/10.1007/978-3-540-24842-2_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22143-2
Online ISBN: 978-3-540-24842-2
eBook Packages: Springer Book Archive