Modeling Human-Agent Interaction Using Bayesian Network Technique
Task manipulation is direct evidence of understanding, and speakers adjust their utterances that are in progress by monitoring listener’s task manipulation. Aiming at developing animated agents that control multimodal instruction dialogues by monitoring users’ task manipulation, this paper presents a probabilistic model of fine-grained timing dependencies among multimodal communication behaviors. Our preliminary evaluation demonstrated that our model quite accurately judges whether the user understand the agent’s utterances and predicts user’s successful mouse manipulation, suggesting that the model is useful in estimating user’s understanding and can be applied to determining the next action of an agent.
KeywordsBayesian Network Target Object Nonverbal Behavior Task Manipulation Bayesian Network Model
Unable to display preview. Download preview PDF.
- 3.Paek, T., Horvitz, E.: Uncertainty, Utility, and Misunderstanding: A Decision-Theoretic Perspective on Grounding in Conversational Systems. In: Brennan, S.E., Giboin, A., Traum, D. (eds.) Working Papers of the AAAI Fall Symposium on Psychological Models of Communication in Collaborative Systems, American Association for Artificial Intelligence, Menlo Park, California. pp. 85–92 (1999)Google Scholar
- 4.Horvitz, E., et al.: The Lumiere Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users. In: Proceedings of Fourteenth Conference on Uncertainty in Artificial Intelligence, pp. 256–265 (1998)Google Scholar
- 5.Kipp, M.: Gesture Generation by Imitation - From Human Behavior to Computer Character Animation, Boca Raton, Florida: Dissertation.com (2004)Google Scholar