Advertisement

Dialog Strategy Acquisition and Its Evaluation for Efficient Learning of Word Meanings by Agents

  • Ryo Taguchi
  • Kouichi Katsurada
  • Tsuneo Nitta
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4211)

Abstract

In word meaning acquisition through interactions among humans and agents, the efficiency of the learning depends largely on the dialog strategies the agents have. This paper describes automatic acquisition of dialog strategies through interaction between two agents. In the experiments, two agents infer each other’s comprehension level from its facial expressions and utterances to acquire efficient strategies. Q-learning is applied to a strategy acquisition mechanism. Firstly, experiments are carried out through the interaction between a mother agent, who knows all the word meanings, and a child agent with no initial word meaning. The experimental results showed that the mother agent acquires a teaching strategy, while the child agent acquires an asking strategy. Next, the experiments of interaction between a human and an agent are investigated to evaluate the acquired strategies. The results showed the effectiveness of both strategies of teaching and asking.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Roy, D.: Integration of speech and vision using mutual information. In: Proc. ICASSP, vol. 4, pp. 2369–2372 (2000)Google Scholar
  2. 2.
    Iwahashi, N.: Language acquisition through a human-robot interface by combining speech, visual, and behavioral information. Information Sciences 156, 109–121 (2003)CrossRefGoogle Scholar
  3. 3.
    Singh, S., Kearns, M., Litman, D., Walker, M.: Empirical Evaluation of Reinforcement Learning Spoken Dialog System. In: Proc. AAAI, pp. 645–651 (2000)Google Scholar
  4. 4.
    Levin, E., Pieraccini, R., Eckert, W.: A stochastic model of human-machine interaction for learning dialog strategies. IEEE Transactions on Speech and Audio Processing 8(1), 11–23 (2000)CrossRefGoogle Scholar
  5. 5.
    Taguchi, R., Katsurada, K., Nitta, T.: Automatic Acquisition of Dialog Strategies for Concept Learning through Interaction among Agents. In: Zhang, J., He, J.-H., Fu, Y. (eds.) CIS 2004 (FM7.1). LNCS, vol. 3314. Springer, Heidelberg (2004)Google Scholar
  6. 6.
    Watkins, C.J.C.H., Dayan, P.: Technical Note: Q-learning. Machine Learning 8, 279–292 (1992)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Ryo Taguchi
    • 1
  • Kouichi Katsurada
    • 1
  • Tsuneo Nitta
    • 1
  1. 1.Graduate School of Engineering, Toyohashi University of TechnologyToyohashi-cityJapan

Personalised recommendations