Learning Observation Models for Dialogue POMDPs

  • Hamid R. Chinaei
  • Brahim Chaib-draa
  • Luc Lamontagne
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7310)


The SmartWheeler project aims at developing an intelligent wheelchair for handicapped people. In this paper, we model the dialogue manager of SmartWheeler in MDP and POMDP frameworks using its collected dialogues. First, we learn the model components of the dialogue MDP based on our previous works. Then, we extend the dialogue MDP to a dialogue POMDP, by proposing two observation models learned from dialogues: one based on learned keywords and the other based on learned intentions. The subsequent keyword POMDP and intention POMDP are compared based on accumulated mean reward in simulation runs. Our experimental results show that the quality of the intention model is significantly higher than the keyword one.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet Allocation. Journal of Machine Learning Research 3, 993–1022 (2003)zbMATHGoogle Scholar
  2. 2.
    Chinaei, H.R., Chaib-draa, B.: Learning Dialogue POMDP Models from Data. In: Butz, C., Lingras, P. (eds.) Canadian AI 2011. LNCS, vol. 6657, pp. 86–91. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  3. 3.
    Chinaei, H.R., Chaib-draa, B., Lamontagne, L.: Application of Hidden Topic Markov Models on Spoken Dialogue Systems. In: Filipe, J., Fred, A., Sharp, B. (eds.) ICAART 2009. CCIS, vol. 67, pp. 151–163. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  4. 4.
    Gruber, A., Rosen-Zvi, M., Weiss, Y.: Hidden Topic Markov Models. In: Artificial Intelligence and Statistics (AISTATS), San Juan, Puerto Rico (2007)Google Scholar
  5. 5.
    Pineau, J., Gordon, G., Thrun, S.: Point-based Value Iteration: An Anytime Algorithm for POMDPs. In: International Joint Conference on Artificial Intelligence (IJCAI), Acapulco, Mexico, pp. 1025–1032 (August 2003)Google Scholar
  6. 6.
    Pineau, J., West, R., Atrash, A., Villemure, J., Routhier, F.: On the Feasibility of Using a Standardized Test for Evaluating a Speech-Controlled Smart Wheelchair. International Journal of Intelligent Control and Systems 16(2), 124–131 (2011)Google Scholar
  7. 7.
    Williams, J.D., Young, S.: The SACTI-1 Corpus: Guide for Research Users. Cambridge University Department of Engineering. Technical report (2005)Google Scholar
  8. 8.
    Williams, J.D., Young, S.: Partially Observable Markov Decision Processes for Spoken Dialog Systems. Computer Speech and Language 21, 393–422 (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Hamid R. Chinaei
    • 1
  • Brahim Chaib-draa
    • 1
  • Luc Lamontagne
    • 1
  1. 1.Computer Science and Software Engineering DepartmentLaval UniversityQuebecCanada

Personalised recommendations