User Modeling Optimization for the Conversational Human-Machine Interfaces

  • David GriolEmail author
  • José Manuel Molina
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 368)


In this paper, we test the applicability of a statistical user modeling technique to develop a simulated user agent that generates dialogs which are similar to real human-machine spoken interactions. The proposed user simulation technique decides the next response of the agent taking into account the previous user turns, the last system answer and the objective of the dialog. In our contribution, we present the results of the comparison between a corpus acquired from real interactions of users with a conversational agent and a corpus acquired by means of the proposed user simulation technique. To do so, we describe the practical application of our proposal for a conversational agent providing tourist information in natural language, employing a comprehensive set of measures for its evaluation.


Agent simulation User modeling Conversational agents Human machine interfaces Spoken interaction 



This work was supported in part by Projects MINECO TEC2012-37832-C02-01, CICYT TEC2011-28626-C02-02, CAM CONTEXTS (S2009/TIC-1485).


  1. 1.
    Macal C, North M (2010) Tutorial on agent-based modelling and simulation. J Simul 4:151–162CrossRefGoogle Scholar
  2. 2.
    Heath B, Hill R, Ciarallo F (2009) A survey of agent-based modeling practices (January 1998 to July 2008). JASSS 12(4)Google Scholar
  3. 3.
    Wilensky U, Rand W (2015) An introduction to agent-based modeling: modeling natural, social and engineered complex systems with NetLogo. MIT PressGoogle Scholar
  4. 4.
    North M, Collier N, Vos J (2006) Experiences creating three implementations of the repast agent modeling toolkit. ACM Trans Model Comput Simul 16:1–25CrossRefGoogle Scholar
  5. 5.
    Klgl F, Herrler R, Oechslein C (2003) From simulated to real environments: how to use SeSam for software development. LNCS 2831:13–24Google Scholar
  6. 6.
    Barnard E, Halberstadt A, Kotelly C, Phillips M (1999) A consistent approach to designing spoken-dialog systems. In: Proceedings of the ASRU, pp 1173–1176Google Scholar
  7. 7.
    Pieraccini R, Huerta J (2005) Where do we go from here? research and commercial spoken dialog systems. In: Proceedings of the SIGdial, pp 1–10Google Scholar
  8. 8.
    Williams J (2009) The best of both worlds: unifying conventional dialog systems and pomdps. In: Proceedings of the InterSpeech, pp 1173–1176Google Scholar
  9. 9.
    Cohen M, Giangola J, Balough J (2004) Voice user interface design. Addison WesleyGoogle Scholar
  10. 10.
    Paek T, Pieraccini R (2008) Automating spoken dialogue management design using machine learning: an industry perspective. Speech Commun 50(8–9):716–729CrossRefGoogle Scholar
  11. 11.
    Möller S, Englert R, Engelbrecht K, Hafner V, Jameson A, Oulasvirta A, Raake A, Reithinger N (2006) MeMo: towards automatic usability evaluation of spoken dialogue services by user error simulations. In: Proceedings of the Interspeech, pp 1786–1789Google Scholar
  12. 12.
    Schatzmann J, Weilhammer K, Stuttle M, Young S (2006) A survey of statistical user simulation techniques for reinforcement-learning of dialogue management strategies. Knowl Eng Rev 21(2):97–126CrossRefGoogle Scholar
  13. 13.
    Schatzmann J, Georgila K, Young S (2005) Quantitative evaluation of user simulation techniques for spoken dialogue systems. In: Proceedings of the SIGdial, pp 45–54Google Scholar
  14. 14.
    Ai H, Raux A, Bohus D, Eskenazi M, Litman D (2007) Comparing spoken dialog corpora collected with recruited subjects versus real users. In: Proceedings of the SIGdial, pp 124–131Google Scholar
  15. 15.
    Griol D, Callejas Z, López-Cózar R, Riccardi G (2014) A domain-independent statistical methodology for dialog management in spoken dialog systems. Comput Speech Lang 28(3)Google Scholar
  16. 16.
    Schatzmann J, Thomson B, Weilhammer K, Ye H, Young S (2007) Agenda-based user simulation for bootstrapping a pomdp dialogue system. In: Proceedings of the HLT/NAACL, pp 149–152Google Scholar
  17. 17.
    Griol D, Molina J, Callejas Z (2012) Bringing together commercial and academic perspectives for the development of intelligent Am I interfaces. JAISE 4(3):183–207Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Computer Science DepartmentCarlos III University of MadridLeganésSpain

Personalised recommendations