Journal on Multimodal User Interfaces

, Volume 3, Issue 1–2, pp 141–153

Natural interaction with a virtual guide in a virtual environment

A multimodal dialogue system
  • Dennis Hofs
  • Mariët Theune
  • Rieks op den Akker
Open Access
Original Paper

Abstract

This paper describes the Virtual Guide, a multimodal dialogue system represented by an embodied conversational agent that can help users to find their way in a virtual environment, while adapting its affective linguistic style to that of the user. We discuss the modular architecture of the system, and describe the entire loop from multimodal input analysis to multimodal output generation. We also describe how the Virtual Guide detects the level of politeness of the user’s utterances in real-time during the dialogue and aligns its own language to that of the user, using different politeness strategies. Finally we report on our first user tests, and discuss some potential extensions to improve the system.

Conversational agent Application Social interaction Politeness Multimodal analysis and generation 

Copyright information

© The Author(s) 2009

Authors and Affiliations

  • Dennis Hofs
    • 1
  • Mariët Theune
    • 1
  • Rieks op den Akker
    • 1
  1. 1.Human Media InteractionUniversity of TwenteEnschedeThe Netherlands

Personalised recommendations