Chapter

Intelligent Virtual Agents

Volume 4722 of the series Lecture Notes in Computer Science pp 161-174

T2D: Generating Dialogues Between Virtual Agents Automatically from Text

  • Paul PiwekAffiliated withNLG Group, Centre for Research in Computing, The Open University, Walton Hall, Milton Keynes MK7 6AA
  • , Hugo HernaultAffiliated withNational Institute of Informatics, 2-1-2 Hitotsubashi, Chiyoda-ku, Tokyo 101-8430
  • , Helmut PrendingerAffiliated withNational Institute of Informatics, 2-1-2 Hitotsubashi, Chiyoda-ku, Tokyo 101-8430
  • , Mitsuru IshizukaAffiliated withGraduate School of Information Science and Technology, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656

* Final gross prices may vary according to local VAT.

Get Access

Abstract

The Text2Dialogue (T2D) system that we are developing allows digital content creators to generate attractive multi-modal dialogues presented by two virtual agents—by simply providing textual information as input. We use Rhetorical Structure Theory (RST) to decompose text into segments and to identify rhetorical discourse relations between them. These are then “acted out” by two 3D agents using synthetic speech and appropriate conversational gestures. In this paper, we present version 1.0 of the T2D system and focus on the novel technique that it uses for mapping rhetorical relations to question–answer pairs, thus transforming (monological) text into a form that supports dialogues between virtual agents.