Chapter

Intelligent Virtual Agents

Volume 4133 of the series Lecture Notes in Computer Science pp 205-217

Towards a Common Framework for Multimodal Generation: The Behavior Markup Language

  • Stefan KoppAffiliated withArtificial .Intelligence Group, University of Bielefeld
  • , Brigitte KrennAffiliated withAustrian Research Institute for AI (OFAI)
  • , Stacy MarsellaAffiliated withInformation Sciences Institute, University of Southern California
  • , Andrew N. MarshallAffiliated withInformation Sciences Institute, University of Southern California
  • , Catherine PelachaudAffiliated withIUT de Montreuil, University de Paris 8
  • , Hannes PirkerAffiliated withAustrian Research Institute for AI (OFAI)
  • , Kristinn R. ThórissonAffiliated withCADIA, Dept. Of Computer Science, Reykjavik University
  • , Hannes VilhjálmssonAffiliated withInformation Sciences Institute, University of Southern California

Abstract

This paper describes an international effort to unify a multimodal behavior generation framework for Embodied Conversational Agents (ECAs). We propose a three stage model we call SAIBA where the stages represent intent planning, behavior planning and behavior realization. A Function Markup Language (FML), describing intent without referring to physical behavior, mediates between the first two stages and a Behavior Markup Language (BML) describing desired physical realization, mediates between the last two stages. In this paper we will focus on BML. The hope is that this abstraction and modularization will help ECA researchers pool their resources to build more sophisticated virtual humans.