Continuous Interaction within the SAIBA Framework

  • Job Zwiers
  • Herwin van Welbergen
  • Dennis Reidsma
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6895)


We propose extensions to the SAIBA BML language, aiming in particular to specify reactive behavior and continuous interaction. Examples of interaction scenarios are provided that illustrate the usefulness of these extensions. The impact on the SAIBA architecture is discussed.


Behavior Plan Reactive Behavior Behavior Realizer Continuous Interaction Virtual Human 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bevacqua, E., Prepin, E., de Sevin, R., Niewiadomski, R., Pelachaud, C.: Reactive behaviors in saiba architecture. In: Workshop Towards a Standard Markup Language for Embodied Dialogue Acts, held in conjunction with AAMAS 2009 (2009)Google Scholar
  2. 2.
    Clark, H.H.: Using language. Cambridge University Press, Cambridge (1996)Google Scholar
  3. 3.
    Gratch, J., Okhmatovskaia, A., Lamothe, F., Marsella, S.C., Morales, M., van der Werf, R.J., Morency, L.-P.: Virtual rapport. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 14–27. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  4. 4.
    Heylen, D., Kopp, S., Marsella, S.C., Pelachaud, C., Vilhjálmsson, H.H.: The next step towards a function markup language. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 270–280. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  5. 5.
    Kopp, S., Krenn, B., Marsella, S.C., Marshall, A.N., Pelachaud, C., Pirker, H., Thórisson, K.R., Vilhjálmsson, H.H.: Towards a common framework for multimodal generation: The behavior markup language. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 205–217. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  6. 6.
    Kopp, S., Stocksmeier, T., Gibbon, D.: Incremental multimodal feedback for conversational agents. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 139–146. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  7. 7.
    McNeill, D.: Hand and Mind: What Gestures Reveal about Thought. University of Chicago Press, Chicago (1995)Google Scholar
  8. 8.
    Perlin, K., Goldberg, A.: Improv: a system for scripting interactive actors in virtual worlds. In: SIGGRAPH, pp. 205–216. ACM, New York (1996)Google Scholar
  9. 9.
    Schmidt, R.C., Richardson, M.: Dynamics of interpersonal coordination. In: Fuchs, A., Jirsa, V. (eds.) Coordination: Neural, Behavioral and Social Dynamics. Understanding Complex Systems, vol. 17, pp. 281–308. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  10. 10.
    Thiebaux, M., Marshall, A.N., Marsella, S.C., Kallmann, M.: Smartbody: Behavior realization for embodied conversational agents. In: Autonomous Agents and Multiagent Systems, pp. 151–158 (2008)Google Scholar
  11. 11.
    Thórisson, K.R.: Gandalf: an embodied humanoid capable of real-time multimodal dialogue with people. In: Autonomous Sgents, pp. 536–537. ACM, New York (1997)Google Scholar
  12. 12.
    Thórisson, K.R., Vilhjálmsson, H.H.: Functional description of multimodal acts: A proposal. In: Function Markup Language Workshop at AAMAS 2009 (2009)Google Scholar
  13. 13.
    van Welbergen, H., Reidsma, D., Ruttkay, Z.M., Zwiers, J.: Elckerlyc: A BML realizer for continuous, multimodal interaction with a virtual human. Journal on Multimodal User Interfaces 3(4), 271–284 (2010)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Job Zwiers
    • 1
  • Herwin van Welbergen
    • 1
  • Dennis Reidsma
    • 1
  1. 1.Human Media InteractionUniversity of TwenteThe Netherlands

Personalised recommendations