A Demonstration of the ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications

  • Jan KolkmeierEmail author
  • Merijn Bruijnes
  • Dennis Reidsma
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10498)


Modern game engines such as Unity make prototyping and developing experiences in virtual and mixed reality environments increasingly accessible and efficient, and their value has long been recognized by the scientific community as well. However, these game engines do not easily allow control of virtual embodied characters, situated in such environments, with the same expressiveness, flexibility, and generalizability, as offered by modern BML realizers that generate synchronized multimodal behavior from Behavior Markup Language (BML). We demonstrate our integration of the ASAP BML Realizer and the Unity3D game engine at the hand of an Augmented Reality setup. We further show an in-unity editor for BML animations in the same system.


BML SAIBA Virtual agents Unity Virtual reality Mixed reality 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kolkmeier, J., Bruijnes, M., Reidsma, D., Heylen, D.: An asap realizer-unity3d bridge for virtual and mixed reality applications. In: International Conference on Intelligent Virtual Agents. Springer (2017)Google Scholar
  2. 2.
    Kolkmeier, J., Lee, M., Heylen, D.: Moral conflicts in vr: addressing grade disputes with a virtual trainer. In: International Conference on Intelligent Virtual Agents. Springer (2017)Google Scholar
  3. 3.
    Kopp, S., van Welbergen, H., Yaghoubzadeh, R., Buschmeier, H.: An architecture for fluid real-time conversational agents: integrating incremental output generation and input processing. Journal on Multimodal User Interfaces 8(1), 97–108 (2014)Google Scholar
  4. 4.
    Linssen, J., Berkhoff, M., Bode, M., Rens, E., Theune, M., Wiltenburg, D.: You can leave your head on - attention management and turn-taking in multi-party interaction with a virtual human/robot duo. In: International Conference on Intelligent Virtual Agents. Springer (2017)Google Scholar
  5. 5.
    Van Welbergen, H., Yaghoubzadeh, R., Kopp, S.: AsapRealizer 2.0: the next steps in fluent behavior realization for ECAs. In: Bickmore, T., Marsella, S., Sidner, C. (eds.) IVA 2014. LNCS, vol. 8637, pp. 449–462. Springer, Cham (2014). doi: 10.1007/978-3-319-09767-1_56CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Jan Kolkmeier
    • 1
    Email author
  • Merijn Bruijnes
    • 1
  • Dennis Reidsma
    • 1
  1. 1.Human Media InteractionUniversity of TwenteEnschedeThe Netherlands

Personalised recommendations