A Demonstration of the ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications
Modern game engines such as Unity make prototyping and developing experiences in virtual and mixed reality environments increasingly accessible and efficient, and their value has long been recognized by the scientific community as well. However, these game engines do not easily allow control of virtual embodied characters, situated in such environments, with the same expressiveness, flexibility, and generalizability, as offered by modern BML realizers that generate synchronized multimodal behavior from Behavior Markup Language (BML). We demonstrate our integration of the ASAP BML Realizer and the Unity3D game engine at the hand of an Augmented Reality setup. We further show an in-unity editor for BML animations in the same system.
KeywordsBML SAIBA Virtual agents Unity Virtual reality Mixed reality
Unable to display preview. Download preview PDF.
- 1.Kolkmeier, J., Bruijnes, M., Reidsma, D., Heylen, D.: An asap realizer-unity3d bridge for virtual and mixed reality applications. In: International Conference on Intelligent Virtual Agents. Springer (2017)Google Scholar
- 2.Kolkmeier, J., Lee, M., Heylen, D.: Moral conflicts in vr: addressing grade disputes with a virtual trainer. In: International Conference on Intelligent Virtual Agents. Springer (2017)Google Scholar
- 3.Kopp, S., van Welbergen, H., Yaghoubzadeh, R., Buschmeier, H.: An architecture for fluid real-time conversational agents: integrating incremental output generation and input processing. Journal on Multimodal User Interfaces 8(1), 97–108 (2014)Google Scholar
- 4.Linssen, J., Berkhoff, M., Bode, M., Rens, E., Theune, M., Wiltenburg, D.: You can leave your head on - attention management and turn-taking in multi-party interaction with a virtual human/robot duo. In: International Conference on Intelligent Virtual Agents. Springer (2017)Google Scholar