Advertisement

Demonstrating and Testing the BML Compliance of BML Realizers

  • Herwin van Welbergen
  • Yuyu Xu
  • Marcus Thiebaux
  • Wei-Wen Feng
  • Jingqiao Fu
  • Dennis Reidsma
  • Ari Shapiro
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6895)

Abstract

BML realizers are complex software modules that implement a standardized interface –the BML specification language– to steer the behavior of a virtual human. We aim to promote and test the compliance of realizers that implement this interface. To this end we contribute a corpus of example BML scripts and a tool called RealizerTester that can be used to formally test and maintain adherence of realizers to the BML standard. The standardized interface of realizers allowed us to implement RealizerTester as an automatic testing framework that can test any realizer. RealizerTester can 1) help in maintaining the stability and extensibility that is crucial for realizers and 2) contribute to the formalization of the emerging BML standard, both by providing test scripts and a formal description of their constraints and by identifying and resolving execution inconsistencies between realizers. We illustrate the testing practices used in the development of two realizers and demonstrate how RealizerTester is integrated with these practices. The scripts in the example corpus were executed on both realizers. This resulted in a video corpus that demonstrates the semantic equivalences and differences in execution of BML scripts by the two realizers.

Keywords

Automatic Testing Software Development Process Virtual Human Feedback Message Facial Action Code System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Supplementary material

978-3-642-23974-8_30_MOESMa_ESM.wmv (17.9 mb)
Electronic Supplementary material (1 KB)

References

  1. 1.
    Personal communication with the authors of SmartBody, Greta, EMBR, and RealActor (2010)Google Scholar
  2. 2.
    Čereković, A., Pandžić, I.S.: Multimodal behavior realization for embodied conversational agents. In: Multimedia Tools and Applications, pp. 1–22 (2010)Google Scholar
  3. 3.
    Ekman, P., Friesen, W.: Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto (1978)Google Scholar
  4. 4.
    Heloir, A., Kipp, M.: Real-time animation of interactive agents: Specification and realization. Applied Artificial Intelligence 24(6), 510–529 (2010)CrossRefGoogle Scholar
  5. 5.
    Kopp, S., Krenn, B., Marsella, S., Marshall, A.N., Pelachaud, C., Pirker, H., Thórisson, K.R., Vilhjálmsson, H.H.: Towards a common framework for multimodal generation: The behavior markup language. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 205–217. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  6. 6.
    Mancini, M., Niewiadomski, R., Bevacqua, E., Pelachaud, C.: Greta: a saiba compliant eca system. In: Troisiéme Workshop sur les Agents Conversationnels Animés (2008)Google Scholar
  7. 7.
    Meszaros, G.: xUnit Test Patterns: Refactoring Test Code. Addison-Wesley, Reading (2007)Google Scholar
  8. 8.
    Thiebaux, M., Marshall, A.N., Marsella, S., Kallmann, M.: Smartbody: Behavior realization for embodied conversational agents. In: Autonomous Agents and Multiagent Systems, pp. 151–158 (2008)Google Scholar
  9. 9.
    Vilhjálmsson, H.H., Cantelmo, N., Cassell, J., Chafai, N.E., Kipp, M., Kopp, S., Mancini, M., Marsella, S.C., Marshall, A.N., Pelachaud, C., Ruttkay, Z., Thórisson, K.R., van Welbergen, H., van der Werf, R.J.: The behavior markup language: Recent developments and challenges. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 99–111. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  10. 10.
    van Welbergen, H., Reidsma, D., Ruttkay, Z.M., Zwiers, J.: Elckerlyc: A BML realizer for continuous, multimodal interaction with a virtual human. Journal on Multimodal User Interfaces 3(4), 271–284 (2010)CrossRefGoogle Scholar
  11. 11.
    Yee, Y.H., Newman, A.: A perceptual metric for production testing. In: ACM SIGGRAPH Sketches, p. 121. ACM, New York (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Herwin van Welbergen
    • 1
  • Yuyu Xu
    • 2
  • Marcus Thiebaux
    • 2
  • Wei-Wen Feng
    • 2
  • Jingqiao Fu
    • 2
  • Dennis Reidsma
    • 1
  • Ari Shapiro
    • 2
  1. 1.Human Media InteractionUniversity of TwenteThe Netherlands
  2. 2.Institute for Creative TechnologiesUniversity of Southern CaliforniaUSA

Personalised recommendations