Towards a Reactive Virtual Trainer

  • Zsófia Ruttkay
  • Job Zwiers
  • Herwin van Welbergen
  • Dennis Reidsma
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4133)


A Reactive Virtual Trainer (RVT) is an Intelligent Virtual Agent (IVA) capable of presenting physical exercises that are to be performed by a human, monitoring the user and providing feedback at different levels. Depending on the motivation and the application context, the exercises may be general ones of fitness to improve the user’s physical condition, special exercises to be performed from time to time during work to prevent for example RSI, or physiotherapy exercises with medical indications. In the paper we discuss the functional and technical requirements of a framework which can be used to author specific RVT applications. The focus is on the reactivity of the RVT, manifested in natural language comments on readjusting the tempo, pointing out mistakes or rescheduling the exercises. We outline the components we have implemented so far: our animation engine, the composition of exercises from basic motions and the module for analysis of tempo in acoustic input.


Motion Capture Basic Motion Embody Conversational Agent Physiotherapy Exercise Expressive Gesture 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Abdel-Malek, K., Yang, J., Mi, Z., Patel, V.C., Nebel, K.: Human Upper Body Motion Prediction. In: Conference on Applied Simulation and Modeling (ASM), Rhodes, Greece, June 28-30 (2004)Google Scholar
  2. 2.
    Badler, N., Bindiganavale, R., Allbeck, J., Schuler, W., Zhao, L., Palmer, M.: Parameterized Action Representation for Virtual Human Agents. In: [5], pp. 256–284Google Scholar
  3. 3.
    Bickmore, T., Cassell, J.: Social Dialogue with Embodied Conversational Agents. In: van Kuppevelt, J., Dybkjaer, L., Bernsen, N. (eds.) Natural, Intelligent and Effective Interaction with Multimodal Dialogue Systems. Kluwer Academic Publishers, New York (in press)Google Scholar
  4. 4.
    Bickmore, T., Picard, R.: Towards caring machines. In: Proc. of CHI (2004)Google Scholar
  5. 5.
    Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.): Embodied Conversational Agents. MIT Press, Cambridge (2000)Google Scholar
  6. 6.
    Chao, S.-P., Chiu, C.-Y., Yang, S.-N., Lin, T.-G.: Tai Chi synthesizer: a motion synthesis framework based on key-postures and motion instructions. Computer Animation and Virtual Worlds 15, 259–268 (2004)CrossRefGoogle Scholar
  7. 7.
  8. 8.
    Hartmann, B., Mancini, M., Pelachaud, C.: Implementing Expressive Gesture Synthesis for Embodied Conversational Agents. In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS (LNAI), vol. 3881, pp. 188–199. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  9. 9.
  10. 10.
    IJsselsteijn, W., de Kort, Y., Westerink, J., De Jager, M., Bonants, R.: Fun and Sports: Enhancing the Home Fitness Experience. In: Rauterberg, M. (ed.) ICEC 2004. LNCS, vol. 3166, pp. 46–56. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  11. 11.
    International Workshop on Virtual Rehabilitation (2005),
  12. 12.
    Lewis Johnson, W., Rizzo, P., Bosma, W.E., Kole, S., Ghijsen, M., van Welbergen, H.: Generating socially appropriate tutorial dialog. In: ISCA Workshop on Affective Dialogue Systems, Kloster Irsee, Germany, pp. 254–264 (2004) ISBN 3-540-22143-3Google Scholar
  13. 13.
    Kim, T.H., Park, S.I., Shin, S.Y.: Rhythmic-motion synthesis based on motion-beat analysis. ACM Trans. on Graphics 22(3), 392–401 (2003)CrossRefGoogle Scholar
  14. 14.
    Klapuri, A., Eronen, A., Astola, J.: Analysis of the meter of acoustic musical signals. IEEE transactions on Speech and Audio Processing (2006)Google Scholar
  15. 15.
    Mandel, M., Zordan, V.: Beyond Ragdolls: Generating Versatile Human Behaviors by Combining Motion Capture and Controlled Physical Simulation. In: Proceedings of Game Developer’s Conference (GDC) (2005)Google Scholar
  16. 16.
    Marsella, S., Johnson, L., LaBore, C.: Interactive Pedagogical Drama for Health Interventions. In: AIED 2003, 11th International Conference on Artificial Intelligence in Education, Australia (2003)Google Scholar
  17. 17.
    Monitoring, measuring and motivating exercise ubiquitous computing to support fitness, Workshop at Ubicomp 2005, Tokyo (September 11, 2005),
  18. 18.
    Noot, H., Ruttkay, Z.: Style in Gesture. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 324–337. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  19. 19.
    Perlin, K.: Ken: An Image Synthesizer. In: Proceedings of SIGGRAPH 1985, pp. 287–296 (1985)Google Scholar
  20. 20.
    Reidsma, D., Nijholt, A., Poppe, R., Rienks, R., Hondorp, H.: Virtual rap dancer: Invitation to dance. In: Proceedings ACM CHI 2006 (Extended Abstracts), Montreal (April 2006) (to appear)Google Scholar
  21. 21.
    Ruttkay, Z., Huang, Z., Eliens, A.: Reusable Gestures for Interactive Web Agents. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds.) IVA 2003. LNCS (LNAI), vol. 2792, pp. 80–87. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  22. 22.
    Shafaei, S., Rahmati, M.: Physiotherapy Virtual Training by Computer Vision Approach. In: Third International Workshop on Virtual Rehabilitation (2004),
  23. 23.
    Takaaki, S., Atsushi, N., Ikeuchi, K.: Rhythmic Motion Analysis using Motion Capture and Musical Information. In: Proc. of 2003 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, pp. 89–94 (2003)Google Scholar
  24. 24.
  25. 25.
    Tweed, D.: A three-dimensional model of the human eye-head saccadic system. J. Neuro-physiol. 77, 654–666 (1997)Google Scholar
  26. 26.
    van Welbergen, H., Nijholt, A., Reidsma, D., Zwiers, J.: Presenting in Virtual Worlds: Towards an Architecture for a 3D Presenter explaining 2D-Presented Information. IEEE transcactions on Intelligent Systems, special issue Intelligent Technologies for Interactive Entertainment (September/October 2006) (to appear)Google Scholar
  27. 27.
    Westerink, J., de Jager, M., de Kort, Y., IJsselsteijn, W., Bonants, R., Vermeulen, J., van Herk, J., Roersma, M.: Raising Motivation in Home Fitnessing: Effects of a Virtual Landscape and a Virtual Coach with Various Coaching Styles. In: ISSP 11th World Congress of Sport Psychology, Sydney, Australia (August 15 - 19, 2005)Google Scholar
  28. 28.
    The World Health Organization warns of the rising threat of heart disease and stroke as over-weight and obesity rapidly increase,

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Zsófia Ruttkay
    • 1
  • Job Zwiers
    • 1
  • Herwin van Welbergen
    • 1
  • Dennis Reidsma
    • 1
  1. 1.HMI,Dept. of CSUniversity of TwenteEnschedeThe Netherlands

Personalised recommendations