Combining Motion Capture and Digital Human Modeling for Creating Instructions in Industrial Settings

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8026)


In this paper, a hybrid framework for creating an instruction video by means of motion capture technologies will be explained. In this video an animated pedagogical agent named Anastasia (animated assistant for tasks in industrial applications) provides human operators with assistance while performing maintenance tasks in IPS2. Firstly, the paper contains a description of the creation process of an animated pedagogical agent which will be illustrated step by step on Anastasia. Secondly, the motion capture technology in form of a data glove will be presented. Thirdly, the concept and implementation how to improve realism of Anastasia by using the data glove will be introduced.


animated pedagogical agent instruction video human modeling motion capturing data glove wearable computing technologies smart clothes 


  1. 1.
    Bergler, C.: Motion capture technology for entertainment. IEEE Signal Processing Magazine 24(6), 158–160 (2007)Google Scholar
  2. 2.
    Brodie, M., Walmsley, A., Page, W.: Fusion motion capture: a prototype system using inertial measurement units and GPS for the biomechanical analysis of ski racing. Sports Technologies 1(1), 17–28 (2008)CrossRefGoogle Scholar
  3. 3.
    Fröhlich, B., Plate, J.: The cubic mouse: A new device for three-dimensional input. In: CHI, pp. 526–531. ACM Press (2000)Google Scholar
  4. 4.
  5. 5.
    Johnson, W.L., Rickel, J.W., Lester, J.C.: Animated pedagogical agents: Face-to-face interaction in interactive learning environments. International Journal of Artificial Intelligence in Education 11, 47–78 (2000)Google Scholar
  6. 6.
    Lester, J.C.: The persona effect: Affective impact of animated pedagogical agents. In: Human Factors in Computing Systems, pp. 359–366 (1997)Google Scholar
  7. 7.
    Lopiccolo, P.: What are ’veople’ for? Computer Graphics World 25(11), 4–5 (2002)Google Scholar
  8. 8.
    Mase, K.: Aspects of interface agents: Avatar, assistant and actor. International Joint Conferences on Artificial Intelligence. In: Workshop on Animated Interface Agents, pp. 33–37 (1997)Google Scholar
  9. 9.
    Reason, J.: Human Error, 2nd edn. Cambridge University Press (2003)Google Scholar
  10. 10.
    Rickel, J.W.: Intelligent virtual agents for education and training: Opportunities and challenges. In: International Conference on Intelligent Virtual Agents, pp. 15–22 (2001)Google Scholar
  11. 11.
    Rickel, J.W., Johnson, W.L.: Animated agents for procedural training in virtual reality: Perception, cognition, and motor control. Applied Artificial Intelligence 13, 343–382 (1999)CrossRefGoogle Scholar
  12. 12.
    Sheridan, T.B.: Telerobotics, Automation and Human Supervisory Control. MIT Press, Cambridge (1992)Google Scholar
  13. 13.
    Schmuntzsch, U., Rötting, M.: Multimodal user interfaces in IPS2. In: International Conference on Digital Human Modeling in the Context of HCI International, pp. 347–356 (2011)Google Scholar
  14. 14.
    Schmuntzsch, U., Sturm, C., Reichmuth, R., Rötting, M.: Virtual agent assistance for maintenance tasks in IPS2. Advances in Ergonomics in Manufacturing, 221 – 231 (2012)Google Scholar
  15. 15.
    Schmuntzsch, U., Yılmaz, U., Reichmuth, R., Rötting, M.: A first approach to generate hybrid animations for maintenance tasks in IPS2. In: Intern. Conf. on Cognitive Modeling (2012)Google Scholar
  16. 16.
    Thalmann, D.: Autonomy and task-level control for virtual actors. Programming and Computer Software 21(4), 202–211 (1995)Google Scholar
  17. 17.
    Uhlmann, E., Meier, H., Stelzer, C., Geisert, C., Bochnig, H., Sadek, K.: Design of PSS based on customer requirements. In: First International Seminar on PSS, Bochum (2008)Google Scholar
  18. 18.
    VRealities: Data gloves (2012),
  19. 19.
    X-IST: Dataglove wireless (2009),
  20. 20.
    XSENS: MVN customer examples (2012),
  21. 21.
    Ziegler, D., Zühlke, D.: Emotional user interfaces and humanoid avatars in industrial environments. In: IFAC World Congress (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  1. 1.Department of Psychology and Ergonomics, Chair of Human-Machine SystemsTU BerlinBerlinGermany

Personalised recommendations