Advertisement

Real-Time Avatar Animation Steered by Live Body Motion

  • Oliver Schreer
  • Ralf Tanger
  • Peter Eisert
  • Peter Kauff
  • Bernhard Kaspar
  • Roman Englert
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3617)

Abstract

The future customer service provided by call centres will be changed due to new web-based interactive multimedia technologies. Technical support will be offered in a completely new way by using advanced image processing technologies and natural representation of virtual humans. We present a prototype system of an animated avatar, which is steered by live body motion of the operator in a call centre. The hand and head motion is transferred directly to the avatar at the customer side in order to support a more natural representation of the virtual human. The system tracks the operators hands and the head motion quite robust in real-time without specific initialization based on a monocular camera.

References

  1. 1.
    Moeslund, T.B., Granum, E.: A survey of computer vision-based human motion capture. Computer Vision and Image Understanding 81(3), 231–268 (2001)zbMATHCrossRefGoogle Scholar
  2. 2.
    Jaeggli, T., Koninckx, T.P., Van Gool, L.: Model-based Sparse 3D Reconstructions for Online Body Tracking. In: Proceedings of IS&T/SPIE’s 17th Annual Symposium on Electronic Imaging - Videometrics VIII, San Jose, California, USA, vol. 5665 (2005)Google Scholar
  3. 3.
    Pavlovic, I., Sharma, R., Huang, T.S.: Visual interpretation of hand gestures for human–computer interaction: a review. IEEE Trans. on PAMI 19, 677–695 (1997)Google Scholar
  4. 4.
    Just, A., Marcel, S., Bernier, O.: HMM and IOHMM for the recognition of Mono- and Bi-manual 3D Hand Gestures. In: British Machine Vision Conf., Kingston Univ. London (2004)Google Scholar
  5. 5.
    Eisert, P., Girod, B.: Analyzing Facial Expressions for Virtual Conferencing. IEEE Computer Graphics & Applications: Special Issue: Computer Animation for Virtual Humans 18(5), 70–78 (1998)Google Scholar
  6. 6.
    Horprasert, T., Yacoob, Y., Davis, L.S.: Computing 3-D head orientation from a monocular image sequence. In: 2nd Int. Conf. on Automatic Face and Gesture Recogn., p. 242 (1996)Google Scholar
  7. 7.
    Zhu, Z., Ji, Q.: 3D Face Pose Tracking from an Uncalibrated Monocular Camera. In: Int. Conf. on Pattern Recognition, Workshop on Face Processing in Video, Washington DC (2004)Google Scholar
  8. 8.
    Anderson, R.R., Hu, J., Parrish, J.A.: Optical radiation transfer in the human skin and applications in vivo remittance spectroscopy. In: Marks, R., Payne, P.A. (eds.) Bioengineering and the Skin, ch. 28, pp. 253–265. MTP Press Limited (1981)Google Scholar
  9. 9.
    Störring, M., Andersen, H.J., Granum, E.: Skin colour detection under changing lighting conditions. In: Symp. on Intelligent Robotics Systems, pp. 187–195 (1999)Google Scholar
  10. 10.
    Askar, S., Kondratyuk, Y., Elazouzi, K., Kauff, P., Schreer, O.: Vision-based Skin-Colour Segmentation of Moving Hands for Real-Time Applications. In: Proc. of 1st European Conference on Visual Media Production (CVMP), London, United Kingdom (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Oliver Schreer
    • 1
  • Ralf Tanger
    • 1
  • Peter Eisert
    • 1
  • Peter Kauff
    • 1
  • Bernhard Kaspar
    • 2
  • Roman Englert
    • 3
  1. 1.Fraunhofer Institute for Telecommunications/Heinrich-Hertz-InstitutBerlinGermany
  2. 2.T-Systems International GmbHDarmstadtGermany
  3. 3.Deutsche Telekom AG, LaboratoriesBerlinGermany

Personalised recommendations