The Application of MPEG-4 Compliant Animation to a Modern Games Engine and Animation Framework

  • Chris Carter
  • Simon Cooper
  • Abdennour El Rhalibi
  • Madjid Merabti
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6459)


The MPEG-4 standards define a technique for 3D facial and body model animations (FAPS / BAPS respectively), as seen in animation systems such as Greta. The way this technique works is in contrast to the set of animation techniques currently used within modern games technologies and applications, which utilize more advanced, expressive animation systems such as Skeletal, Morph Target and Inverse Kinematics. This paper describes an object oriented, Java-based framework for the integration and transformation of MPEG4 standards-compliant animation streams known as Charisma. Charisma is designed for use with modern games animation systems; this paper illustrates the application of this framework on top of our Java / OpenGL-based games engine framework known as Homura.


MPEG-4 FAPS Facial Animation Skinning Homura Charisma 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Poggi, I., Pelachaud, C., de Rosis, F., Carofiglio, V., De Carolis, B.: Greta: A Believable Embodied Conversational Agent. In: Multimodal Intelligent Information Presentation, pp. 3–25. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  2. 2.
    Grammalidis, N., Sarris, N., Deligianni, F., Strintzis, M.G.: Three-Dimensional Facial Adaptation for MPEG-4 Talking Heads. EURASIP Journal on Applied Signal Processing (1), 1005–1020 (2002)Google Scholar
  3. 3.
    Forchheimer, R., Pandzic, I., Pakstas, A.: MPEG-4 Facial Animation: The Standard, Implementation and Applications. Wiley and Sons Inc., New York (2002)Google Scholar
  4. 4.
    Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 187–194 (July 1999)Google Scholar
  5. 5.
    Deng, Z., Chiang, P.Y., Fox, P., Neumann, U.: Animating blendshape faces by cross-mapping motion capture data. In: Proceedings of the 2006 Symposium on Interactive 3D Graphics and Games, pp. 43–48 (2006)Google Scholar
  6. 6.
    Tolani, D., Goswami, A., Badler, N.I.: Real-Time Inverse Kinematics Techniques for Anthropomorphic Limbs. Graphical Models 62(5), 353–388 (2000)CrossRefzbMATHGoogle Scholar
  7. 7.
    Ersotelos, N., Dong, F.: Building highly realistic facial modeling and animation: a survey. The Visual Computer: International Journal of Computer Graphics 24(1), 13–30 (2007)CrossRefGoogle Scholar
  8. 8.
    Balci, K.: Xface: MPEG4 Open Source Toolkit for 3D Facial Animation. In: Proceedings of the Working Conference on Advanced Visual interfaces, Gallipoli, Italy, pp. 399–402 (2004)Google Scholar
  9. 9.
    de Rosis, F., Pelachaud, C., Poggi, I., Carofiglio, V., De Carolis, B.: From Greta’s Mind to her Face: Modeling the Dynamics of Affective States in a Conversational Embodied Agent. International Journal of Human-Computer Studies 59(1-2), 81–118 (2003)CrossRefGoogle Scholar
  10. 10.
    Image Metrics - Official Site (July 2010),
  11. 11.
    Zhang, Y., Ji, Q., Zhu, Z., Yi, B.: Dynamic Facial Expression Analysis and Synthesis With MPEG-4 Facial Animation Parameters. IEEE Transactions on Circuits and Systems for Video Technology 18(10), 1383–1396 (2008)CrossRefGoogle Scholar
  12. 12.
    Pardas, M., Bonafonte, A., Landabaso, J.L.: Emotion Recognition based on MPEG4 Facial Animation Parameters. In: Proceedings of IEEE Acoustics, Speech, and Signal Processing, pp. 3624–3627 (2002)Google Scholar
  13. 13.
    Ahlberg, J., Pandzic, I., You, L.: Evaluating Face Models Animated by MPEG-4 FAPs. In: OZCHI Workshop on Talking Head Technology, Fremantle, Western Australia (November 2001)Google Scholar
  14. 14.
    Lavagetto, F., Pockaj, R.: The Facial Animation Engine: Toward a High-Level Interface for the Design of MPEG-4 Compliant Animated Faces. IEEE Transactions on Circuits and Systems for Video Technology 9(2), 277–289 (1999)CrossRefGoogle Scholar
  15. 15.
    Pasquariello, S., Pelachaud, C.: Greta: A Simple Facial Animation Engine. In: Proceedings of the 6th Online World Conference on Soft Computing in Industrial Applications (2001)Google Scholar
  16. 16.
    Balci, K., Not, E., Zancanaro, M., Pianesi, F.: Xface open source project and smil-agent scripting language for creating and animating embodied conversational agents. In: Proceedings of the 15th International Conference on Multimedia, Augsburg, Germany, pp. 1013–1016 (2007)Google Scholar
  17. 17.
    Pandzic, I.S.: Facial Animation Framework for the Web. In: Proceedings of the Seventh International Conference on 3D Web Technology, Arizona, USA, pp. 27–34 (2002)Google Scholar
  18. 18.
    Carter, C.: Networking Middleware and Online-Deployment Mechanisms for Java-Based Games. In: 6th International Conference in Computer Game Design and Technology (GDTW), Holiday Inn., Liverpool, UK, November 12-13 (2008)Google Scholar
  19. 19.
    Carter, C., El-Rhalibi, A., Merabti, M., Price, M.: Homura and Net-Homura: The Creation and Web-based Deployment of Cross-Platform 3D Games. In: Proceedings of Ubiquitous Multimedia Systems and Applications (UMSA), St. Petersburg (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Chris Carter
    • 1
  • Simon Cooper
    • 1
  • Abdennour El Rhalibi
    • 1
  • Madjid Merabti
    • 1
  1. 1.School of Computing & Mathematical SciencesLiverpool John Moores UniversityLiverpoolUK

Personalised recommendations