Multimedia Tools and Applications

, Volume 47, Issue 1, pp 147–162 | Cite as

Decimation of human face model for real-time animation in intelligent multimedia systems

  • Soo-Kyun Kim
  • Syung-Og An
  • Min Hong
  • Doo-Soon Park
  • Shin-Jin Kang
Article

Abstract

Animating a complex human face model in real-time is not a trivial task in intelligent multimedia systems for next generation environments. This paper proposes a generation scheme of a simplified model for real-time human face animation in intelligent multimedia systems. Previous work mainly focused on the geometric features when generating a simplified human face model. Such methods may lose the critical feature points for animating human faces. The proposed method can find those important feature points and can generate the feature-preserved low-level models busing our new quadrics. The new quadrics consist of basic error metrics and feature edge quadrics. The quality of facial animation with a lower-level model is as good as that of a computationally expansive original model. In this paper, we prove that our decimated facial model is effective in facial animation using a well-known expression-retargeting technique.

Keywords

Facial animation Feature preserving simplification Intelligent multimedia system 

References

  1. 1.
    Busso C, Deng Z, Neumann U, Narayanan S (2005) Natural head motion synthesis driven by acoustic prosody features. Computer Animation and Virtual Worlds 16(3–4):283–290CrossRefGoogle Scholar
  2. 2.
    Busso C, Deng Z, Grimm M, Neumann U, Narayanan S (2007) Rigid head motion in expressive speech animation: Analysis and synthesis. IEEE Transaction on Audio, Speech and Language Processing 15(3):1075–1086CrossRefGoogle Scholar
  3. 3.
    Cignoni P, Rocchini C, Scopigno R (1998) Metro: measuring error on simplified surfaces. Comput Graph Forum 17(2):167–174CrossRefGoogle Scholar
  4. 4.
    Deng Z, Noh J (2007) Computer facial animation: a survey. Springer, LondonGoogle Scholar
  5. 5.
    Deng Z, Busso C, Narayanan S, Neumann U (2004) Audio-based head motion synthesis for avatar-based telepresence systems. In: Proceedings of ACM SIGMM 2004 workshop on effective telepresence (ETP 2004), New York, NY, pp 24–30Google Scholar
  6. 6.
    Garland M, Heckbert PS (1997) Surface simplification using quadric error metrics. In: Proceedings of SIGGRAPH 97, pp 209–216Google Scholar
  7. 7.
    Garland M, Heckbert PS (1998) Simplifying surfaces with color and texture using quadric error metrics. In: Proceedings of IEEE visualization 98, pp 263–269Google Scholar
  8. 8.
    Ho TC, Lin YC, Chuang JH, Peng CH, Cheng YJ (2006) User-assisted mesh simplification. In: Proceedings of ACM international conference on virtual reality continuum and its applications, pp 59–66Google Scholar
  9. 9.
    Hoppe H (1999) New quadric metric for simplifying meshes with appearance attributes. In: Proceedings of IEEE visualization, pp 59–66Google Scholar
  10. 10.
    Hubeli A, Gross M (2001) Multiresolution feature extraction from unstructured meshes. In: Proceedings of IEEE visualization 01, pp 287–294Google Scholar
  11. 11.
    Kho Y, Garland M (2003) User-guided simplification. In: Proceedings of ACM symposium on interactive 3D graphics, pp 123–126Google Scholar
  12. 12.
    Kim SJ, Kim SK, Kim CH (2002) Discrete differential error metric for surface simplification. In: Proceedings of Pacific graphics 2002, pp 276–283Google Scholar
  13. 13.
    Lee YC, Terzopoulos D, Waters K (1995) Realistic face modeling for animation. In: Proceedings of SIGGRAPH 95, pp 55–62Google Scholar
  14. 14.
    Li WD, Cai YL, Lu WF (2007) A 3D simplification algorithm for distributed visualization. Comput Ind 58(3):211–226CrossRefGoogle Scholar
  15. 15.
    Lindstrom P, Silva CT (2001) A memory insensitive technique for large model simplification. In: Proceedings of IEEE visualization 01, pp 121–126Google Scholar
  16. 16.
    Lindstrom P, Turk G (1998) Fast and memory efficient polygonal simplification. In: Proceedings of IEEE visualization 98, pp 279–286Google Scholar
  17. 17.
    Luebke D, Reddy M, Cohen J, Varshney A, Watson B, Huebner R (2003) Level of detail for 3D graphics. Morgan Kaufmann, San FranciscoGoogle Scholar
  18. 18.
    Noh J, Neumann U (2001) Expression cloning. In: Proceedings of SIGGRAPH 2001, pp 277–288Google Scholar
  19. 19.
    Parke FI (1982) Parameterized models for facial Animation. IEEE Comput Graph Appl 2(9):61–68CrossRefGoogle Scholar
  20. 20.
    Pojar E, Schmalstieg D (2003) User-controlled creation of multiresolution meshes. In: Proceedings of ACM symposium on interactive 3D graphics, pp 127–130Google Scholar
  21. 21.
    Ronfard R, Rossignac J (1996) Full-range approximation of triangulated polyhedra. Comput Graph Forum 15(3):67–76CrossRefGoogle Scholar
  22. 22.
    Rossignac J, Borrel P (1993) Multi-resolution 3D approximations for rendering complex scenes. In: Proceedings of geometric modeling in computer graphics: methods and application. Springer, New York, pp 455–465Google Scholar
  23. 23.
    Schroeder WJ, Zarge JA, Lorensen WE (1992) Decimation of triangle meshes. In: Proceedings of SIGGRAPH 92, pp 65–70Google Scholar
  24. 24.
    Ulgen F (1997) A step toward universal facial animation via volume morphing. In: Proceedings of 6th IEEE international workshop on robot and human communication, pp 358–363Google Scholar
  25. 25.
    Watanabe K, Belyaev AG (2001) Detection of salient curvature features on polygonal surfaces. Comput Graph Forum 20(3):385–392CrossRefGoogle Scholar
  26. 26.
    Waters K, Frisbie J (1995) A coordinated muscle model for speech animation. In: Proceedings of graphics interface, pp 163–170Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  • Soo-Kyun Kim
    • 1
  • Syung-Og An
    • 1
  • Min Hong
    • 2
  • Doo-Soon Park
    • 2
  • Shin-Jin Kang
    • 3
  1. 1.Department of Game EngineeringPaichai UniversityDaejeonSouth Korea
  2. 2.Division of Computer Science & EngineeringSoonchunhyang UniversityAsanSouth Korea
  3. 3.School of GamesHongik UniversitySeoulSouth Korea

Personalised recommendations