Generation of Facial Expressions from Emotion Using a Fuzzy Rule Based System

  • The Duy Bui
  • Dirk Heylen
  • Mannes Poel
  • Anton Nijholt
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2256)


We propose a fuzzy rule-based system to map representations of the emotional state of an animated agent onto muscle contraction values for the appropriate facial expressions. Our implementation pays special attention to the way in which continuous changes in the intensity of emotions can be displayed smoothly on the graphical face. The rule system we have defined implements the patterns described by psychologists and researchers dealing with facial expressions of humans, including rules for displaying blends of expressions.


Facial Expression Fuzzy Rule Basic Emotion Emotion Intensity Facial Animation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bui, T.D (2001), Generation of facial expression from emotion using a Fuzzy Rule Based Sytem, Technical Report, Parlevink, Faculty of Computer Science, University of Twente.Google Scholar
  2. 2.
    Ekman, P. and W. Friesen(1975). Unmasking the Face. Prentice Hall.Google Scholar
  3. 3.
    Ekman, P., and W. Friesen, Facial Action Coding System. Consulting Psychologists Press, Inc., 1978.Google Scholar
  4. 4.
    Galernter, D.H. (1994), The muse in the machine. NewYork: Free Press.Google Scholar
  5. 5.
    Hayes-Roth, B. and R. van Gent(1997), Story-making with improvisational puppets, in Proceedings of 9th Conference Uncertainty in Artificial Intelligence, pp 122–127, San Francisco, Morgan Kaufmann.Google Scholar
  6. 6.
    J. Hendrix, Zs. Ruttkay, P. ten Hagen, H. Noot, A. Lelievre, B. de Ruiter (2000), A facial repertoire for avatars, Proceedings of theWorkshop “Interacting Agents”, Enschede, The Netherlands.Google Scholar
  7. 7.
    Izard, C.E. (1971), The face of emotion, NewYork: Appleton-Century-Crofts.Google Scholar
  8. 8.
    Izard, C.E. (1991), The psychology of emotions, NewYork: Plenum.Google Scholar
  9. 9.
    Izard, C.E. (1997), Emotions and facial expressions: A perspective from Differential Emotions Theory, in J.A. Russell and J.M. Fernandez-Dols (Eds.), The Psychology of Facial Expression, Maison des Sciences de l’Homme and Cambridge University Press.Google Scholar
  10. 10.
    Kesteren, A.J., R. Op den Akker, M. Poel and A. Nijholt (2000), Simulation of emotions of agents in virtual environments using neural networks. In: Learning to Behave: Internalising Knowledge. Proceeding TwenteWorkshops on Language technology 18 (TWLT18).Google Scholar
  11. 11.
    Lee, C.C. (1990), Fuzzy Logic in control systems: Fuzzy logic controller-parts i and ii. Fuzzy Sets and Systems 15:111–128,224-240Google Scholar
  12. 12.
    Nijholt, A., M. van den Berk and A. van Hessen (1998), A natural language web-based dialogue system with a talking face, Proceedings Text, Speech and Dialogue. Sojka et al (eds.), Brno, Czech republic, pp 415–420.Google Scholar
  13. 13.
    Nijholt, A., D. Heylen and R. Vertegaal (2000), Inhabited interfaces: Attentive conversational agents that help. In: Proceedings 3rd international Conference on Disability,Virtual Reality and Associated Technologies-CDVRAT2000, Alghero, Sardinia.Google Scholar
  14. 14.
    Paradiso, A. and M. L’Abbate (2001), A Model for the Generation and Combination of Emotional Expressions, In: Proceedings of theWorkshop on Multimodal Communication and Context in Embodied Agents. C. Pelachaud and I. Poggi (eds.)-Autonomous Agents, Montreal, Canada.Google Scholar
  15. 15.
    Parke, F.I. and Waters, K. (1994) Computer Facial Animation, AK Peters. ISBN 1-56881-014-8.Google Scholar
  16. 16.
    Perlin, K., and A. Goldberg (1996), Improv: A system for scripting interactive actors in virtual worlds, in SIGGRAPH’96, Proceedings of the 23rd Annual Conference on Computer Graphics, pp 205–216, NewYork, ACM Press.Google Scholar
  17. 17.
    Perlin, K. (1997), Layered compositing of facial expression, SIGGRAPH’97 Technical Sketch, NewYork University Media Research Lab. Available: <>.
  18. 18.
    F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D. Salesin (1998), Synthesizing realistic facial expressions from photographs, in SIGGRAPH 98 Conference Proceedings, pages 75–84, ACM SIGGRAPH, July 1998.Google Scholar
  19. 19.
    Plutchik, R. (1962), The emotions: Facts, theories, and a new model, NewYork: Random House.Google Scholar
  20. 20.
    Prevost, S. and C. Pelachaud. (1995). Talking Heads: Physical, Linguistic and Cognitive Issues in Facial Animation. Course Notes for Computer Graphics International 1995, Leeds, UKGoogle Scholar
  21. 21.
    Russell, J.A. and J.M. Fernández-Dols (1997), The meaning of Faces, in J.A. Russell and J.M. Fernandez-Dols (Eds.), The Psychology of Facial Expression, Maison des Sciences de l’Homme and Cambridge University Press.Google Scholar
  22. 22.
    Stern, A., A. Frank, and B. Resner(1998), Virtual Petz:A hybrid approach to creating autonomous, lifelike Dogz and Catz, in Proceedings of the Second International Conference on Autonomous Agents, AGENTS98, pp 334–335, NewYork, ACM Press.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • The Duy Bui
    • 1
  • Dirk Heylen
    • 1
  • Mannes Poel
    • 1
  • Anton Nijholt
    • 1
  1. 1.Department of Computer ScienceUniversity of TwenteThe Netherlands

Personalised recommendations