Skip to main content
SpringerLink
Log in

Virtual humans: thirty years of research, what next?

  • original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

In this paper, we present research results and future challenges in creating realistic and believable Virtual Humans. To realize these modeling goals, real-time realistic representation is essential, but we also need interactive and perceptive Virtual Humans to populate the Virtual Worlds. Three levels of modeling should be considered to create these believable Virtual Humans: 1) realistic appearance modeling, 2) realistic, smooth and flexible motion modeling, and 3) realistic high-level behaviors modeling. At first, the issues of creating virtual humans with better skeleton and realistic deformable bodies are illustrated. To give a level of believable behavior, challenges are laid on generating on the fly flexible motion and complex behaviours of Virtual Humans inside their environments using a realistic perception of the environment. Interactivity and group behaviours are also important parameters to create believable Virtual Humans which have challenges in creating believable relationship between real and virtual humans based on emotion and personality, and simulating realistic and believable behaviors of groups and crowds. Finally, issues in generating realistic virtual clothed and haired people are presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Magnenat-Thalmann, N., Thalmann, D. (eds): Handbook of Virtual Humans. New York, John Wiley (2004)

  2. Aubel, A., Thalmann, D.: MuscleBuilder: a modeling tool for human anatomy. J Comput Sci Technol 19(5), 585–595 (2004)

    Google Scholar 

  3. Magnenat-Thalmann, N., Thalmann, D.: The Direction of Synthetic Actors in the film Rendez-vous à Montreal, IEEE Computer Graphics and Applications 7(12), pp. 9–19 (1987)

    Google Scholar 

  4. Chadwick, J., Haumann, D., Parent, R.: Layered construction for deformable animated characters. Computer Graphics (SIGGRAPH ’89 Proceedings), pp. 243–252 (1989)

  5. Henne, M.: A constraint-based skin model for human figure animation. Master’s Thesis, University of California, Santa Cruz, June (1990)

  6. Yoshimito, S.: Ballerinas generated by a personal computer. J Visualizat Comput Animation 3, 85–90 (1992)

    Google Scholar 

  7. Thalmann, D., Shen, J., Chauvineau, E.: Fast realistic human body deformations for animation and vr applications. Computer Graphics International’96, Pohang, Korea (1996)

  8. Wilhelms, J.: Animals with anatomy. IEEE Comput Graph Appl 17(3), pp. 22–30 (1997)

    Google Scholar 

  9. Scheeppers, F., Parent, RE., Carlson, WE., May, S.F.: Anatomy-based modeling of the human musculature. Computer Graphics (SIGGRAPH’97 Pro-ceedings), pp. 163–172 (1997)

  10. Porcher Nedel, L., Thalmann, D.: Anatomic modeling of deformable human bodies. Visual Computer 16(6), 306–321 (2000)

    Google Scholar 

  11. Aubel, A., Thalmann, D.: Interactive modeling of the human musculature. Proc. Computer Animation, Seoul, Korea (2001)

  12. Seo, H., Cordier, F., Philippon, L., Magnenat-Thalmann, N.: Interactive modeling of mpeg-4 deformable human body models. In: Proc. Deform’2000, Workshop on Virtual Humans by IFIP Working Group 5.10 (Computer Graphics and Virtual Worlds), pp. 120–131. Kluwer, Dordrecht (2000)

  13. Berthoz, A.: The Brain’s Sense of Movement. Harward University Press, ISBN 067 400 9800 (2002)

  14. Rose, C., Cohen, M.F., Bodenheimer, B.: Verbs and adverbs: multidimensional motion interpolation. IEEE Comput Graph Appl 18(3), 32–40 (1998)

    Google Scholar 

  15. Brand, M., Hertzmann, A.: Style machines. Proc. of SIGGRAPH’00, New Orleans, and Technical Report TR-2000-14 MERL (2000)

  16. Witkin, A., Popovic, Z.: Motion warping. Proceedings of SIGGRAPH 95, Los Angeles, August 1995, pp. 105–108. ISBN 0-201-84776-0. Held in Los Angeles, California (1995)

  17. Popovic, Z., Witkin, A.: Physically based motion transformation. Proceedings of SIGGRAPH 99, Los Angeles, August 2000, pp. 11–20. ISBN 0-20148-560-5

  18. Bruderlin, A., Williams, L.: Motion signal processing. In: Cook, R. (ed.) SIGGRAPH 95 Conference Proceedings, Annual Conference Series, held in Los Angeles, August, pp. 97–104. ACM SIGGRAPH, Addison Wesley, Reading (1995)

  19. Gleicher, M.: Retargeting motion to new characters. In: Cohen, M. (ed.) SIGGRAPH 98 Con-ference Proceedings, Annual Conference Series, pp. 33–42. ACM SIGGRAPH, Addison Wesley, Reading, July 1998. ISBN 0-89791-999-8 (1998)

  20. Bindiganavale, R., Badler, N.I.: Motion abstraction and mapping with spatial constraints. In: Magnenat-Thalmann, N., Thalmann, D. (eds.) Modeling and Motion Capture Techniques for Virtual Environments. Lecture Notes in Artificial Intelligence, pp. 70–82. Springer, Berlin Heidelberg New York (1998)

  21. Jehee, L., Shin, S.Y.: A hierarchical approach. In: Proceedings of SIGGRAPH 99, held in Los Angeles, pp. 39–48. ISBN 0-20148-560-5

  22. Boulic, R., Magnenat-Thalmann, N., Thalmann, D.: A global human walking model with real-time kinematics personification. Visual Computer 6(6), 344–358

  23. Boulic, R., Capin, T., Huang, Z., Moccozet, L., Molet, T., Kalra, P., Lintermann, B., Magnenat-Thalmann, N., Pandzic, I., Saar, K. Schmitt, A., Shen, J., Thalmann, D.: The HUMANOID environment for interactive animation of multiple deformable human characters. Proc. Eurographics ‘95, Maastricht, August 1995, pp. 337–348 (1995)

  24. Glardon, P., Boulic, R., Thalmann, D.: PCA-based walking engine using motion capture data. In: Proceedings of Computer Graphics International, pp. 292–298, June 2004

  25. Egges, A., Visser, R., Magnenat-Thalmann, N.: Example-based idle motion synthesis in a real-time application. CAPTECH Workshop, Zermatt, Switzerland, pp. 13–19, December (2004)

  26. Isla, D., Blumberg, B.: Object persistence for synthetic creatures. In: Proceedings of International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS), Bologna, Italy, July (2002)

  27. Blumberg, B., Galyean, T.: Multi-level direction of autonomous creatures for real-time virtual environments. In: Proceedings of SIGGRAPH 95 (1995)

  28. Tu, X., Terzopoulos, D.: Artificial fishes: physics, locomotion, perception, behavior. ACM Computer Graphics, Proceedings of SIGGRAPH’94, July (1994)

  29. Noser, H., Renault, O., Thalmann, D., Magnenat Thalmann, N.: Navigation for digital actors based on synthetic vision, memory and learning. Computers and Graphics 19(1), 7–19 (1995)

  30. Kuffner, J.-J., Latombre, J.-C.: Fast synthetic vision, memory, and learning models for virtual humans. Proc. Computer Animation, IEEE, pp. 118–127 (1999)

  31. Elfes, A.: Occupancy grid: a stochastic spatial representation for active robot perception. 6th Conf. on Uncertainty in AI (1990)

  32. Conde, T., Thalmann, D.: An artificial life environment for autonomous virtual agents with multi-sensorial and multi-perceptive features. Comput Anim Virtual Worlds 15(3–4), 311–318 (2004)

    Google Scholar 

  33. Badler, N.N.: Virtual humans for animation, ergonomics, and simulation. IEEE Workshop on Non-Rigid and Articulated Motion, Puerto Rico, June (1997)

  34. Johnson, W.L., Rickel, J.: Steve: an animated pedagogical agent for procedural training in virtual environments. Sigart Bull 8(1–4), 16–21 (1997)

    Google Scholar 

  35. Levison, L.: Connecting planning and acting via object-specific reasoning. Ph.D. thesis, Dept. of Computer & Information Science, University of Pennsylvania (1996)

  36. Kallmann, M., Thalmann, D.: A behavioral interface to simulate agent-object interactions in real-time. Proc. Computer Animation 99, IEEE Computer Society Press (1991)

  37. Shah, J.J., Mäntylä, M.: Parametric and feature-based CAD/CAM. John Wiley, New York. ISBN 0-471-00214-3 (1995)

  38. Ulicny, B., Thalmann, D.: Crowd simulation for interactive virtual environments and VR training systems. Proc. Eurographics Workshop on Animation and Simulation’01. Springer, Berlin Heidelberg New York (2001)

  39. Reynolds, C.: Flocks, herds and schools: a, distributed behavioral model. Proc. SIGGRAPH’87. Comput Graph 21(4), 25–34 (1987)

  40. Bouvier, E., Guilloteau, P.: Crowd simulation in immersive space management. In: Proc. Eurographics Workshop on Virtual Environments and Scientific Visualization ’96, pp. 104–110. Springer, Berlin Heidelberg New York (1996)

  41. Brogan, D., Hodgins, J.: Group behaviors for systems with significant dynamics. Auton Robots 4, 137–153 (1997)

    Google Scholar 

  42. Aubel, A., Thalmann, D.: MuscleBuilder: a modeling tool for human anatomy. J Comput Sci Technol 19(5), 585–595 (2004)

    Google Scholar 

  43. Tecchia, F., Chrysanthou, Y.: Real-time rendering of densely populated urban environments. In: Proc. Eurographics Rendering Workshop, pp. 83–88 (2000)

  44. McPhail, C., Powers, W.T., Tucker, C.W.: Simulating individual and collective actions in temporary gatherings. Social Sci Comput Rev 10(1), 1–28 (1992)

    Google Scholar 

  45. Still, G.K.: Crowd Dynamics. PhD thesis, Warwick University, 2000

  46. Aubel, A., Boulic, R., Thalmann, D.: Real-time display of virtual humans: level of details and impostors. IEEE Trans Circuits Syst Video Technol, Special Issue on 3D Video Technology 10(2), 207–227 (2000)

    Google Scholar 

  47. Anderson, M., McDaniel, E., Chenney, S.: Constrained animation of flocks. Proc. ACM Symposium on Computer Animation (2003)

  48. Helbing, D., Farkas, I., Vicsek, T.: Simulating dynamical features of escape panic. Nature 407, 487–490 (2000)

    Google Scholar 

  49. McPhail, C.: The Myth of Maddening Crowd. Aldine De Gruyter, New York (1991)

  50. Ulicny, B., Thalmann, D.: Towards interactive real-time crowd behavior simulation. Comput Graph Forum 21(4), 767–775 (2002)

    Google Scholar 

  51. Kalra, D., Barr, A.H.: Modeling with time and events in computer animation. Proc. Eurographics’92, pp. 45–58. Blackwell Publishers, Oxford (1992)

  52. Rosenbloom, P.S., Laird, J.E., Newell, A.: The Soar papers: research on artificial intelligence. MIT Press, Cambridge (1993)

  53. Cremer, J., Kearney, J., Papelis, Y.: HCSM: framework for behavior and scenario control in virtual environments. ACM Trans Modeling Comput Simul 5(3), 42–267 (1995)

    Google Scholar 

  54. Boulic, R., Becheiraz, P., Emering, L., Thalmann, D.: Integration of motion control techniques for virtual human and avatar real-time animation. Proc. VRST ’97, pp. 111–118. ACM Press, New Yokr (1997)

  55. Ulicny, B., de Heras, P., Thalmann, D.: (2004) Crowdbrush: interactive authoring of real-time crowd scenes. Proc. ACM SIGGRAPH/Eurographics Symposium on Computer Animation’04, pp. 243–252 (2004)

  56. Parke, F.I.: A parametric model for human faces. Ph.D. Thesis, University of Utah, UTEC-CSc-75-04 (1974)

  57. Ortony, A., Clore, G.L., Collins, A.: The Cognitive Structure of Emotions. Cambridge University Press (1988)

  58. Eysenck, H.J.: Biological dimensions of personality. In: Pervin, L.A. (ed.) Handbook of Personality: Theory and Research, pp. 244–276. Guilford Press, New York (1990)

  59. Costa, P.T., McCrae, R.R.: Normal personality assessment in clinical practice: the NEO personality inventory. Psychol Assess (4), 5–13 (1992)

    Google Scholar 

  60. Egges, A., Kshirsagar, S., Magnenat-Thalmann, N.: Generic personality and emotion simulation for conversational agents. Comput Anim Virtual Worlds 15(1), 1–13 (2004)

    Google Scholar 

  61. Marsella, S., Gratch, J.: A step towards irrationality: Using emotion to change belief. In: Proceedings of the 1st International Joint Conference on Autonomous Agents and Multi-Agent Systems, Bologna, Italy, July (2002)

  62. Johns, M., Silverman, B.G.: How emotions and personality effect the utility of alternative decisions: a terrorist target selection case study. In: Tenth Conference On Computer Generated Forces and Behavioral Representation, May (2001)

  63. André, E., Klesen, M., Gebhard, P., Allen, S., Rist, T.: Integrating models of personality and emotions into lifelike characters. In: Proceedings International Workshop on Affect in Interactions. Towards a New Generation of Interfaces (1999)

  64. Ball, G., Breese, J.: Emotion and personality in a conversational character. In: Proceedings of the Workshop on Embodied Conversational Characters, pp. 83–84, 119–121, October (1998)

  65. Chittaro, L., Serra, M.: Behavioural programming of autonomous characters based on probabilistic automata and personality. Comput Anim Virtual Worlds 15(3–4), 319–326 (2004)

    Google Scholar 

  66. El-Nasr, M., Ioerger, Z., Yen, J.: A pet with evolving emotional intelligence. In: Proceedings of Autonomous Agents’99 (1999)

  67. LeDoux, J.E., Hirst, W.: Mind and Brain: Dialogues in Cognitive Neuroscience. Cambridge University Press (1986)

  68. Davidson, R.J., Ekman, P., Saron, C.D., Senulis, J.A., Friesen, W.V.: Approach withdrawal and cerebral asymmetry: emotional expression and brain physiology. J Personal Soc Psychol 58, 330–341 (1990)

    Google Scholar 

  69. Ekman, P.: Expression and the nature of emotion. In: Ekman, P., Scherer, K.R. (eds.): Approaches to emotion, pp. 319–343. Lawrence Erlbaum, Hillsdale, NJ (1984)

  70. Scherer, K.R.: Emotion expression in speech and music. In: Sundberg, J., Nord, L., Carlson, R. (eds): Music, Language, Speech, and Brain, pp. 146–156. MacMillan, London (1991)

  71. Pelachaud, C., Bilvi, M.: Computational model of believable conversational agents. In: Huget, M.-P. (ed.) Communication in MAS: Background, Current Trends and Future, pp. 300–317. Springer, Berlin Heidelberg New York (2003)

  72. Smid, C., Pandzic, I., Radman, V.: Autonomous speaker agent. In CASA 2004, 17th International Conference on Computer Animation and Agent, pp. 259–266 (2004)

  73. Weil, J.: The synthesis of cloth objects. Proc. SIGGRAPH’86, Computer Graphics, vol. 24, pp. 243–252 (1986)

  74. Carignan, M., Yang, Y., Magnenat-Thalmann, N., Thalmann, D.: Dressing animated synthetic actors with complex deformable clothes. Computer Graphics (SIGGRAPH’92 Proceedings), vol. 26(2), pp. 99–104. Addison-Wesley, Reading (1992)

  75. Volino, P., Courchesne, M., Magnenat-Thalmann, N.: Versatile and efficient techniques for simulating cloth and other deformable objects. Computer Graphics (SIGGRAPH’95 Proceedings), pp. 137–144. Addison-Wesley, Reading (1995)

  76. Breen, D.E., House, D.H., Wozny, M.J.: Predicting the drape of woven cloth using interacting particles. Computer Graphics (SIGGRAPH’94 Proceedings), pp. 365–372. Addison-Wesley, Reading (1994)

  77. Eischen, J.W., Deng, S., Clapp, T.G.: Finite-element modeling and control of flexible fabric parts, computer graphics in textiles and apparel. IEEE Computer Graphics and Applications, pp. 71–80 (1996)

  78. Barff, D., Witkin, A.: Large steps in cloth simulation. ACM Trans Graph, Proceedings of ACM SIGGRAPH 1998, ACM SIGGRAPH, pp. 43–54, Addison Wesley, Reading (1998)

  79. Eberhardt, B., Etzmuss, O., Hauth, M.: Implicit-explicit schemes for fast animation with particles systems. Proceedings of the Eurographics Workshop on Computer Animation and Simulation, pp. 137–151. Springer, Berlin Heidelberg New York (2000)

  80. Volino, P., Magnenat-Thalmann, N.: Developing simulation techniques for an interactive clothing system. In: Virtual Systems and Multimedia (VSMM’97 Proceedings), pp. 109–118. IEEE Press, Geneva, Switzerland (1997)

  81. Volino, P., Courchesne, M., Magnenat-Thalmann, N.: Versatile and efficient techniques for simulating cloth and other deformable objects. Computer Graphics (SIGGRAPH’95 Proceedings), pp. 137–144. Addison-Wesley, Reading (1995)

  82. Eberhardt, B., Weber, A., Strasser, W.: A fast, flexible, particle-system model for cloth draping. Computer Graphics in Textiles and Apparel (IEEE Computer Graphics and Applications), pp. 52–59, September (1996)

  83. Kang, Y.-M., Cho, H.-G.: Bilayered approximate integration for rapid and plausible animation of virtual cloth with realistic wrinkles. Proceedings of Computer Animation 2002, pp. 203. Geneva, Switzerland, IEEE Press, June (2002)

  84. Hadap, S., Bangarter, E., Volino, P., Magnenat-Thalmann, N.: Animating wrinkles on clothes. IEEE Visualization ’99, pp. 175–182. IEEE Press, San Francisco (1999)

  85. Ng, H., Grimsdale, R.L.: GEOFF – a geometrical editor for fold formation. Lecture Notes in Computer Science: Image Analysis Applications and Computer Graphics, vol. 1024, pp. 124–131. Springer, Berlin Heidelberg New York (1995)

  86. Grzeszczuk, R., Terzopoulos, D., Hinton, G.: Neuroanimator: fast neural network emulation and control of physics-based models. SIGGRAPH 98 Conference Proceedings, Annual Conference Series, ACM SIGGRAPH, pp. 9–20. Addison Wesley, Reading (1998)

  87. James, D.L., Fatahalian, K.: Precomputing interactive dynamic deformable scenes. ACM Transactions on Graphics (TOG), ACM SIGGRAPH, vol. 22(3), pp. 165–172. Addison Wesley, Reading (2003)

  88. Cordier, F., Magnenat-Thalmann, N.: Real-time animation of dressed virtual human. Computer Graphics Forum, vol. 21(3), Blackwell Publishers, Oxford (2002)

  89. Magnenat-Thalmann, N., Seo, H., Cordier, F.: Automatic modeling of virtual humans and body clothing. J Comput Sci Technol 19(6) (in press), Chinese Academy of Sciences, Beijing, China (publisher), December (2004)

  90. Papagiannakis, G., Schertenleib, S., O’Kennedy, B., Poizat, M., Magnenat-Thalmann, N., Stoddart, A., Thalmann, D.: Mixing virtual and real scenes in the site of ancient Pompeii, J CAVW 16(1), 11–24 (2005)

    Google Scholar 

  91. Daldegan, A., Magnenat-Thalmann, N., Kurihara, T., Thalmann, D.: An integrated system for modeling, animating and rendering hair. Computer Graphics Forum (Eurographics ’93), vol. 12(3), pp. 211–221 (1993)

  92. Rosenblum, R., Carlson, W., Tripp, E.: Simulating the structure and dynamics of human hair: modeling, rendering and animation. J Visual Comput Animat 2, 141–148 (1991)

    Google Scholar 

  93. Anjyo, K., Usami, Y., Kurihara, T.: A simple method for extracting the natural beauty of hair. Computer Graphics (Proceedings of SIGGRAPH 92), vol. 26(2), pp. 111–120, July (1992)

  94. Lee, D.-W., Ko, H.S.: Natural hairstyle modeling and animation. In: Proceedings of International Workshop on Human Modeling and Animation, pp. 11–21, Seoul, Korea, June 2000. Korea Computer Graphics Society (2000)

  95. Lin, M., Gottschalk, S.: Collision detection between geometric models: a survey. In: Proceedings IMA Conf. on Mathematics of Surfaces, pp.33–52 (1998)

  96. Hadap, S., Magnenat-Thalmann, N.: Modeling dynamic hair as a continuum. Computer Graphics Forum, vol. 20(3), Eurographics Proceedings, Manchester, United Kingdom, September (2001)

Download references

Author information

Authors and Affiliations

  1. MIRALab, University of Geneva, Switzerland

    Nadia Magnenat-Thalmann & Daniel Thalmann

Authors
  1. Nadia Magnenat-Thalmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Daniel Thalmann
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nadia Magnenat-Thalmann.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Magnenat-Thalmann, N., Thalmann, D. Virtual humans: thirty years of research, what next?. Visual Comput 21, 997–1015 (2005). https://doi.org/10.1007/s00371-005-0363-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-005-0363-6

Keywords

Search

Navigation