Abstract
In this paper, we present research results and future challenges in creating realistic and believable Virtual Humans. To realize these modeling goals, real-time realistic representation is essential, but we also need interactive and perceptive Virtual Humans to populate the Virtual Worlds. Three levels of modeling should be considered to create these believable Virtual Humans: 1) realistic appearance modeling, 2) realistic, smooth and flexible motion modeling, and 3) realistic high-level behaviors modeling. At first, the issues of creating virtual humans with better skeleton and realistic deformable bodies are illustrated. To give a level of believable behavior, challenges are laid on generating on the fly flexible motion and complex behaviours of Virtual Humans inside their environments using a realistic perception of the environment. Interactivity and group behaviours are also important parameters to create believable Virtual Humans which have challenges in creating believable relationship between real and virtual humans based on emotion and personality, and simulating realistic and believable behaviors of groups and crowds. Finally, issues in generating realistic virtual clothed and haired people are presented.
Similar content being viewed by others
References
Magnenat-Thalmann, N., Thalmann, D. (eds): Handbook of Virtual Humans. New York, John Wiley (2004)
Aubel, A., Thalmann, D.: MuscleBuilder: a modeling tool for human anatomy. J Comput Sci Technol 19(5), 585–595 (2004)
Magnenat-Thalmann, N., Thalmann, D.: The Direction of Synthetic Actors in the film Rendez-vous à Montreal, IEEE Computer Graphics and Applications 7(12), pp. 9–19 (1987)
Chadwick, J., Haumann, D., Parent, R.: Layered construction for deformable animated characters. Computer Graphics (SIGGRAPH ’89 Proceedings), pp. 243–252 (1989)
Henne, M.: A constraint-based skin model for human figure animation. Master’s Thesis, University of California, Santa Cruz, June (1990)
Yoshimito, S.: Ballerinas generated by a personal computer. J Visualizat Comput Animation 3, 85–90 (1992)
Thalmann, D., Shen, J., Chauvineau, E.: Fast realistic human body deformations for animation and vr applications. Computer Graphics International’96, Pohang, Korea (1996)
Wilhelms, J.: Animals with anatomy. IEEE Comput Graph Appl 17(3), pp. 22–30 (1997)
Scheeppers, F., Parent, RE., Carlson, WE., May, S.F.: Anatomy-based modeling of the human musculature. Computer Graphics (SIGGRAPH’97 Pro-ceedings), pp. 163–172 (1997)
Porcher Nedel, L., Thalmann, D.: Anatomic modeling of deformable human bodies. Visual Computer 16(6), 306–321 (2000)
Aubel, A., Thalmann, D.: Interactive modeling of the human musculature. Proc. Computer Animation, Seoul, Korea (2001)
Seo, H., Cordier, F., Philippon, L., Magnenat-Thalmann, N.: Interactive modeling of mpeg-4 deformable human body models. In: Proc. Deform’2000, Workshop on Virtual Humans by IFIP Working Group 5.10 (Computer Graphics and Virtual Worlds), pp. 120–131. Kluwer, Dordrecht (2000)
Berthoz, A.: The Brain’s Sense of Movement. Harward University Press, ISBN 067 400 9800 (2002)
Rose, C., Cohen, M.F., Bodenheimer, B.: Verbs and adverbs: multidimensional motion interpolation. IEEE Comput Graph Appl 18(3), 32–40 (1998)
Brand, M., Hertzmann, A.: Style machines. Proc. of SIGGRAPH’00, New Orleans, and Technical Report TR-2000-14 MERL (2000)
Witkin, A., Popovic, Z.: Motion warping. Proceedings of SIGGRAPH 95, Los Angeles, August 1995, pp. 105–108. ISBN 0-201-84776-0. Held in Los Angeles, California (1995)
Popovic, Z., Witkin, A.: Physically based motion transformation. Proceedings of SIGGRAPH 99, Los Angeles, August 2000, pp. 11–20. ISBN 0-20148-560-5
Bruderlin, A., Williams, L.: Motion signal processing. In: Cook, R. (ed.) SIGGRAPH 95 Conference Proceedings, Annual Conference Series, held in Los Angeles, August, pp. 97–104. ACM SIGGRAPH, Addison Wesley, Reading (1995)
Gleicher, M.: Retargeting motion to new characters. In: Cohen, M. (ed.) SIGGRAPH 98 Con-ference Proceedings, Annual Conference Series, pp. 33–42. ACM SIGGRAPH, Addison Wesley, Reading, July 1998. ISBN 0-89791-999-8 (1998)
Bindiganavale, R., Badler, N.I.: Motion abstraction and mapping with spatial constraints. In: Magnenat-Thalmann, N., Thalmann, D. (eds.) Modeling and Motion Capture Techniques for Virtual Environments. Lecture Notes in Artificial Intelligence, pp. 70–82. Springer, Berlin Heidelberg New York (1998)
Jehee, L., Shin, S.Y.: A hierarchical approach. In: Proceedings of SIGGRAPH 99, held in Los Angeles, pp. 39–48. ISBN 0-20148-560-5
Boulic, R., Magnenat-Thalmann, N., Thalmann, D.: A global human walking model with real-time kinematics personification. Visual Computer 6(6), 344–358
Boulic, R., Capin, T., Huang, Z., Moccozet, L., Molet, T., Kalra, P., Lintermann, B., Magnenat-Thalmann, N., Pandzic, I., Saar, K. Schmitt, A., Shen, J., Thalmann, D.: The HUMANOID environment for interactive animation of multiple deformable human characters. Proc. Eurographics ‘95, Maastricht, August 1995, pp. 337–348 (1995)
Glardon, P., Boulic, R., Thalmann, D.: PCA-based walking engine using motion capture data. In: Proceedings of Computer Graphics International, pp. 292–298, June 2004
Egges, A., Visser, R., Magnenat-Thalmann, N.: Example-based idle motion synthesis in a real-time application. CAPTECH Workshop, Zermatt, Switzerland, pp. 13–19, December (2004)
Isla, D., Blumberg, B.: Object persistence for synthetic creatures. In: Proceedings of International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS), Bologna, Italy, July (2002)
Blumberg, B., Galyean, T.: Multi-level direction of autonomous creatures for real-time virtual environments. In: Proceedings of SIGGRAPH 95 (1995)
Tu, X., Terzopoulos, D.: Artificial fishes: physics, locomotion, perception, behavior. ACM Computer Graphics, Proceedings of SIGGRAPH’94, July (1994)
Noser, H., Renault, O., Thalmann, D., Magnenat Thalmann, N.: Navigation for digital actors based on synthetic vision, memory and learning. Computers and Graphics 19(1), 7–19 (1995)
Kuffner, J.-J., Latombre, J.-C.: Fast synthetic vision, memory, and learning models for virtual humans. Proc. Computer Animation, IEEE, pp. 118–127 (1999)
Elfes, A.: Occupancy grid: a stochastic spatial representation for active robot perception. 6th Conf. on Uncertainty in AI (1990)
Conde, T., Thalmann, D.: An artificial life environment for autonomous virtual agents with multi-sensorial and multi-perceptive features. Comput Anim Virtual Worlds 15(3–4), 311–318 (2004)
Badler, N.N.: Virtual humans for animation, ergonomics, and simulation. IEEE Workshop on Non-Rigid and Articulated Motion, Puerto Rico, June (1997)
Johnson, W.L., Rickel, J.: Steve: an animated pedagogical agent for procedural training in virtual environments. Sigart Bull 8(1–4), 16–21 (1997)
Levison, L.: Connecting planning and acting via object-specific reasoning. Ph.D. thesis, Dept. of Computer & Information Science, University of Pennsylvania (1996)
Kallmann, M., Thalmann, D.: A behavioral interface to simulate agent-object interactions in real-time. Proc. Computer Animation 99, IEEE Computer Society Press (1991)
Shah, J.J., Mäntylä, M.: Parametric and feature-based CAD/CAM. John Wiley, New York. ISBN 0-471-00214-3 (1995)
Ulicny, B., Thalmann, D.: Crowd simulation for interactive virtual environments and VR training systems. Proc. Eurographics Workshop on Animation and Simulation’01. Springer, Berlin Heidelberg New York (2001)
Reynolds, C.: Flocks, herds and schools: a, distributed behavioral model. Proc. SIGGRAPH’87. Comput Graph 21(4), 25–34 (1987)
Bouvier, E., Guilloteau, P.: Crowd simulation in immersive space management. In: Proc. Eurographics Workshop on Virtual Environments and Scientific Visualization ’96, pp. 104–110. Springer, Berlin Heidelberg New York (1996)
Brogan, D., Hodgins, J.: Group behaviors for systems with significant dynamics. Auton Robots 4, 137–153 (1997)
Aubel, A., Thalmann, D.: MuscleBuilder: a modeling tool for human anatomy. J Comput Sci Technol 19(5), 585–595 (2004)
Tecchia, F., Chrysanthou, Y.: Real-time rendering of densely populated urban environments. In: Proc. Eurographics Rendering Workshop, pp. 83–88 (2000)
McPhail, C., Powers, W.T., Tucker, C.W.: Simulating individual and collective actions in temporary gatherings. Social Sci Comput Rev 10(1), 1–28 (1992)
Still, G.K.: Crowd Dynamics. PhD thesis, Warwick University, 2000
Aubel, A., Boulic, R., Thalmann, D.: Real-time display of virtual humans: level of details and impostors. IEEE Trans Circuits Syst Video Technol, Special Issue on 3D Video Technology 10(2), 207–227 (2000)
Anderson, M., McDaniel, E., Chenney, S.: Constrained animation of flocks. Proc. ACM Symposium on Computer Animation (2003)
Helbing, D., Farkas, I., Vicsek, T.: Simulating dynamical features of escape panic. Nature 407, 487–490 (2000)
McPhail, C.: The Myth of Maddening Crowd. Aldine De Gruyter, New York (1991)
Ulicny, B., Thalmann, D.: Towards interactive real-time crowd behavior simulation. Comput Graph Forum 21(4), 767–775 (2002)
Kalra, D., Barr, A.H.: Modeling with time and events in computer animation. Proc. Eurographics’92, pp. 45–58. Blackwell Publishers, Oxford (1992)
Rosenbloom, P.S., Laird, J.E., Newell, A.: The Soar papers: research on artificial intelligence. MIT Press, Cambridge (1993)
Cremer, J., Kearney, J., Papelis, Y.: HCSM: framework for behavior and scenario control in virtual environments. ACM Trans Modeling Comput Simul 5(3), 42–267 (1995)
Boulic, R., Becheiraz, P., Emering, L., Thalmann, D.: Integration of motion control techniques for virtual human and avatar real-time animation. Proc. VRST ’97, pp. 111–118. ACM Press, New Yokr (1997)
Ulicny, B., de Heras, P., Thalmann, D.: (2004) Crowdbrush: interactive authoring of real-time crowd scenes. Proc. ACM SIGGRAPH/Eurographics Symposium on Computer Animation’04, pp. 243–252 (2004)
Parke, F.I.: A parametric model for human faces. Ph.D. Thesis, University of Utah, UTEC-CSc-75-04 (1974)
Ortony, A., Clore, G.L., Collins, A.: The Cognitive Structure of Emotions. Cambridge University Press (1988)
Eysenck, H.J.: Biological dimensions of personality. In: Pervin, L.A. (ed.) Handbook of Personality: Theory and Research, pp. 244–276. Guilford Press, New York (1990)
Costa, P.T., McCrae, R.R.: Normal personality assessment in clinical practice: the NEO personality inventory. Psychol Assess (4), 5–13 (1992)
Egges, A., Kshirsagar, S., Magnenat-Thalmann, N.: Generic personality and emotion simulation for conversational agents. Comput Anim Virtual Worlds 15(1), 1–13 (2004)
Marsella, S., Gratch, J.: A step towards irrationality: Using emotion to change belief. In: Proceedings of the 1st International Joint Conference on Autonomous Agents and Multi-Agent Systems, Bologna, Italy, July (2002)
Johns, M., Silverman, B.G.: How emotions and personality effect the utility of alternative decisions: a terrorist target selection case study. In: Tenth Conference On Computer Generated Forces and Behavioral Representation, May (2001)
André, E., Klesen, M., Gebhard, P., Allen, S., Rist, T.: Integrating models of personality and emotions into lifelike characters. In: Proceedings International Workshop on Affect in Interactions. Towards a New Generation of Interfaces (1999)
Ball, G., Breese, J.: Emotion and personality in a conversational character. In: Proceedings of the Workshop on Embodied Conversational Characters, pp. 83–84, 119–121, October (1998)
Chittaro, L., Serra, M.: Behavioural programming of autonomous characters based on probabilistic automata and personality. Comput Anim Virtual Worlds 15(3–4), 319–326 (2004)
El-Nasr, M., Ioerger, Z., Yen, J.: A pet with evolving emotional intelligence. In: Proceedings of Autonomous Agents’99 (1999)
LeDoux, J.E., Hirst, W.: Mind and Brain: Dialogues in Cognitive Neuroscience. Cambridge University Press (1986)
Davidson, R.J., Ekman, P., Saron, C.D., Senulis, J.A., Friesen, W.V.: Approach withdrawal and cerebral asymmetry: emotional expression and brain physiology. J Personal Soc Psychol 58, 330–341 (1990)
Ekman, P.: Expression and the nature of emotion. In: Ekman, P., Scherer, K.R. (eds.): Approaches to emotion, pp. 319–343. Lawrence Erlbaum, Hillsdale, NJ (1984)
Scherer, K.R.: Emotion expression in speech and music. In: Sundberg, J., Nord, L., Carlson, R. (eds): Music, Language, Speech, and Brain, pp. 146–156. MacMillan, London (1991)
Pelachaud, C., Bilvi, M.: Computational model of believable conversational agents. In: Huget, M.-P. (ed.) Communication in MAS: Background, Current Trends and Future, pp. 300–317. Springer, Berlin Heidelberg New York (2003)
Smid, C., Pandzic, I., Radman, V.: Autonomous speaker agent. In CASA 2004, 17th International Conference on Computer Animation and Agent, pp. 259–266 (2004)
Weil, J.: The synthesis of cloth objects. Proc. SIGGRAPH’86, Computer Graphics, vol. 24, pp. 243–252 (1986)
Carignan, M., Yang, Y., Magnenat-Thalmann, N., Thalmann, D.: Dressing animated synthetic actors with complex deformable clothes. Computer Graphics (SIGGRAPH’92 Proceedings), vol. 26(2), pp. 99–104. Addison-Wesley, Reading (1992)
Volino, P., Courchesne, M., Magnenat-Thalmann, N.: Versatile and efficient techniques for simulating cloth and other deformable objects. Computer Graphics (SIGGRAPH’95 Proceedings), pp. 137–144. Addison-Wesley, Reading (1995)
Breen, D.E., House, D.H., Wozny, M.J.: Predicting the drape of woven cloth using interacting particles. Computer Graphics (SIGGRAPH’94 Proceedings), pp. 365–372. Addison-Wesley, Reading (1994)
Eischen, J.W., Deng, S., Clapp, T.G.: Finite-element modeling and control of flexible fabric parts, computer graphics in textiles and apparel. IEEE Computer Graphics and Applications, pp. 71–80 (1996)
Barff, D., Witkin, A.: Large steps in cloth simulation. ACM Trans Graph, Proceedings of ACM SIGGRAPH 1998, ACM SIGGRAPH, pp. 43–54, Addison Wesley, Reading (1998)
Eberhardt, B., Etzmuss, O., Hauth, M.: Implicit-explicit schemes for fast animation with particles systems. Proceedings of the Eurographics Workshop on Computer Animation and Simulation, pp. 137–151. Springer, Berlin Heidelberg New York (2000)
Volino, P., Magnenat-Thalmann, N.: Developing simulation techniques for an interactive clothing system. In: Virtual Systems and Multimedia (VSMM’97 Proceedings), pp. 109–118. IEEE Press, Geneva, Switzerland (1997)
Volino, P., Courchesne, M., Magnenat-Thalmann, N.: Versatile and efficient techniques for simulating cloth and other deformable objects. Computer Graphics (SIGGRAPH’95 Proceedings), pp. 137–144. Addison-Wesley, Reading (1995)
Eberhardt, B., Weber, A., Strasser, W.: A fast, flexible, particle-system model for cloth draping. Computer Graphics in Textiles and Apparel (IEEE Computer Graphics and Applications), pp. 52–59, September (1996)
Kang, Y.-M., Cho, H.-G.: Bilayered approximate integration for rapid and plausible animation of virtual cloth with realistic wrinkles. Proceedings of Computer Animation 2002, pp. 203. Geneva, Switzerland, IEEE Press, June (2002)
Hadap, S., Bangarter, E., Volino, P., Magnenat-Thalmann, N.: Animating wrinkles on clothes. IEEE Visualization ’99, pp. 175–182. IEEE Press, San Francisco (1999)
Ng, H., Grimsdale, R.L.: GEOFF – a geometrical editor for fold formation. Lecture Notes in Computer Science: Image Analysis Applications and Computer Graphics, vol. 1024, pp. 124–131. Springer, Berlin Heidelberg New York (1995)
Grzeszczuk, R., Terzopoulos, D., Hinton, G.: Neuroanimator: fast neural network emulation and control of physics-based models. SIGGRAPH 98 Conference Proceedings, Annual Conference Series, ACM SIGGRAPH, pp. 9–20. Addison Wesley, Reading (1998)
James, D.L., Fatahalian, K.: Precomputing interactive dynamic deformable scenes. ACM Transactions on Graphics (TOG), ACM SIGGRAPH, vol. 22(3), pp. 165–172. Addison Wesley, Reading (2003)
Cordier, F., Magnenat-Thalmann, N.: Real-time animation of dressed virtual human. Computer Graphics Forum, vol. 21(3), Blackwell Publishers, Oxford (2002)
Magnenat-Thalmann, N., Seo, H., Cordier, F.: Automatic modeling of virtual humans and body clothing. J Comput Sci Technol 19(6) (in press), Chinese Academy of Sciences, Beijing, China (publisher), December (2004)
Papagiannakis, G., Schertenleib, S., O’Kennedy, B., Poizat, M., Magnenat-Thalmann, N., Stoddart, A., Thalmann, D.: Mixing virtual and real scenes in the site of ancient Pompeii, J CAVW 16(1), 11–24 (2005)
Daldegan, A., Magnenat-Thalmann, N., Kurihara, T., Thalmann, D.: An integrated system for modeling, animating and rendering hair. Computer Graphics Forum (Eurographics ’93), vol. 12(3), pp. 211–221 (1993)
Rosenblum, R., Carlson, W., Tripp, E.: Simulating the structure and dynamics of human hair: modeling, rendering and animation. J Visual Comput Animat 2, 141–148 (1991)
Anjyo, K., Usami, Y., Kurihara, T.: A simple method for extracting the natural beauty of hair. Computer Graphics (Proceedings of SIGGRAPH 92), vol. 26(2), pp. 111–120, July (1992)
Lee, D.-W., Ko, H.S.: Natural hairstyle modeling and animation. In: Proceedings of International Workshop on Human Modeling and Animation, pp. 11–21, Seoul, Korea, June 2000. Korea Computer Graphics Society (2000)
Lin, M., Gottschalk, S.: Collision detection between geometric models: a survey. In: Proceedings IMA Conf. on Mathematics of Surfaces, pp.33–52 (1998)
Hadap, S., Magnenat-Thalmann, N.: Modeling dynamic hair as a continuum. Computer Graphics Forum, vol. 20(3), Eurographics Proceedings, Manchester, United Kingdom, September (2001)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Magnenat-Thalmann, N., Thalmann, D. Virtual humans: thirty years of research, what next?. Visual Comput 21, 997–1015 (2005). https://doi.org/10.1007/s00371-005-0363-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-005-0363-6