Generating 3D Virtual Populations from Pictures of a Few Individuals

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1663)


This paper describes a method for cloning faces from two orthogonal pictures and for generating populations from a small number of these clones. An efficient method for reconstructing 3D heads suitable for animation from pictures starts with the extraction of feature points from the orthogonal picture sets. Data from several such heads serve to statistically infer the parameters of the multivariate probability distribution characterizing a hypothetical population of heads. A previously constructed, animation-ready generic model is transformed to each individualized head based on the features either extracted from the orthogonal pictures or determined by a sample point from the multivariate distribution. Using projections of the 3D heads, 2D texture images are obtained for individuals reconstructed from pictures, which are then fitted to the clone, a fully automated procedure resulting in 360° texture mapping. For heads generated through population sampling, a texture morphing algorithm generates new texture mappings.


Feature Point Texture Image Feature Line Texture Mapping Head Shape 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Tsuneya Kurihara and Kiyoshi Arai, “A Transformation Method for Modeling and Animation of the Human Face from Photographs”, In Proc. Computer Animation’91, Springer-Verlag, Tokyo, pp. 45–58, 1991.Google Scholar
  2. 2.
    Takaaki Akimoto, Yasuhito Suenaga, and Richard S. Wallace, Automatic Creation of 3D Facial Models, IEEE Computer Graphics & Applications, Sept., 1993Google Scholar
  3. 3.
    Horace H.S. Ip, Lijin Yin, Constructing a 3D individual head model from two orthogonal views. The Visual Computer, Springer-Verlag, 12:254–266, 1996.Google Scholar
  4. 4.
    Lee W. S., Kalra P., Magnenat-Thalmann N, “Model Based Face Reconstruction for Animation”, In Proc. Multimedia Modeling (MMM’97), World Scientific, Singapore, pp. 323–338, 1997.Google Scholar
  5. 5.
    Yuencheng Lee, Demetri Terzopoulos, and Keith Waters, “Realistic Modeling for Facial Animation”, In Computer Graphics (Proc. SIGGRAPH’96), pp. 55–62, 1996.Google Scholar
  6. 6.
    Douglas DeCarlo, Dimitris Metaxas and Matthew Stone, “An Anthropometric Face Model using Variational Techniques”, In Computer Graphics (Proc. SIG-GRAPH’98), pp. 67–74, 1998.Google Scholar
  7. 7.
    Brian Guenter, Cindy Grimm, Daniel Wood, “Making Faces”, In Computer Graphics (Proc. SIGGRAPH’98), pp. 55–66, 1998.Google Scholar
  8. 8.
    Frederic Pighin, Jamie Hecker, Dani Lischinski, Richard Szeliski, David H. Salesin, Synthesizing “Realistic Facial Expressions from Photographs”, In Computer Graphics (Proc. SIGGRAPH’98), pp. 75–84, 1998.Google Scholar
  9. 10.
    Peter J. Burt and Edward H. Andelson, “A Multiresolution Spline with Application to Image Mosaics”, ACM Transactions on Graphics, 2(4):217–236, Oct., 1983.CrossRefGoogle Scholar
  10. 11.
    Marc Proesmans, Luc Van Gool, “Reading between the lines-a method for extracting dynamic 3D with texture”. In Proc. of VRST’97, pp. 95–102, 1997.Google Scholar
  11. 12.
    S.-Y. Lee, K.-Y. Chwa, S.-Y. Shin, G. Wolberg, “Image metamorphosis using Snakes and Free-Form deformations”, In Computer Graphics (Proc. SIG-GRAPH’95), pp. 439–448, 1995.Google Scholar
  12. 13.
    P. Fua, “Face Models from Uncalibrated Video Sequences”, In Proc. CAPTECH’98, pp. 215–228, 1998.Google Scholar
  13. 14.
    Sederberg T. W., Parry S. R., “Free-Form Deformation of Solid Geometric Models”, In Computer Graphics (Proc. SIGGRAPH’86), pp. 151–160, 1986.Google Scholar
  14. 15.
    Sibson R., “A Vector Identity for the Dirichlet Tessellation”, Math. Proc. Cambridge Philos. Soc., 87, pp. 151–155, 1980.MathSciNetzbMATHCrossRefGoogle Scholar
  15. 16.
    Aurenhammer F., “Voronoi Diagrams-A Survey of a Fundamental Geometric Data Structure”, ACM Computing Survey, 23, 3, September 1991.Google Scholar
  16. 17.
    Farin G., “Surface Over Dirichlet Tessellations”, Computer Aided Geometric Design, 7, pp. 281–292, North-Holland, 1990.MathSciNetzbMATHCrossRefGoogle Scholar
  17. 18.
    DeRose T.D., “Composing Bezier Simplexes”, ACM Transactions on Graphics, 7(3), pp. 198–221, 1988.zbMATHCrossRefGoogle Scholar
  18. 19.
    Moccozet L., MagnenatThalmann N., “Dirichlet Free-Form Deformations and their Application to Hand Simulation”, In Proc. Computer Animation’97, IEEE Computer Society, pp.93–102, 1997.Google Scholar
  19. 20.
    Kalra P, Mangili A, Magnenat-Thalmann N, Thalmann D, “Simulation of Facial Muscle Actions Based on Rational Free Form Deformations”, Proc. Eurographics’92, pp. 59–69, NCC Blackwell,1992.Google Scholar
  20. 21.
    Kendall, M. G. and Stuart, A. Advanced Theory of Statistics, vol. 3. Griffin, 1976.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1999

Authors and Affiliations

  1. 1.Miralab, Centre Universitaire d’InformatiqueUniversity of GenevaGeneva 4Switzerland
  2. 2.Centre de recherches mathématiquesUniversité de MontréalMontréal H3CQuébec

Personalised recommendations