Relating image warping to 3D geometrical deformations

  • A. L. Yuille
  • Mario Ferraro
  • Tony Zhang
Session 5: Shapes & Surfaces
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1310)


We demonstrate that, for a large class of reflectance functions, there is a direct relationship between image warps and the corresponding geometric deformations of the underlying three-dimensional objects. This helps explain the hidden geometrical assumptions in object recognition schemes which involve two-dimensional image warping computed by matching image intensity. In addition, it allows us to propose a novel variant of shape from shading which we call shape from image warping. The idea is that the three-dimensional shape of an object is estimated by determining how much the image of the object is warped with respect to the image of a known prototype shape. Therefore detecting the image warp relative to a prototype of known shape allows us to reconstruct the shape of the imaged object. We derive properties of these shape warps and illustrate the results by recovering the shapes of faces.


Object Recognition Surface Normal Surface Extremum Reflectance Function Image Warp 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    J.J. Atick, P.A. Griffin, and A.N. Redlich. “Statistical Approach to Shape from Shading: Reconstruction of 3D Face Surfaces from Single 2D Images”. Preprint. The Computational Neuroscience Laboratory. The Rockefeller University. New York, NY. 1995.Google Scholar
  2. 2.
    R. Epstein, P.W. Hallinan and A.L. Yuille. “5 ± Eigenimages Suffice: An Empirical Investigation of Low-Dimensional Lighting Models”. In Proceedings of IEEE WORKSHOP ON PHYSICS-BASED MODELING IN COMPUTER VISION. 1995.Google Scholar
  3. 3.
    R. Epstein, A.L. Yuille, and P.N. Belhumeur. “Learning object representations from lighting variations”.In Object Representation in Computer Vision II. Eds. J. Ponce, A. Zisserman, and M. Hebert. Springer Lecture Notes in Computer Science 1144. 1996.Google Scholar
  4. 4.
    M.D. Greenberg. Foundations of Applied Mathematics. Prentice-Hall Inc. Englewood Cliffs, NJ. 1978.Google Scholar
  5. 5.
    P.W. Hallinan. “A low-dimensional lighting representation of human faces for arbitrary lighting conditions”. In. Proc. IEEE Conf. on Comp. Vision and Patt. Recog., pp 995–999. 1994.Google Scholar
  6. 6.
    P.W. Hallinan. A Deformgble Model for Face Recognition under Arbitrary Lighting Conditions. PhD Thesis. Division of Applied Sciences. Harvard University. 1995.Google Scholar
  7. 7.
    B.K.P. Horn. Computer Vision. MIT Press, Cambridge, Mass. 1986.Google Scholar
  8. 8.
    B.K.P. Horn and M. J. Brooks, Eds. Shape from Shading. Cambridge MA, MIT Press, 1989.Google Scholar
  9. 9.
    P.J. Huber. Robust Statistics. John Wiley and Sons. New York. 1981.Google Scholar
  10. 10.
    S.K. Nayar, K. Ikeuchi and T. Kanade “Surface reflections: physical and geometric perspectives” IEEE trans. on Pattern Analysis and Machine Intelligence, vol 13 p611–634. 1991.Google Scholar
  11. 11.
    J. Oliensis. “Shape from shading as a partially well-constrained problem”. Computer Vision, Graphics, and Image Processing: Image Understanding. 54, pp 163–183. 1991.Google Scholar
  12. 12.
    C. Von Westenholz. Differential forms in Mathematical Physics. North-Holland publishing company. Amsterdam. 1981.Google Scholar
  13. 13.
    A.L. Yuille, M. Ferraro, and T. Zhang. “Surface Shape from Warping and Object Recognition”. Smith-Kettlewell Eye Research Institute Preprint. 1996.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1997

Authors and Affiliations

  • A. L. Yuille
    • 1
  • Mario Ferraro
    • 2
  • Tony Zhang
    • 3
  1. 1.Smith-Kettlewell Eye Research InstituteSan Francisco
  2. 2.Dipartimento di Fisica SperimentaleUniversita' di TorinoTorinoItaly
  3. 3.Division of Applied SciencesHarvard UniversityCambridge

Personalised recommendations