Skip to main content
SpringerLink
Log in

Mathematical methods in shape-from-shading: A review of recent results

  • Published:
Acta Applicandae Mathematica Aims and scope Submit manuscript

Abstract

Recent developments in the mathematical methods in shape-from-shading are surveyed. The basic differential geometry of the problem is reviewed, especially as it relates to uniqueness. The algorithms of Horn, Lee, Frankot-Chellappa, Shao-Simchony-Chellappa, Szeliski and others are discussed. These algorithms include regularization techniques to impose integrability or smoothness constraints, discrete smoothing splines, multi-resolution techniques, and associated iterative methods. Related issues of shape-from-texture, shape-from-shading in SAR imagery and illuminant direction estimation are explored.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Aloimonos, J.: Visual shape computation, Proc. IEEE 76 (1988), 899–916.

    Google Scholar 

  • Aloimonos, J.: Shape from texture, Biol. Cyber. 58 (1988), 345–360.

    Google Scholar 

  • Aloimonos, J. and Swaim, M.: Shape from patterns: regularization, Int. J. Comp. Vision (1988).

  • Bajacsy, R. and Lieberman, L.: Computer description of real outdoor scenes, in Proc. 2nd Int. Jt. Conf. Pattern Rec. (Copenhagen, 1974), 174–179.

  • Bajacsy, R. and Lieberman, L.: Texture gradient as a depth cue, CGIP 5 (1976), 52–67.

    Google Scholar 

  • Barrow, H. G. and Tenenbaum, J. M.: Recovering intrinsic scene characteristics from images, in Computer Vision Systems, Academic Press, New York, 1978, pp. 3–26.

    Google Scholar 

  • Barrow, H. G. and Tenenbaum, J. M.: Interpreting line drawings as 3-D surfaces, Artifical Intelligence 17 (1981), 75–117.

    Google Scholar 

  • Bertero, M., Poggio, T. A. and Torre, V.: Ill-posed problems in early vision, Proc. IEEE 76 (1988), 869–889.

    Google Scholar 

  • Blake, A. and Marinos, M.: Shape from texture: estimation, isotropy and moments, J. Art. Int. (to appear).

  • Blake, A. and Zisserman, A.: Visual Reconstruction, MIT Press, Cambridge, 1987.

    Google Scholar 

  • Blake, A., Zisserman, A. and Knowles, G.: Surface descriptions from stereo and shading, Imag. Vis. Comp. 3 (1985), 183–191.

    Google Scholar 

  • Brady, M. and Yuille, A.: An extremum principle for shape from contour, IEEE PAMI 6 (1984), 288–301.

    Google Scholar 

  • Briggs, W. L.: A Multigrid Tutorial, SIAM, Philadelphia, 1987.

    Google Scholar 

  • Brooks, M. J.: Surface normals from closed paths, Proc. 1979 Int. Jt. Conf. Art. Int. (Tokyo, 1979), 98–101.

  • Brooks, M. J. and Horn, B. K. P.: Shape and source from shading, Proc. Int. Jt. Conf. Art. Int. (Los Angeles, 1985), 932–936.

  • Bruss, A. R.: Is what you see what you get? Proc. Int. Jt. Conf. Art. Int. (Karlsruhe, 1983), 1053–1056.

  • Bruss, A. R.: The eikonal equation: some results applicable to computer vision, J. Math. Phys. 23 (1982), 890–896.

    Google Scholar 

  • Buzbee, B., Golub, G. and Nielson, C.: On direct methods for solving Poisson's equations, SIAM J. Num. Anal. 7 (1970), 627–656.

    Google Scholar 

  • Choe, Y. and Kashyap, R. L.: Shape from textured and shaded surface, 10th International Conference on Pattern Recognition (1990).

  • Davis, L. S., Janos, L. and Dunn, S. M.: Efficient recovery of shape from texture, IEEE PAMI 5 (1983), 485–492.

    Google Scholar 

  • Deift, P. and Sylvester, J.: Some remarks on the shape-from-shading problem in computer vision, J. Math. Anal. Appl. 84 (1981), 235–248.

    Google Scholar 

  • Frankot, R. T. and Chellappa, R.: Application of a shape form shading technique to synthetic aperture radar imagery, IEEE Int. Geosci. Remote Sensing Symp. (Ann Arbor, 1987), 1323–1329.

  • Frankot, R. T. and Chellappa, R.: A method for enforcing integrability in shape form shading algorithms, IEEE PAMI-10 (1988) 439–451; see also Proc. 1st Int. Conf. Comp. Vis. (1987), 118–127.

  • Frankot, R. T. and Chellappa, R.: Lognormal random field models and their application to radar image synthesis, IEEE GE 25 (1987), 195–207.

    Google Scholar 

  • Frankot, R. T. and Chellappa, R.: Estimation of surface topography from SAR imagery using shape from shading techniques, Artificial Intelligence 43 (1990), 271–310.

    Google Scholar 

  • Garding, J.: Shape form texture and contour by weak isotropy, 10th International Conference on Pattern Recognition (1990).

  • Geman, S. and Hwang, C.: Diffusions for global optimization, SIAM J. Control. Optim 24 (1986), 1031–1043.

    Google Scholar 

  • Gibson, J. J.: The perception of the visual surfaces, Amer. J. Psychology 63 (1950), 367–384.

    Google Scholar 

  • Gibson, J. J.: The Perception of the Visual World, Houghton Mifflin, New York, 1950.

    Google Scholar 

  • Grimson, W. E. L.. Images to Surfaces: A Computational Study of the Human Early Vision System, MIT Press, Cambridge, 1981.

    Google Scholar 

  • Grimson, W. E. L.: An implementation of a computational theory of visual surface interpolation, CVGIP 22 (1983), 39–69.

    Google Scholar 

  • Grimson, W. E. L.: Binocular shading and visual surface reconstruction, CVGIP 28 (1984), 18–44.

    Google Scholar 

  • Grimson, W. E. L. and Pavlidis, T.: Discontinuity detection for visual surface reconstruction, CVGIP 30 (1985), 316–330.

    Google Scholar 

  • Horn, B. K. P.: Determining lightness from an image, CGIP 3 (1974), 277–299.

    Google Scholar 

  • Horn, B. K. P.: Obtaining shapes from shading information, in Psychology of Computer Vision, McGraw-Hill, New York, 1975, pp. 115–155.

    Google Scholar 

  • Horn, B. K. P.: Understanding image intensities, Artificial Intelligence 8 (1977), 201–231.

    Google Scholar 

  • Horn, B. K. P.: Hill-shading and the reflectance map, Proc. IEEE 69 (1981), 14–47.

    Google Scholar 

  • Horn, B. K. P.: Extended Gaussian images, Proc. IEEE 72 (1984), 1656–1678.

    Google Scholar 

  • Horn, B. K. P.: Robot Vision, McGraw-Hill, New York, 1986.

    Google Scholar 

  • Horn, B. K. P.: Height and slope from shading, Inter. J. Comp. Vis. (to appear).

  • Horn, B. K. P. and Brooks, M. J.: The variational approach to shape from shading, CVGIP 33 (1986), 174–208.

    Google Scholar 

  • Horn, B. K. P. and Brooks, M. J. (eds.), Shape from Shading, MIT Press, Cambridge, 1989.

    Google Scholar 

  • Horn, B. K. P. and Sjoberg, R. W.: Calculating the reflectance map, Appl. Optim. 18 (1979), 1770–1779.

    Google Scholar 

  • Horn, B. K. P., Szeliski, R. and Yuille, A. L.: Impossible shaded images, MIT AI Lab, preprint, 1989.

  • Ikeuchi, K.: Constructing a depth map from images, MIT AIM-774, 1983.

  • Ikeuchi, K.: Shape from regular patterns, Artificial Intelligence 22 (1984), 49–75.

    Google Scholar 

  • Ikeuchi, K. and Horn, B. K. P.: Numerical shape from shading and occluding boundaries, Artificial Intelligence 17 (1981), 141–184.

    Google Scholar 

  • Jau, Y. C. and Chin, R. T.: Shape from texture using the Wigner distribution, in IEEE Comp. Soc. Conf. Computer Vision and Pattern Rec. (Ann Arbor, 1988).

  • Kanatani, K.: Detection of surface orientation and motion from texture by a stereological technique, Artificial Intelligence 23 (1984), 213–237.

    Google Scholar 

  • Kanatani, K. and Chou, T.: Shape from texture: general principle, Artificial Intelligence 38 (1989), 1–48.

    Google Scholar 

  • Kender, J. R.: Shape from texture, in Proc. 6th Int. Jt. Conf. Art. Int. (Tokyo, 1979), 475–480.

  • Keydel, W.: Application and experimental verification of an empirical backscattering cross section model for the earth's surface, IEEE GE 20, (1982), 67–71.

  • Kube, P. and Pentland, A.: On the imaging of fractal surfaces, IEEE PAMI 10 (1988), 704–707.

    Google Scholar 

  • Leberl, F. W.: Radargrammetric Image Processing, Artech House, Norwood, 1990.

    Google Scholar 

  • Lee, C. H. and Rosenfeld, A.: Improved methods of estimating shape from shading using the light source coordinate system, Artificial Intelligence 6 (1985), 125–143.

    Google Scholar 

  • Lee, D.: A provably convergent algorithm for shape from shading, DARPA Image Understanding Workshop (Miami, 1985), 489–496.

  • Lee, D.: Optimal algorithms for image understanding, J. Complexity 1 (1985), 138–146.

    Google Scholar 

  • Lee, D.: Some computational aspects of low-level computer vision, Proc. IEEE 76 (1988), 890–898.

    Google Scholar 

  • Lee, D.: Algorithms for shape form shading and occluding boundaries, Proc. Comp. Vis. Patt. Recog. (Ann Arbor, 1988), 478–485.

  • Lee, D. and Papageorgiou, A.: Shading boundary conditions and surface of Mars, Tech. Mem. AT&T (1988).

  • Marinos, C. and Blake, A.: Shape from texture: the homogeneity hypothesis, preprint, 1990.

  • Maurer, H.: Testure analysis with Fourier series, Proc. 9th Inter. Symp. Remote Sensing Envir. (Ann Arbor, 1974), 1411–1420.

  • Ohta, Y., Maenobu, K. and Sakai, T.: Obtaining surface orientation from texels under perspective projection, Proc. 7th Inter. Jt. Conf. Art. Int. (1981), 746–751.

  • Oliensis, J.: Existence and uniqueness in shape from shading, COINS TR 89-109, Univ. Mass., 1989.

  • Palis, J. and Melo, W.de: Geometric Theory of Dynamical Systems, Springer-Verlag, New York, 1982.

    Google Scholar 

  • Palis, J. and Smale, S.: Structural stability theorems, Proc. Symp. Pure Math. 15. (Berkeley, 1968), 223–231.

    Google Scholar 

  • Peet, F. G. and Sahota, T. S.: Surface curvature as a measure of image texture, IEEE PAMI 7 (1985), 734–738.

    Google Scholar 

  • Peleg, S., Naor, J., Hartley, R. and Avnir, D.: Multiple resolution texture analysis and classification, CAR-TR-17, Un. Maryland Tech. Memo, 1983.

  • Pentland, A. P.: Finding the illuminant direction, J. Optim Soc. Am. 72 (1982), 448–455.

    Google Scholar 

  • Pentland, A. P.: Fractal-based description of natural scenes, Proc. IEEE 1983 CV PR, pp. 201–209.

  • Pentland, A. P.: Fractal textures, Proc. IJCAI 83 (Karlsruhe, 1983).

  • Pentland, A. P.: Local shading anslysis, IEEE PAMI 6 (1984), 170–187.

    Google Scholar 

  • Pentland, A. P.: Fractal based description of natural scenes, IEEE PAMI 6 (1984), 661–674.

    Google Scholar 

  • Pentland, A. P.: On describing complex surfaces, Image Vis. Comp. 3 (1986), 153–162.

    Google Scholar 

  • Pentland, A. P.: Shading into texture, Artificial Intelligence 29 (1986), 147–170.

    Google Scholar 

  • Pentland, A. P.: Perceptual organization and the representation of natural form, Artificial Intelligence 28 (1986), 293–331.

    Google Scholar 

  • Pentland, A. P. (ed.), From Pixels to Predicates, Ablex, Norwood, NJ, 1986.

    Google Scholar 

  • Pentland, A.: Shape information from shading: a theory about human perception, IEEE 2nd Inter. Conf. Comp. Vis. (1988), 404–411.

  • Poggio, T., Torre, V. and Kock, C.: Computational vision and regularization theory, Nature 317 (1985), 314–319.

    Google Scholar 

  • Rindfleisch, T.: Photometric method for lunar topography, Photog. Eng. 32 (1966), 262–276.

    Google Scholar 

  • Ron, G. and Peleg, S.: Multiresolution shape from shading, CVPR'89 (1989), 350–355.

  • Saunders, R. S.: The surface of Venus, Scien. Amer. 263 (1990), 60–65.

    Google Scholar 

  • Saxberg, B. V. H.: A modern differential geometric approach to shape from shading, MIT AI Lab, Tech. Rep. 1117, 1989.

  • Shao, M., Simchony, T. and Chellappa, R.: New algorithms for reconstruction of a 3-d depth map from one or more images, Proc. Comp. Vis. Patt. Rec. (Ann Arbor, 1988), 530–535.

  • Simchony, T. and Chellappa, R.: Direct analytical methods for solving Poisson equations in computer vision problems, IEEE Comp. Vis. Workshop (1987, Miami Beach).

  • Simchony, T., Chellappa, R. and Lichtenstein, Z.: Pyramid implementation of optimal-step conjugate-search algorithms for some low-level vision problems, IEEE Trans. Systems Man Cybernet. 19 (1988), 1408–1424.

    Google Scholar 

  • Simchony, T., Chellappa, R. and Shao, M.: Direct analytical methods for solving Poisson equations in computer vision problems, IEEE PAMI 12 (1990), 435–446.

    Google Scholar 

  • Smith, G. B.: From image irradiance to surface orientation, SRI Tech. Note 273, 1982.

  • Smith, G. B.: Shape from shading: an assessment, SRI Tech. Note 287, 1983.

  • Smith, G. B.: The relationship between image irradiance and surface orientation, Proc. IEEE 1983 CV PR, pp. 14–19.

  • Strat, T. M.: A numerical method for shape from shading in a single image, MS thesis, MIT, 1979.

  • Szeliski, R.: Fast shape from shading, preprint, 1990.

  • Szeliski, R.: Fast shape from shading, ECCV'90 (1990), 359–368.

  • Terzopoulos, D.: Multilevel computational processes for visual surface reconstruction, CVGIP 24 (1983), 52–96.

    Google Scholar 

  • Terzopoulos, D.: Multigrid relaxation methods and the analysis of lightness, shading and flow, MIT AI Memo 803, 1984.

  • Terzopoulos, D.: Multiresolution algorithms in computational vision, in Image Understanding 1984, Ablex, Norwood, 1984, chap. 10.

  • Terzopoulos, D.: Regularization of inverse visual problems involving discontinuities, IEEE PAMI 8 (1986), 413–424.

    Google Scholar 

  • Tikhonov, A. N. and Arsenin, V. A.: Solutions of Ill-Posed Problems, Winston & Sons, Washington, D.C., 1977.

    Google Scholar 

  • Troutman, J. L.: Variational Calculus with Elementary Convexity, Springer-Verlag, New York, 1983.

    Google Scholar 

  • Van, Diggelen, J.: A photometric investigation of the slopes and heights of the ranges of hills in the maria of the moon, Bull. Astron. Inst. Netherlands 11 (1951), 283–289.

    Google Scholar 

  • Wildey, R. L.: Generalized photoclinometry for Mariner 9, Icarus 25 (1975), 613–626.

    Google Scholar 

  • Wildey, R. L.: Topography from single radar images, Science 224 (1984), 153–156.

    Google Scholar 

  • Wildey, R. L.: Radarclinometry for the Venus radar mapper, Photog. Eng. Rem. Sen. 52 (1989), 41–50.

    Google Scholar 

  • Witkin, A. P.: Recovering surface shape and orientation from texture, Artificial Intelligence 17 (1981), 17–47.

    Google Scholar 

  • Woodham, R. J.: Relating properties of surface curvature to image intensity, Proc. 6th IJCAI (Tokyo, 1979), 971–977.

  • Woodham, R. J.: Using digital terrain data to model image formation in remote sensing, Proc. SPIE 238 (1980), 361–369.

    Google Scholar 

  • Woodham, R. J.: Analyzing images of curved surfaces, Artificial Intelligence 17 (1981), 117–140.

    Google Scholar 

  • Yserentant, H.: On the multi-level splitting of finite element spaces, Numer. Math. 49 (1986), 369–412.

    Google Scholar 

  • Zheng, Q. and Chellappa, R.: A robust algorithm for inferring shape from shading, preprint, Dept. Elec. Eng. Systems, USC, 1991.

Download references

Author information

Authors and Affiliations

  1. Zeta Associates, Inc., 10300 Eaton Pl., Suite 500, 22030, Fairfax, VA, U.S.A.

    Norman E. Hurt

Authors
  1. Norman E. Hurt
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hurt, N.E. Mathematical methods in shape-from-shading: A review of recent results. Acta Appl Math 23, 163–188 (1991). https://doi.org/10.1007/BF00048804

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00048804

AMS subject classification (1991)

Key words

Search

Navigation