Abstract
We present a new implementation of an algorithm aimed at recovering a 3D shape from its 2D gray-level picture. In order to reconstruct the shape of the object, an almost arbitrarily initialized 3D function is propagated on a rectangular grid, so that a level set of this function tracks the height contours of the shape. The method imports techniques from differential geometry, fluid dynamics, and numerical analysis and provides an accurate shape from shading algorithm. The method solves some topological problems and gracefully handles cases of non-smooth surfaces that give rise to shocks in the propagating contours. Real and synthetic images of 3D profiles were submitted to the algorithm and the reconstructed surfaces are presented, demonstrating the effectiveness of the proposed method.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ascher, U.M. and Carter, P.M. 1993. A Multigrid Method for Shape from Shading.SIAM J. Numer. Anal. 30(1): 102–115.
Brooks, M.J. and Horn, B.K.P. 1985. Shape and Source from Shading.Proc. Intern. Joint Conf. Artif. Intell., Los Angeles, pp. 932–936. Also in Horn and Brooks, 1989.
Bruckstein, A.M. 1988. On Shape from Shading.Comput. Vision Graphics Image Process, 44:139–154. First appearedOn Shape from Shading: Some Theoretical Considerations. EE Report No. 524, Technion—Israel Institute of Technology, 1985.
Cayley, A. 1859. On Contour and Slope Lines.Philos. Mag., pp. 264–268.
Chopp, D.L. 1991. Computing Minimal Surfaces via Level Set Curvature Flow. Lawrence Berkeley Lab. and Dep. of Math., Uni. of CA. Berkeley, LBL-30685, Ph.D Thesis.
Chopp, D.L. and Sethian, J.A. 1991. Flow Under Mean Curvature: Singularity Formation and Minimal Surfaces.Center for pure applied math. Univ. of CA. Berkeley, PAM-541.
Chorin, A.J. 1980. Flame Advection and Propagation Algorithms.J. of Comput. Phys., 35:1–11.
Chorin, A.J. 1985. Curvature and Solidification.J. of Comput. Phys., 58:472–490.
Courant, R. and Hilbert, D. 1953. Methods of Mathematical Physics, Vol. I. Wiley: New York.
Courant, R. and Hilbert D. 1962. Methods of Mathematical Physics, Vol. II. Wiley: New York.
Frankot, R.T. and Chellappa, R. 1988. A Method of Enforcing Integrability in Shape from Shading Algorithms.IEEE Trans. Pattern Anal. Mach. Intell., 4(10):439–451. Also in Horn and Brooks, 1989.
Horn, B.K.P. 1975. Obtaining Shape from Shading Information. In P.H. Winston (ed.),The Psychology of Computer Vision, McGraw Hill: New York. pp. 115–155. Also in Horn and Brooks, 1989.
Horn, B.K.P. 1986. Robot Vision. MIT Press: Cambridge, MA; and McGraw-Hill: New York.
Horn, B.K.P. 1990. Height and Gradient from Shading.Int. J. of Comput. Vision, 5:37–75.
Horn, B.K.P. and Brooks, M.J. 1986. The Variational Approach to Shape from Shading.Comput. Vision, Graph. Image Process, 2(33):174–208. Also in Horn and Brooks, 1989.
Horn B.K.P. and Brooks M.J. (eds.) 1989. Shape from Shading. MIT Press: Cambridge, MA.
Ikeuchi, K. and Horn, B.K.P. 1981. Numerical Shape from Shading and Occluding Boundaries.Artificial Intelligence, 17(1–3):141–184. Also in Horn and Brooks, 1989.
John, F. 1982. Partial Differential Equations. InApplied Mathematical Sciences, 4th ed., Springer Verlag, New York.
Kimia, B.B. 1990. Toward a Computational Theory of Shape. Ph.D. Thesis, Department of Electrical Engineering, McGill University, Montreal.
Kimia, B.B. and Siddiqi K. 1994. Geometric Heat Equation and Non-linear Diffusion of Shapes and Images. InProc. of CVPR.
Kimia, B.B., Tannenbaum, A., and Zucker, S.W. 1990. Toward a Computational Theory of Shape: An Overview. InProceedings of the First European Conference on Computer Vision, Springer Verlag, Antibes, France.
Kimia, B.B., Tannenbaum, A., and Zucker, S.W. 1992. On the Evolution of Curves via a Function of Curvature, (I): The Classical Case.J. of Math. Analysis and Applications, 163(2):000-000.
Kimia, B.B., Tannenbaum, A., and Zucker, S.W. (to appear). Shapes, Shocks, and Deformations, I: The Components of Shape and the Reaction-Diffusion Space.International Journal of Computer Vision.
Kimmel, R. 1992. Shape from Shading via Level Sets.M.Sc. Thesis (in Hebrew), Technion-Israel Institute of Technology.
Kimmel, R. and Bruckstein, A.M. 1992. Shape from Shading via Level Sets. CIS Report #9209, CS Department, Technion.
Kimmel, R. and Bruckstein, A.M. 1993a. Distance Maps and Weighted Distance Transforms.Proceedings SPIE—Geometric Methods in Computer Vision II, San Diego, California, 2031: 259–268.
Kimmel, R. and Bruckstein, A.M. 1993b. Global Shape from Shading. CIS Report #9327, CS Department, Technion, to appear inCVIU.
Kimmel, R. and Bruckstein, A.M. 1993c. Tracking Level Sets by Level Sets: A Method for Solving the Shape from Shading Problem. CIS Report # 9319, CS Department, Technion.CVIU, 62(l):47–58, July 1995.
Kimmel, R., Kiryati, N., and Bruckstein, A.M. 1994. Distance Maps and Weighted Distance Transforms. To appear inJ. of Mathematical Imaging and Vision, Special Issue on Topology and Geometry in Computer Vision.
Maxwell, J.C. 1870. On Hills and Dales.Philos. Mag. (Maxwell's Collected Works), pp. 233–240.
Mitchel, A.R. and Griffiths, D.F. 1985. The Finite Difference Method in Partial Differential Equations. Wiley: New York.
Oliensis, J. 1990. Uniqueness in Shape from Shading.Int. J. of Comput. Vision, 6(2):75–104.
Oliensis, J. 1991. Shape from Shading as Partially Well-Constrained Problem.CVGIP: Image Understanding, 54(2): 163–183.
Osher, S. and Rudin., L. 1993. Rapid convergence of approximate solutions to shape-from-shading problem,Cognitech Inc., Unpublished.
Osher, S.J. and Sethian, J.A. 1988. Fronts Propagating with Curvature Dependent Speed: algorithms based on Hamilton-Jacobi formulations.J. of Comp. Phys, 79:12–49.
Osher, S.J. and Shu, C.W. 1991. High-Order Essentially Nonoscillatory Schemes for Hamilton-Jacobi Equations.SIAM J. Numer. Anal.,28(4):907–022.
Pentland, A.P. 1989. Local Shading Analysis.IEEE Trans. on PAMI, 6(2):170–187. Also in Horn and Brooks, 1989.
Pentland, A.P. 1990. Linear Shape from Shading.Int. J. of Comput. Vision, 4:153–162.
Rouy, E. and Tourin, A. 1992. A viscosity solutions approach to shape-from-shading.SIAM. J. Numer. Anal., 29(3): 867–884.
Sethian, J.A. 1985. Curvature and the Evolution of Fronts.Commun. in Math. Phys., 101:487–499.
Sethian, J.A. 1987. Numerical Methods for Propagating Fronts. InVariational methods for free surface interfaces, P. Concus and R. Finn (eds.), Springer-Verlag, New York.
Sethian, J.A. 1989. A Review of Recent Numerical Algorithms for Hypersurfaces Moving with Curvature Dependent Speed.J. of Diff. Geom., 33:131–161.
Sethian, J.A. and Strain, J. 1992. Crystal Growth and Dendritic Solidification, submitted for publication:J. of Computational Physics, 98:231–253.
Sod, G.A. 1985. Numerical Methods in Fluid Dynamics, Cambridge Univ. Press.
Zhu, J. and Sethian, J.A. 1991. Projection Methods Coupled to Level Set Interface Techniques. Lawrence Berkeley Lab. and Dep. of Math., Univ. of CA. Berkeley, LBL-30183.
Author information
Authors and Affiliations
Additional information
R. Kimmel's work was partly supported by the Ollendorf Fund.
B.B. Kimia's work was supported by the Sun Microsystems Academic Equipment Grant.
A.M. Bruckstein's work was supported in part by the Fund for the Promotion of Research at the Technion.
Rights and permissions
About this article
Cite this article
Kimmel, R., Siddiqi, K., Kimia, B.B. et al. Shape from shading: Level set propagation and viscosity solutions. Int J Comput Vision 16, 107–133 (1995). https://doi.org/10.1007/BF01539551
Issue Date:
DOI: https://doi.org/10.1007/BF01539551