Skip to main content
SpringerLink
Log in

3D Reconstruction by Shadow Carving: Theory and Practical Evaluation

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

Cast shadows are an informative cue to the shape of objects. They are particularly valuable for discovering object’s concavities which are not available from other cues such as occluding boundaries. We propose a new method for recovering shape from shadows which we call shadow carving. Given a conservative estimate of the volume occupied by an object, it is possible to identify and carve away regions of this volume that are inconsistent with the observed pattern of shadows. We prove a theorem that guarantees that when these regions are carved away from the shape, the shape still remains conservative. Shadow carving overcomes limitations of previous studies on shape from shadows because it is robust with respect to errors in shadows detection and it allows the reconstruction of objects in the round, rather than just bas-reliefs. We propose a reconstruction system to recover shape from silhouettes and shadow carving. The silhouettes are used to reconstruct the initial conservative estimate of the object’s shape and shadow carving is used to carve out the concavities. We have simulated our reconstruction system with a commercial rendering package to explore the design parameters and assess the accuracy of the reconstruction. We have also implemented our reconstruction scheme in a table-top system and present the results of scanning of several objects.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Horn, B.K.P. and Brooks, M.J. 1989. Shape from Shading. MIT Press.

  • Rocchini, C., Cignoni, P., Montani, C., Pingi, P., and Scopigno, R. 2001. A low cost optical 3D scanner. Compute Graphics Forum 20(3):299–309.

    Article  Google Scholar 

  • Bouguet, J.-Y. and Perona, P. 1999. 3D photography using shadow in dual space geometry. International Journal of Computer Vision, 35(2):129–149.

    Article  Google Scholar 

  • Andreetto, M., Brusco, N., and Cortelazzo, G.M. 2004. Automatic 3D modeling of textured cultural heritage objects. IEEE Transactions on Image Processing, 13(3):354–369.

    Article  Google Scholar 

  • Shafer, S.A. and Kanade, T. 1983. Using shadows in finding surface orientations. Computer Vision, Graphics, and Image Processing 22:145–176.

    Article  Google Scholar 

  • Hambrick, L.N., Loew, M.H., and Carroll, R.L. 1987. The entry-exit method of shadow boundary segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 9(5):597–607.

    Google Scholar 

  • Kriegman, D. and Belhumeur, P. 2001. What shadows reveal about object structure. Journal of the Optical Society of America–A, 18(8):1804–1813.

    Google Scholar 

  • Hatzitheodour, M. and Kender, M. 1988. An optimal algorithm for the derivation of shape from shadows. In Proc. of Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 486–491.

  • Raviv, D., Pao, Y.-H., and Loparo, K.A. 1989. Reconstruction of three-dimensional surfaces from two-dimensional binary images. IEEE Transactions on Robotics and Automation, 5(5):701–710.

    Article  Google Scholar 

  • Langer, M.S., Dudek, G., and Zucker, S.W. 1995. Space occupancy using multiple shadow images. In Proc. of the International Conference on Intelligent Robotics and Systems, Pittsburg, PA, pp. 390–396.

  • Daum, M. and Dudek, G. 1998. On 3D surface reconstruction using shape from shadows. In Proc. of Computer Society Conf. on Computer Vision and Pattern Recognition, Santa Barbara, CA, pp. 461–468.

  • Yang, D.K.-M. 1996. Shape from Darkness Under Error, Ph.D. thesis, Columbia University.

  • Yu, Y. and Chang, J. 2005. Shadow graphs and 3D texture reconstruction. International Journal of Computer Vision, 62(1–2):35–60.

    Google Scholar 

  • Kutulakos, K.N. and Seitz, S.M. 1999. A theory of shape by space carving. In Proc. of the Interational Conference on Computer Vision, Kerkyra, Greece, pp. 307–313.

  • Savarese, S., Rushmeier, H., Bernardini, F., and Perona, P. 2002. Implementation of a shadow carving system for shape capture. In Proc. of 3D Data Processing Visualization and Trasmission, pp. 12–23.

  • Savarese, S., Rushmeier, H., Bernardini, F., and Perona, P. 2001. Shadow carving. In Proc. of the Int. Conf. on Computer Vision, pp. 190–197.

  • Martin, W.N. and Aggarwal, J.K. 1983. Volumetric descriptions of objects from multiple views. IEEE Transactions on Pattern Analysis and Machine Intelligence, 5(2):150–158.

    Google Scholar 

  • Szeliski, R. 1993. Rapid octree construction from image sequences. Computer Vision, Graphics and Image Processing, 58(1):23–32.

    Article  Google Scholar 

  • Lorensen, W. and Cline, H. 1987. Marching cubes: A high resolution 3D surface construction algorithm. Computer Graphics, 21:163–169.

    Google Scholar 

  • Reed, M.K. and Allen, P.K. 1999. 3D modeling from range imagery: An incremental method with a planning component. Image and Vision Computing, 17:99–111.

    Article  MATH  Google Scholar 

  • Laurentini, A. 1995. How far 3D shapes can be understood from 2D silhouettes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(2):188–195.

    Article  Google Scholar 

  • Koenderink, J. 1984. What does the occluding contour tell us about solid shape? Perception, 13:321–330.

    Google Scholar 

  • Giblin, P. and Weiss, R. 1986. Reconstruction of surfaces from profiles. In Proceedings of the International Conference Computer Vision, pp. 136–144.

  • Vaillant, R. and Faugeras, O. 1992. Using extremal boundaries for 3D object modeling. IEEE Transaction of Pattern Analysis and Machine Intelligence, 14(2):157–173.

    Article  Google Scholar 

  • Cipolla, R. and Blake, A. 1992. Surface shape from the deformation of apparent contours. International Journal of Computer Vision, 9(2):99–111.

    Article  Google Scholar 

  • Zheng, J.Y. 1994. Acquiring 3D models from sequences of contours. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(2):163–178.

    Article  Google Scholar 

  • Lazebnik, S., Boyer, E., and Ponce, J. 2001. On computing exact visual hulls of solids bounded by smooth surfaces. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 156–161.

  • Fitzgibbon, A., Cross, G., and Zisserman, A. 1998. Automatic 3D model construction for turn-table sequences. In Proceedings of SMILE Workshop on Structure from Multiple Images in Large Scale Environments Vol. 1506, pp. 154–170.

  • Boyer, E. and Berger, M. 1997. 3D surface reconstruction using occluding contours. International Journal of Computer Vision 22(3):219–233.

    Article  Google Scholar 

  • Sullivan, S. and Ponce, J. 1998. Automatic model construction and pose estimation from photographs using triangular splines. IEEE Trans. Pattern Anal. Mach. Intell., 20(10):1091–1097.

    Article  Google Scholar 

  • Leibe, B., Starner, T., Ribarsky, W., Wartell, Z., Krum, D.M., Weeks, J., Singletary, B., and Hodges, L.F. 2000. Toward spontaneous interaction with the perceptive workbench. IEEE Computer Graphics & Applications, 20(6):54–65.

    Article  Google Scholar 

  • Kampel, M., Tosovic, S., and Sablatnig, R. 2002. Octree-based fusion of shape from silhouette and shape from structured light. Intl. Symposium on 3D Data Processing Visualization and Transmission, pp. 754–757.

  • Seitz, S.M. and Dyer, C.R. 1997. Photorealistic scene reconstruction by voxel coloring. In Proc. of Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 1067–1073.

  • Broadhurst, A. and Cipolla, R. 2001. A probabilistic framework for space carving. In Proc. of the International Conference on Computer Vision, pp. 388–393.

  • Bhotika, R., Fleet, D., and Kutulakos, K. 2002. A probabilistic theory of occupancy and emptiness. In Proc. of the European Conference on Computer Vision, pp. 112–132.

  • Szeliski, R. and Golland, P. 1999. Stereo matching with transparency and matting. Int. Journal of Computer Vision, 32(1):45–61.

    Article  Google Scholar 

  • De Bonet, J. and Viola, P. 1999. Roxels: Responsibility weighted 3D volume reconstruction. In Proc. of the International Conference on Computer Vision, pp. 418–425.

  • Eisert, P., Steinbach, E., and Girod, B. 1999. Multi-hypothesis, volumetric reconstruction of 3D objects from multiple calibrated camera views. In Proc. of the International Conference on Acoustics, Speech, and Signal Processing, pp. 3509–3512.

  • Slabaugh, G., Culbertson, W., Malzbender, T., Stevens, M., and Schafer, R. 2004. Methods for volumetric reconstruction of visual scenes. International Journal of Computer Vision, 57(3):179–199.

    Article  Google Scholar 

  • Treuille, A., Hertzmann, A., and Seitz, S. 2004. Example-based stereo with general BRDFs. In Proc. of the European Conference on Computer Vision, pp. 457–469.

  • Farouk, M., El-Rifai, I., El-Tayar, S., El-Shishiny, H., Hosny, M., El-Rayes, M., Gomes, J., Giordano, F., Rushmeier, H., Bernardini, F., and Magerlein, K. 2003. Scanning and processing 3D objects for web display. In Proc. of the International Conference on 3DIM, pp. 310–317.

  • Tsai, R.Y. 1987. A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE Journal of Robotics and Automation, 3(4):323–344.

    Article  Google Scholar 

  • Kenneth Wong, K.-Y. 2001. Structure and Motion from Silhouettes, Ph.D. thesis, University of Cambridge.

  • Taubin, G. 1995. A signal processing approach to fair surface design. SIGGRAPH, 351–358.

  • Taubin, G., Zhang, T., and Golub, G. 1996. Optimal surface smoothing as filter design. Tech. Rep. RC-20404, IBM Research.

Download references

Author information

Authors and Affiliations

  1. California Institute of Technology, Mail stop 136-93, Pasadena, CA, 91125

    Silvio Savarese & Marco Andreetto

  2. IBM T. J. Watson Research Center, P.O. Box 704, Yorktown Heights, NY, 10598

    Holly Rushmeier & Fausto Bernardini

  3. California Institute of Technology, Mail stop 136-93, Pasadena, CA, 91125

    Pietro Perona

Authors
  1. Silvio Savarese
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marco Andreetto
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Holly Rushmeier
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Fausto Bernardini
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Pietro Perona
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Silvio Savarese.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Savarese, S., Andreetto, M., Rushmeier, H. et al. 3D Reconstruction by Shadow Carving: Theory and Practical Evaluation. Int J Comput Vision 71, 305–336 (2007). https://doi.org/10.1007/s11263-006-8323-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-006-8323-9

Keywords

Search

Navigation