Advertisement

International Journal of Computer Vision

, Volume 71, Issue 3, pp 305–336 | Cite as

3D Reconstruction by Shadow Carving: Theory and Practical Evaluation

  • Silvio SavareseEmail author
  • Marco Andreetto
  • Holly Rushmeier
  • Fausto Bernardini
  • Pietro Perona
Article

Abstract

Cast shadows are an informative cue to the shape of objects. They are particularly valuable for discovering object’s concavities which are not available from other cues such as occluding boundaries. We propose a new method for recovering shape from shadows which we call shadow carving. Given a conservative estimate of the volume occupied by an object, it is possible to identify and carve away regions of this volume that are inconsistent with the observed pattern of shadows. We prove a theorem that guarantees that when these regions are carved away from the shape, the shape still remains conservative. Shadow carving overcomes limitations of previous studies on shape from shadows because it is robust with respect to errors in shadows detection and it allows the reconstruction of objects in the round, rather than just bas-reliefs. We propose a reconstruction system to recover shape from silhouettes and shadow carving. The silhouettes are used to reconstruct the initial conservative estimate of the object’s shape and shadow carving is used to carve out the concavities. We have simulated our reconstruction system with a commercial rendering package to explore the design parameters and assess the accuracy of the reconstruction. We have also implemented our reconstruction scheme in a table-top system and present the results of scanning of several objects.

Keywords

shape recovery shape from shadows 3D reconstruction Computer Vision shape from silhouettes shape from contours 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Horn, B.K.P. and Brooks, M.J. 1989. Shape from Shading. MIT Press.Google Scholar
  2. Rocchini, C., Cignoni, P., Montani, C., Pingi, P., and Scopigno, R. 2001. A low cost optical 3D scanner. Compute Graphics Forum 20(3):299–309.CrossRefGoogle Scholar
  3. Bouguet, J.-Y. and Perona, P. 1999. 3D photography using shadow in dual space geometry. International Journal of Computer Vision, 35(2):129–149.CrossRefGoogle Scholar
  4. Andreetto, M., Brusco, N., and Cortelazzo, G.M. 2004. Automatic 3D modeling of textured cultural heritage objects. IEEE Transactions on Image Processing, 13(3):354–369.CrossRefGoogle Scholar
  5. Shafer, S.A. and Kanade, T. 1983. Using shadows in finding surface orientations. Computer Vision, Graphics, and Image Processing 22:145–176.CrossRefGoogle Scholar
  6. Hambrick, L.N., Loew, M.H., and Carroll, R.L. 1987. The entry-exit method of shadow boundary segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 9(5):597–607.Google Scholar
  7. Kriegman, D. and Belhumeur, P. 2001. What shadows reveal about object structure. Journal of the Optical Society of America–A, 18(8):1804–1813.Google Scholar
  8. Hatzitheodour, M. and Kender, M. 1988. An optimal algorithm for the derivation of shape from shadows. In Proc. of Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 486–491.Google Scholar
  9. Raviv, D., Pao, Y.-H., and Loparo, K.A. 1989. Reconstruction of three-dimensional surfaces from two-dimensional binary images. IEEE Transactions on Robotics and Automation, 5(5):701–710.CrossRefGoogle Scholar
  10. Langer, M.S., Dudek, G., and Zucker, S.W. 1995. Space occupancy using multiple shadow images. In Proc. of the International Conference on Intelligent Robotics and Systems, Pittsburg, PA, pp. 390–396.Google Scholar
  11. Daum, M. and Dudek, G. 1998. On 3D surface reconstruction using shape from shadows. In Proc. of Computer Society Conf. on Computer Vision and Pattern Recognition, Santa Barbara, CA, pp. 461–468.Google Scholar
  12. Yang, D.K.-M. 1996. Shape from Darkness Under Error, Ph.D. thesis, Columbia University.Google Scholar
  13. Yu, Y. and Chang, J. 2005. Shadow graphs and 3D texture reconstruction. International Journal of Computer Vision, 62(1–2):35–60.Google Scholar
  14. Kutulakos, K.N. and Seitz, S.M. 1999. A theory of shape by space carving. In Proc. of the Interational Conference on Computer Vision, Kerkyra, Greece, pp. 307–313.Google Scholar
  15. Savarese, S., Rushmeier, H., Bernardini, F., and Perona, P. 2002. Implementation of a shadow carving system for shape capture. In Proc. of 3D Data Processing Visualization and Trasmission, pp. 12–23.Google Scholar
  16. Savarese, S., Rushmeier, H., Bernardini, F., and Perona, P. 2001. Shadow carving. In Proc. of the Int. Conf. on Computer Vision, pp. 190–197.Google Scholar
  17. Martin, W.N. and Aggarwal, J.K. 1983. Volumetric descriptions of objects from multiple views. IEEE Transactions on Pattern Analysis and Machine Intelligence, 5(2):150–158.Google Scholar
  18. Szeliski, R. 1993. Rapid octree construction from image sequences. Computer Vision, Graphics and Image Processing, 58(1):23–32.CrossRefGoogle Scholar
  19. Lorensen, W. and Cline, H. 1987. Marching cubes: A high resolution 3D surface construction algorithm. Computer Graphics, 21:163–169.Google Scholar
  20. Reed, M.K. and Allen, P.K. 1999. 3D modeling from range imagery: An incremental method with a planning component. Image and Vision Computing, 17:99–111.zbMATHCrossRefGoogle Scholar
  21. Laurentini, A. 1995. How far 3D shapes can be understood from 2D silhouettes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(2):188–195.CrossRefGoogle Scholar
  22. Koenderink, J. 1984. What does the occluding contour tell us about solid shape? Perception, 13:321–330.Google Scholar
  23. Giblin, P. and Weiss, R. 1986. Reconstruction of surfaces from profiles. In Proceedings of the International Conference Computer Vision, pp. 136–144.Google Scholar
  24. Vaillant, R. and Faugeras, O. 1992. Using extremal boundaries for 3D object modeling. IEEE Transaction of Pattern Analysis and Machine Intelligence, 14(2):157–173.CrossRefGoogle Scholar
  25. Cipolla, R. and Blake, A. 1992. Surface shape from the deformation of apparent contours. International Journal of Computer Vision, 9(2):99–111.CrossRefGoogle Scholar
  26. Zheng, J.Y. 1994. Acquiring 3D models from sequences of contours. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(2):163–178.CrossRefGoogle Scholar
  27. Lazebnik, S., Boyer, E., and Ponce, J. 2001. On computing exact visual hulls of solids bounded by smooth surfaces. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 156–161.Google Scholar
  28. Fitzgibbon, A., Cross, G., and Zisserman, A. 1998. Automatic 3D model construction for turn-table sequences. In Proceedings of SMILE Workshop on Structure from Multiple Images in Large Scale Environments Vol. 1506, pp. 154–170.Google Scholar
  29. Boyer, E. and Berger, M. 1997. 3D surface reconstruction using occluding contours. International Journal of Computer Vision 22(3):219–233.CrossRefGoogle Scholar
  30. Sullivan, S. and Ponce, J. 1998. Automatic model construction and pose estimation from photographs using triangular splines. IEEE Trans. Pattern Anal. Mach. Intell., 20(10):1091–1097.CrossRefGoogle Scholar
  31. Leibe, B., Starner, T., Ribarsky, W., Wartell, Z., Krum, D.M., Weeks, J., Singletary, B., and Hodges, L.F. 2000. Toward spontaneous interaction with the perceptive workbench. IEEE Computer Graphics & Applications, 20(6):54–65.CrossRefGoogle Scholar
  32. Kampel, M., Tosovic, S., and Sablatnig, R. 2002. Octree-based fusion of shape from silhouette and shape from structured light. Intl. Symposium on 3D Data Processing Visualization and Transmission, pp. 754–757.Google Scholar
  33. Seitz, S.M. and Dyer, C.R. 1997. Photorealistic scene reconstruction by voxel coloring. In Proc. of Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 1067–1073.Google Scholar
  34. Broadhurst, A. and Cipolla, R. 2001. A probabilistic framework for space carving. In Proc. of the International Conference on Computer Vision, pp. 388–393.Google Scholar
  35. Bhotika, R., Fleet, D., and Kutulakos, K. 2002. A probabilistic theory of occupancy and emptiness. In Proc. of the European Conference on Computer Vision, pp. 112–132.Google Scholar
  36. Szeliski, R. and Golland, P. 1999. Stereo matching with transparency and matting. Int. Journal of Computer Vision, 32(1):45–61.CrossRefGoogle Scholar
  37. De Bonet, J. and Viola, P. 1999. Roxels: Responsibility weighted 3D volume reconstruction. In Proc. of the International Conference on Computer Vision, pp. 418–425.Google Scholar
  38. Eisert, P., Steinbach, E., and Girod, B. 1999. Multi-hypothesis, volumetric reconstruction of 3D objects from multiple calibrated camera views. In Proc. of the International Conference on Acoustics, Speech, and Signal Processing, pp. 3509–3512.Google Scholar
  39. Slabaugh, G., Culbertson, W., Malzbender, T., Stevens, M., and Schafer, R. 2004. Methods for volumetric reconstruction of visual scenes. International Journal of Computer Vision, 57(3):179–199.CrossRefGoogle Scholar
  40. Treuille, A., Hertzmann, A., and Seitz, S. 2004. Example-based stereo with general BRDFs. In Proc. of the European Conference on Computer Vision, pp. 457–469.Google Scholar
  41. Farouk, M., El-Rifai, I., El-Tayar, S., El-Shishiny, H., Hosny, M., El-Rayes, M., Gomes, J., Giordano, F., Rushmeier, H., Bernardini, F., and Magerlein, K. 2003. Scanning and processing 3D objects for web display. In Proc. of the International Conference on 3DIM, pp. 310–317.Google Scholar
  42. Tsai, R.Y. 1987. A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE Journal of Robotics and Automation, 3(4):323–344.CrossRefGoogle Scholar
  43. Kenneth Wong, K.-Y. 2001. Structure and Motion from Silhouettes, Ph.D. thesis, University of Cambridge.Google Scholar
  44. Taubin, G. 1995. A signal processing approach to fair surface design. SIGGRAPH, 351–358.Google Scholar
  45. Taubin, G., Zhang, T., and Golub, G. 1996. Optimal surface smoothing as filter design. Tech. Rep. RC-20404, IBM Research.Google Scholar

Copyright information

© Springer Science + Business Media, LLC 2006

Authors and Affiliations

  • Silvio Savarese
    • 1
    Email author
  • Marco Andreetto
    • 1
  • Holly Rushmeier
    • 2
  • Fausto Bernardini
    • 2
  • Pietro Perona
    • 3
  1. 1.California Institute of TechnologyPasadena
  2. 2.IBM T. J. Watson Research CenterYorktown Heights
  3. 3.California Institute of TechnologyPasadena

Personalised recommendations