Advertisement

Shadow Graphs and Surface Reconstruction

  • Yizhou Yu
  • Johnny T. Chang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2351)

Abstract

We present a method to solve shape-from-shadow using shadow graphs which give a new graph-based representation for shadow constraints. It can be shown that the shadow graph alone is enough to solve the shape-from-shadow problem from a dense set of images. Shadow graphs provide a simpler and more systematic approach to represent and integrate shadow constraints from multiple images. To recover shape from a sparse set of images, we propose a method for integrated shadow and shading constraints. Previous shape-from-shadow algorithms do not consider shading constraints while shape-from-shading usually assumes there is no shadow. Our method is based on collecting a set of images from a fixed viewpoint as a known light source changes its position. It first builds a shadow graph from shadow constraints from which an upper bound for each pixel can be derived if the height values of a small number of pixels are initialized properly. Finally, a constrained optimization procedure is designed to make the results from shape-from-shading consistent with the upper bounds derived from the shadow constraints. Our technique is demonstrated on both synthetic and real imagery.

Keywords

Surface Geometry Shadow Graph Shading Optimization 

References

  1. 1.
    P. Belhumeur and D. Kriegman. What is the set of images of an object under all possible illumination conditions? Int. Journal Comp. Vision, 28(3):1–16, 1998.Google Scholar
  2. 2.
    P. Belhumeur, D. Kriegman, and A. Yuille. The bas-relief ambiguity. In IEEE Conf. on Comp. Vision andPatt. Recog., pages 1040–1046, 1997.Google Scholar
  3. 3.
    K.J. Dana, B. van Ginneken, S.K. Nayar, and J.J. Koenderink. Reflectance and texture of real-world surfaces. In Proceedings of CVPR, pages 151–157, 1997.Google Scholar
  4. 4.
    M. Daum and G. Dudek. On 3-d surface reconstruction using shape from shadows. In IEEE Conf. on Comp. Vision and Patt. Recog., pages 461–468, 1998.Google Scholar
  5. 5.
    P. Dupuis and J. Oliensis. Shape from shading: Provably convergent algorithms and uniqueness results. In Computer Vision-ECCV 94, pages 259–268, 1994.Google Scholar
  6. 6.
    Fsqp software. http://gachinese.com/aemdesign/FSQPframe.htm. Originally developed at the Institute for Systems Research, University of Maryland.
  7. 7.
    A. Georghiades, P. Belhumeur, and D. Kriegman. Illumination-based image synthesis: Creating novel images of human faces under differing pose and lighting. In IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes, pages 47–54, 1999.Google Scholar
  8. 8.
    R. Hassin and S. Rubinstein. Approximations for the maximum acyclic subgraph problem. Information Processing Letters, 51:133–140, 1994.zbMATHCrossRefMathSciNetGoogle Scholar
  9. 9.
    M. Hatzitheodorou. The derivation of 3-d surface shape from shadows. In Proc. Image Understanding Workshop, pages 1012–1020, 1989.Google Scholar
  10. 10.
    B.K.P. Horn and M.J. Brooks. The variational approach to shape from shading. Computer Vision, Graphics & Image Processing, 33:174–208, 1986.CrossRefGoogle Scholar
  11. 11.
    K. Ikeuchi. Determining surface orientations of specular surfaces by using the photometric stereo method. IEEE Trans. Patt. Anal. Mach. Intel., 3(6):661–669, 1981.CrossRefGoogle Scholar
  12. 12.
    D. Jacobs. Linear fitting with missing data: Applications to structure from motion and characterizing intensity images. In IEEE Conf. on Comp. Vision and Patt. Recog., pages 206–212, 1997.Google Scholar
  13. 13.
    J. Kender and E. Smith. Shape from darkness. In Int. Conf. on Computer Vision, pages 539–546, 1987.Google Scholar
  14. 14.
    D.J. Kriegman and P.N. Belhumeur. What shadows reveal about object structure. In Computer Vision-ECCV 98, 1998.Google Scholar
  15. 15.
    Y.G. Leclerc and A.F. Bobick. The direct computation of height from shading. In Proc. of IEEE Conf. on Comp. Vision and Patt. Recog., pages 552–558, 1991.Google Scholar
  16. 16.
    X. Liu, Y. Yu, and H.-Y Shum. Synthesizing bidirectional texture functions for real-world surfaces. In Proceedings of SIGGRAPH, pages 97–106, 2001.Google Scholar
  17. 17.
    S.K. Nayar, K. Ikeuchi, and T. Kanade. Determining shape and reflectance of hybrid surfaces by photometric sampling. IEEE Trans. Robotics and Automation, 6(4):418–431, 1990.CrossRefGoogle Scholar
  18. 18.
    S.K. Nayar, K. Ikeuchi, and T. Kanade. Shape from interreflections. International Journal of Computer Vision, 6(3):2–11, 1991.CrossRefGoogle Scholar
  19. 19.
    W.H. Press, B.P. Flannery, S.A. Teukolsky, and W.T. Vetterling. Numerical Recipes in C. Cambridge Univ. Press, New York, 1988.Google Scholar
  20. 20.
    S.A. Shafer. Shadows and silhouettes in computer vision. Kluwer Academic Publishers, 1985.Google Scholar
  21. 21.
    A. J. Stewart and M.S. Langer. Towards accurate recovery of shape from shading under diffuse lighting. IEEE Patt. Anal. Mach. Intel., 19(9): 1020–1025, 1997.CrossRefGoogle Scholar
  22. 22.
    R.J. Woodham. Photometric method for determining surface orientation from multiple images. In B.K.P. Horn and M.J. Brooks, editors, Shape from Shading, pages 513–532. MIT Press, 1989.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Yizhou Yu
    • 1
  • Johnny T. Chang
    • 1
  1. 1.Department of Computer ScienceUniversity of Illinois at Urbana-ChampaignUrbanaUSA

Personalised recommendations