International Journal of Computer Vision

, Volume 73, Issue 1, pp 77–93 | Cite as

A Framework for Automatically Recovering Object Shape, Reflectance and Light Sources from Calibrated Images

Article

Abstract

In this paper, we present a complete framework for recovering an object shape, estimating its reflectance properties and light sources from a set of images. The whole process is performed automatically. We use the shape from silhouette approach proposed by R. Szeliski (1993) combined with image pixels for reconstructing a triangular mesh according to the marching cubes algorithm. A classification process identifies regions of the object having the same appearance. For each region, a single point or directional light source is detected. Therefore, we use specular lobes, lambertian regions of the surface or specular highlights seen on images. An identification method jointly (i) decides what light sources are actually significant and (ii) estimates diffuse and specular coefficients for a surface represented by the modified Phong model (Lewis, 1994). In order to validate our algorithm efficiency, we present a case study with various objects, light sources and surface properties. As shown in the results, our system proves accurate even for real objects images obtained with an inexpensive acquisition system.

Keywords

shape from silhouette marching cubes multiple light sources detection reflectance properties recovery reshading 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Boivin, S. and Gagalowicz, A. 2001. Image-based rendering of diffuse, specular and glossy surfaces from a single image. In SIGGRAPH’2001, Annual Conference Series, pp. 107–116.Google Scholar
  2. Brooks, M.J. and Horn, B.K.P. 1985. Shape and source from shading. Tech. Rep., MIT.Google Scholar
  3. Callet, P. and Zymla, A. 2004. Rendering of binary alloys. In ICCVG 2004, pp. 469–476.Google Scholar
  4. Chen, Q. and Medioni, G. 1999. A volumetric stereo matching method: Application to image-based modeling. In CVPR, IEEE Computer Society, pp. 29–34.Google Scholar
  5. Chien, C.H. and Aggarwal, J.K. 1986. Volume/surface octrees for the representation of three-dimensional objects. Comput. Vision Graph. Image Process. 36(1): 100–113.CrossRefGoogle Scholar
  6. Cook, R.L. and Torrance, K.E. 1982. A reflectance model for computer graphics. ACM Transactions on Graphics, 1(1):7–24.CrossRefGoogle Scholar
  7. Debevec, P.E. 1998. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. ACM Computer Graphics 32(Annual Conference Series), : 189–198.Google Scholar
  8. Debevec, P., Hawkins, T., Tchou, C., Duiker, H.P., Sarokin, W., and Sagar, M. 2000. Acquiring the reflectance field of a human face. In Siggraph 2000, Computer Graphics Proceedings, pp. 145–156.Google Scholar
  9. Esteban, C.H. and Schmitt, F. 2003. Silhouette and stereo fusion for 3d object modeling. In 3DIM 2003, pp. 46–53.Google Scholar
  10. Faugeras, O. and Keriven, R. 1998. Complete dense stereovision using level set methods. Lecture Notes in Computer Science 1406: 379+.Google Scholar
  11. Guillou, E. 2000. Simulation d’environnements complexes non lambertiens à partir d’images: Application à la réalité augmentée. Ph.D. thesis, Université de Rennes 1.Google Scholar
  12. Hasenfratz, J.M., Lapierre, M., Gascuel, J.D., and Boyer, E. 2003. Real-time capture, reconstruction and insertion into virtual world of human actors. In Vision, Video and Graphics, Eurographics, pp. 49–56.Google Scholar
  13. Hawkins, T., Wenger, A., Tchou, C., Gardner, A., Göransson, F., and Debevec, P.E. 2004. Animatable facial reflectance fields. In EGSR, Rendering Techniques, pp. 309–321.Google Scholar
  14. He, X.D., Torrance, K.E., Sillion, F.X., and Greenberg, D.P. 1991. A comprehensive physical model for light reflection. ACM Computer Graphics 25(Annual Conference Series), : 175–186.Google Scholar
  15. Hougen, D. and Ahuja, N. 1993. Estimation of the light source distribution and its use in integrated shape recovery from stereo and shading. In Proc. 4th IEEE ICCV, pp. 148–155.Google Scholar
  16. Hougen, D.R. and Ahuja, N. 1994. Adaptive polynomial modelling of the reflectance map for shape estimation from stereo and shading. In CVPR, pp. 991–994.Google Scholar
  17. Kay, G. and Caelli, T. 1994. Inverting an illumination model from range and intensity maps. CVGIP, 59(2):183–201.CrossRefGoogle Scholar
  18. Kutulakos, K.N. and Seitz, S.M. 1998. A Theory of Shape by Space Carving. Tech. Rep. TR692.Google Scholar
  19. Lafortune, E., Foo, S.C., Torrance, K.E., and Greenberg, D.P. 1997. Non-linear approximation of reflectance functions. Computer Graphics 31(Annual Conference Series) :117–126.Google Scholar
  20. Lee, C.H. and Rosenfeld, A. 1985. Improved methods of estimating shape from shading using the light source coordinate system Artificial Intelligence, 26:125–143.Google Scholar
  21. Levoy, M. and Hanrahan, P. 1996. Lightfield rendering. Computer Graphics 30 (Annual Conference Series) :31–42.Google Scholar
  22. Levoy, M., Pulli, K., Curless, B., Rusinkiewicz, S., Koller, D., Pereira, L., Ginzton, M., Anderson, S., Davis, J., Ginsberg, J., Shade, J., Fulk, D. 2000. The digital michelangelo project: 3D scanning of large statues. In Siggraph 2000, Computer Graphics Proceedings, pp. 131–144.Google Scholar
  23. Lewis, R. 1994. Making shaders more physically plausible. Computer Graphics Forum, 13(2).Google Scholar
  24. Lorensen, W.E. and Cline, H.E. 1987. Marching cubes: A high resolution 3d surface construction algorithm. ACM Computer Graphics 21(Annual Conference Series) :163–169.Google Scholar
  25. Martin, W.N. and Aggarwal, J.K. 1983. Volumetric descriptions of objects from multiple views. IEEE Transactions on Pattern Analysis and Machine Intelligence, 5(2):150–158.Google Scholar
  26. Mercier, B. and Meneveaux, D. 2004. Joint estimation of multiple light sources and reflectance from images. In ICCVG 2004, pp. 66–71.Google Scholar
  27. Mercier, B. and Meneveaux, D. 2005. Shape from silhouette: Image pixels for marching cubes. Journal of WSCG 2005, 13 :112–118.Google Scholar
  28. Nillius, P. and Eklundh, J.O. 2001. Automatic estimation of the projected light source direction. In CVPR, pp. I:1076–1083.Google Scholar
  29. Oren, M. and Nayar, S.K. 1994. Generalization of Lambert’s reflectance model. Computer Graphics 28(Annual Conference Series) :239–246.Google Scholar
  30. Pentland, A. (1982). Finding the illuminant direction. JOSA 72: 448–455.Google Scholar
  31. Powell, M., Sarkar, S., and Goldgof, D. 2001. A simple strategy for calibrating the geometry of light sources. PAMI, 23(9):1022–1027.Google Scholar
  32. Sato, Y. and Ikeuchi, K. 1996. Reflectance analysis for 3D computer graphics model generation. Graphical Models and Image Processing: GMIP, 58(5):437–451.CrossRefGoogle Scholar
  33. Sato, Y., Wheeler, M.D., and Ikeuchi, K. 1997. Object shape and reflectance modeling from observation. ACM Computer Graphics 31(Annual Conference Series) : 379–388.Google Scholar
  34. Sato, I., Sato, Y., and Ikeuchi, K. 1999. Illumination distribution from shadows. In CVPR99, pp. I: 306–312.Google Scholar
  35. Seitz, S. and Dyer, C. 1997. Photorealistic scene reconstruction by voxel coloring. In CVPR, pp. 1067–1073.Google Scholar
  36. Singh, H. and Chellappa, R. 1994. An improved shape from shading algorithm. Tech. Rep. CS-TR-3218, Department of Computer Science, University of Maryland Center for Automation Research, College Park, MD.Google Scholar
  37. Slabaugh, G., Culbertson, B., Malzbender, T., and Schafer, R. 2001. A survey of methods for volumetric scene reconstruction from photographs. In VG01, pp. 81–100.Google Scholar
  38. Szeliski, R. 1993. Rapid octree construction from image sequences. In CVGIP: Image Understanding, vol. 1, pp. 23–32.Google Scholar
  39. Torrance, K.E. and Sparrow, E.M. 1967. Theory for off-specular reflection from roughened surface. Journal of Optical Society of America 57, :1105–1114.CrossRefGoogle Scholar
  40. Vega, O. and Yang, Y. 1994. Default shape theory: With application to the computation of the direction of the light source. CVGIP, 60(3):285–299.CrossRefGoogle Scholar
  41. Ward, G. 1992. Measuring and modeling anisotropic reflection. In ACM (ed.), SIGGRAPH’92}, pp. 265–272.Google Scholar
  42. Yang, Y. and Yuille, A. 1991. Source from shading. In IEEE CVPR, pp. 534–539.Google Scholar
  43. Yu, Y., Debevec, P., Malik, J., and Hawkins, T. 1999. Inverse global illumination: Recovering reflectance models of real scenes from photographs. In ACM (ed.), SIGGRAPH’99, pp. 215–224.Google Scholar
  44. Zhang, Y. and Yang, Y. 2000. Illuminant direction determination for multiple light sources. In CVPR00, pp. I:269–276.Google Scholar
  45. Zheng, Q. and Chellappa, R. 1991. Estimation of illumination, albedo, and shape from shading. PAMI, 13(7):680–702.Google Scholar
  46. Zhou, W. and Kambhamettu, C. 2002. Estimation of illuminant direction and intensity of multiple light sources. In ECCV02, p. IV:206 ff.Google Scholar

Copyright information

© Springer Science + Business Media, LLC 2006

Authors and Affiliations

  • Bruno Mercier
    • 1
  • Daniel Meneveaux
    • 1
  • Alain Fournier
    • 2
  1. 1.SIC LaboratoryUniversity of PoitiersFuturoscope ChasseneuilFrance
  2. 2.Department of Computer ScienceImager Lab, University of British ColumbiaVancouverCanada

Personalised recommendations