Abstract
We introduce a method to jointly estimate the BRDF and geometry of an object from a single image under known, but uncontrolled, natural illumination. We show that this previously unexplored problem becomes tractable when one exploits the orientation clues embedded in the lighting environment. Intuitively, unique regions in the lighting environment act analogously to the point light sources of traditional photometric stereo; they strongly constrain the orientation of the surface patches that reflect them. The reflectance, which acts as a bandpass filter on the lighting environment, determines the necessary scale of such regions. Accurate reflectance estimation, however, relies on accurate surface orientation information. Thus, these two factors must be estimated jointly. To do so, we derive a probabilistic formulation and introduce priors to address situations where the reflectance and lighting environment do not sufficiently constrain the geometry of the object. Through extensive experimentation we show what this space looks like, and offer insights into what problems become solvable in various categories of real-world natural illumination environments.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Alldrin, N.G., Kriegman, D.J.: Toward Reconstructing Surfaces With Arbitrary Isotropic Reflectance: A Stratified Photometric Stereo Approach. In: IEEE Int’l Conf. on Computer Vision, pp. 1–8 (2007)
Alldrin, N.G., Zickler, T., Kriegman, D.J.: Photometric stereo with non-parametric and spatially-varying reflectance. In: IEEE Int’l Conf. on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Basri, R., Jacobs, D., Kemelmacher, I.: Photometric Stereo with General, Unknown Lighting. Int’l Journal of Computer Vision 72(3), 239–257 (2006)
Boykov, Y., Veksler, O., Zabih, R.: Fast Approximate Energy Minimization via Graph Cuts. IEEE Trans. on Pattern Analysis and Machine Intelligence 23(11), 1222–1239 (2001)
Debevec, P.: Light Probe Image Gallery (2012), http://www.pauldebevec.com/Probes/
Durou, J.-D., Falcone, M., Sagona, M.: Numerical Methods for Shape-from-Shading: A New Survey with Benchmarks. Computer Vision and Image Understanding 109(1), 22–43 (2008)
Goldman, D.B., Curless, B., Hertzmann, A., Seitz, S.M.: Shape and Spatially-Varying BRDFs from Photometric Stereo. IEEE Trans. on Pattern Analysis and Machine Intelligence 32(6), 1060–1071 (2010)
Hertzmann, A., Seitz, S.M.: Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs. IEEE Trans. on Pattern Analysis and Machine Intelligence 27(8), 1254–1264 (2005)
Huang, R., Smith, W.: Shape-from-Shading Under Complex Natural Illumination. In: IEEE Int’l Conf. on Image Processing, pp. 13–16 (2011)
Ikeuchi, K., Horn, B.K.P.: Numerical Shape from Shading and Occluding Boundaries. Artificial Intelligence (1981)
Johnson, M.K., Adelson, E.H.: Shape Estimation in Natural Illumination. In: IEEE Int’l Conf. on Computer Vision and Pattern Recognition, pp. 1–8 (2011)
Kim, J., Zabih, R.: Factorial Markov Random Fields. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part III. LNCS, vol. 2352, pp. 321–334. Springer, Heidelberg (2002)
Lombardi, S., Nishino, K.: Single Image Multimaterial Estimation. In: IEEE Int’l Conf. on Computer Vision and Pattern Recognition, pp. 238–245 (2011)
Matusik, W., Pfister, H., Brand, M., McMillan, L.: A data-driven reflectance model. ACM Trans. on Graphics 22(3), 759–769 (2003)
Nishino, K.: Directional Statistics BRDF Model. In: IEEE Int’l Conf. on Computer Vision, pp. 476–483 (2009)
Nishino, K., Lombardi, S.: Directional Statistics-based Reflectance Model for Isotropic Bidirectional Reflectance Distribution Functions. Journal of Optical Society America, A 28(1), 8–18 (2011)
Rusinkiewicz, S.: A New Change of Variables for Efficient BRDF Representation. In: Eurographics Workshop on Rendering, pp. 11–22 (1998)
Woodham, R.J.: Photometric Method for Determining Surface Orientation from Multiple Images, vol. 19. MIT Press (1989)
Zhang, R., Tsai, P.-S., Cryer, J.E., Shah, M.: Shape from Shading: A Survey. IEEE Trans. on Pattern Analysis and Machine Intelligence 21(8), 690–706 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Oxholm, G., Nishino, K. (2012). Shape and Reflectance from Natural Illumination. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7572. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33718-5_38
Download citation
DOI: https://doi.org/10.1007/978-3-642-33718-5_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33717-8
Online ISBN: 978-3-642-33718-5
eBook Packages: Computer ScienceComputer Science (R0)