Abstract
We develop new mathematical results based on the spherical harmonic convolution framework for reflection from a curved surface. We derive novel identities, which are the angular frequency domain analogs to common spatial domain invariants such as reflectance ratios. They apply in a number of canonical cases, including single and multiple images of objects under the same and different lighting conditions. One important case we consider is two different glossy objects in two different lighting environments. Denote the spherical harmonic coefficients by \(B_{lm}^{light,{material}}\), where the subscripts refer to the spherical harmonic indices, and the superscripts to the lighting (1 or 2) and object or material (again 1 or 2). We derive a basic identity, \(B^{\rm 1,1}_{lm}\) \(B^{\rm 2,2}_{lm}\) = \(B^{\rm 1,2}_{lm}\) \(B^{\rm 2,1}_{lm}\), independent of the specific lighting configurations or BRDFs. While this paper is primarily theoretical, it has the potential to lay the mathematical foundations for two important practical applications. First, we can develop more general algorithms for inverse rendering problems, which can directly relight and change material properties by transferring the BRDF or lighting from another object or illumination. Second, we can check the consistency of an image, to detect tampering or image splicing.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Basri, R., Jacobs, D.: Photometric stereo with general, unknown lighting. In: CVPR 2001, pp. II-374–II-381 (2001)
Basri, R., Jacobs, D.: Lambertian reflectance and linear subspaces. PAMI 25(2), 218–233 (2003)
Davis, J., Yang, R., Wang, L.: BRDF invariant stereo using light transport constancy. In: ICCV 2005 (2005)
Gonzalez, R., Woods, R.: Digital Image Processing. Pearson Education, London (2003)
Hertzmann, A., Seitz, S.: Example-based photometric stereo: Shape reconstruction with general, varying BRDFs. PAMI 27(8), 1254–1264 (2005)
Jin, H., Soatto, S., Yezzi, A.: Multi-view stereo beyond lambert. In: CVPR 2003, pp. 171–178 (2003)
Johnson, M., Farid, H.: Exposing digital forgeries by detecting inconsistencies in lighting. In: ACM Multimedia and Security Workshop (2005)
Lin, Z., Wang, R., Tang, X., Shum, H.: Detecting doctored images using camera response normality and consistency. In: CVPR 2005 (2005)
Mahajan, D.: A theory of spherical harmonic identities for inverse rendering, BRDF/lighting transfer and image consistency checking. Master’s thesis, Columbia (2006)
Marschner, S.: Inverse Rendering for Computer Graphics. PhD thesis, Cornell (1998)
Wiener, N.: Extrapolation, interpolation and smoothing of stationary time series. MIT Press, Cambridge (1942)
Narasimhan, S., Ramesh, V., Nayar, S.: A class of photometric invariants: Separating material from shape and illumination. In: ICCV 2003, pp. 1387–1394 (2003)
Nayar, S., Bolle, R.: Reflectance based object recognition. IJCV 17(3), 219–240 (1996)
Ng, T., Chang, S., Sun, Q.: Blind detection of photomontage using higher order statistics. In: IEEE International Symposium on Circuits and Systems (2004)
Ramamoorthi, R., Hanrahan, P.: A signal-processing framework for inverse rendering. In: SIGGRAPH 2001, pp. 117–128 (2001)
Simakov, D., Frolova, D., Basri, R.: Dense shape reconstruction of a moving object under arbitrary, unknown lighting. In: ICCV 2003, pp. 1202–1209 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mahajan, D., Ramamoorthi, R., Curless, B. (2006). A Theory of Spherical Harmonic Identities for BRDF/Lighting Transfer and Image Consistency. In: Leonardis, A., Bischof, H., Pinz, A. (eds) Computer Vision – ECCV 2006. ECCV 2006. Lecture Notes in Computer Science, vol 3954. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11744085_4
Download citation
DOI: https://doi.org/10.1007/11744085_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33838-3
Online ISBN: 978-3-540-33839-0
eBook Packages: Computer ScienceComputer Science (R0)