A Theory of Spherical Harmonic Identities for BRDF/Lighting Transfer and Image Consistency

  • Dhruv Mahajan
  • Ravi Ramamoorthi
  • Brian Curless
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3954)

Abstract

We develop new mathematical results based on the spherical harmonic convolution framework for reflection from a curved surface. We derive novel identities, which are the angular frequency domain analogs to common spatial domain invariants such as reflectance ratios. They apply in a number of canonical cases, including single and multiple images of objects under the same and different lighting conditions. One important case we consider is two different glossy objects in two different lighting environments. Denote the spherical harmonic coefficients by \(B_{lm}^{light,{material}}\), where the subscripts refer to the spherical harmonic indices, and the superscripts to the lighting (1 or 2) and object or material (again 1 or 2). We derive a basic identity, \(B^{\rm 1,1}_{lm}\)\(B^{\rm 2,2}_{lm}\) = \(B^{\rm 1,2}_{lm}\)\(B^{\rm 2,1}_{lm}\), independent of the specific lighting configurations or BRDFs. While this paper is primarily theoretical, it has the potential to lay the mathematical foundations for two important practical applications. First, we can develop more general algorithms for inverse rendering problems, which can directly relight and change material properties by transferring the BRDF or lighting from another object or illumination. Second, we can check the consistency of an image, to detect tampering or image splicing.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Basri, R., Jacobs, D.: Photometric stereo with general, unknown lighting. In: CVPR 2001, pp. II-374–II-381 (2001)Google Scholar
  2. 2.
    Basri, R., Jacobs, D.: Lambertian reflectance and linear subspaces. PAMI 25(2), 218–233 (2003)CrossRefGoogle Scholar
  3. 3.
    Davis, J., Yang, R., Wang, L.: BRDF invariant stereo using light transport constancy. In: ICCV 2005 (2005)Google Scholar
  4. 4.
    Gonzalez, R., Woods, R.: Digital Image Processing. Pearson Education, London (2003)Google Scholar
  5. 5.
    Hertzmann, A., Seitz, S.: Example-based photometric stereo: Shape reconstruction with general, varying BRDFs. PAMI 27(8), 1254–1264 (2005)CrossRefGoogle Scholar
  6. 6.
    Jin, H., Soatto, S., Yezzi, A.: Multi-view stereo beyond lambert. In: CVPR 2003, pp. 171–178 (2003)Google Scholar
  7. 7.
    Johnson, M., Farid, H.: Exposing digital forgeries by detecting inconsistencies in lighting. In: ACM Multimedia and Security Workshop (2005)Google Scholar
  8. 8.
    Lin, Z., Wang, R., Tang, X., Shum, H.: Detecting doctored images using camera response normality and consistency. In: CVPR 2005 (2005)Google Scholar
  9. 9.
    Mahajan, D.: A theory of spherical harmonic identities for inverse rendering, BRDF/lighting transfer and image consistency checking. Master’s thesis, Columbia (2006)Google Scholar
  10. 10.
    Marschner, S.: Inverse Rendering for Computer Graphics. PhD thesis, Cornell (1998)Google Scholar
  11. 11.
    Wiener, N.: Extrapolation, interpolation and smoothing of stationary time series. MIT Press, Cambridge (1942)Google Scholar
  12. 12.
    Narasimhan, S., Ramesh, V., Nayar, S.: A class of photometric invariants: Separating material from shape and illumination. In: ICCV 2003, pp. 1387–1394 (2003)Google Scholar
  13. 13.
    Nayar, S., Bolle, R.: Reflectance based object recognition. IJCV 17(3), 219–240 (1996)CrossRefGoogle Scholar
  14. 14.
    Ng, T., Chang, S., Sun, Q.: Blind detection of photomontage using higher order statistics. In: IEEE International Symposium on Circuits and Systems (2004)Google Scholar
  15. 15.
    Ramamoorthi, R., Hanrahan, P.: A signal-processing framework for inverse rendering. In: SIGGRAPH 2001, pp. 117–128 (2001)Google Scholar
  16. 16.
    Simakov, D., Frolova, D., Basri, R.: Dense shape reconstruction of a moving object under arbitrary, unknown lighting. In: ICCV 2003, pp. 1202–1209 (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Dhruv Mahajan
    • 1
  • Ravi Ramamoorthi
    • 1
  • Brian Curless
    • 2
  1. 1.Columbia UniversityUSA
  2. 2.University of WashingtonUSA

Personalised recommendations