Photometric Stereo for Dynamic Surface Orientations

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6311)


We present a photometric stereo method for non-rigid objects of unknown and spatially varying materials. The prior art uses time-multiplexed illumination but assumes constant surface normals across several frames, fundamentally limiting the accuracy of the estimated normals. We explicitly account for time-varying surface orientations, and show that for unknown Lambertian materials, five images are sufficient to recover surface orientation in one frame. Our optimized system implementation exploits the physical properties of typical cameras and LEDs to reduce the required number of images to just three, and also facilitates frame-to-frame image alignment using standard optical flow methods, despite varying illumination. We demonstrate the system’s performance by computing surface orientations for several different moving, deforming objects.


Color Channel Surface Orientation Angular Error Orientation Error Dynamic Scene 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Supplementary material (10.9 mb)
Electronic Supplementary Material (11,243 KB)


  1. 1.
    Basri, R., Frolova, D.: A two-frame theory of motion, lighting and shape. In: IEEE Conference on Computer Vision and Pattern Recognition (2009)Google Scholar
  2. 2.
    Black, M., Anandan, P.: A framework for the robust estimation of optical flow. In: IEEE International Conference on Computer Vision, pp. 231–236 (1993)Google Scholar
  3. 3.
    Decker, B.D., Kautz, J., Mertens, T., Bekaert, P.: Capturing multiple illumination conditions using time and color multiplexing. In: IEEE Conference on Computer Vision and Pattern Recognition (2009)Google Scholar
  4. 4.
    Gretag Macbeth Color Management Solutions,
  5. 5.
    Hernández, C., Vogiatzis, G., Brostow, G.J., Stenger, B., Cipolla, R.: Non-rigid photometric stereo with colored lights. In: IEEE International Conference on Computer Vision, pp. 1–8 (2007)Google Scholar
  6. 6.
    Joshi, N., Kriegman, D.: Shape from varying illumination and viewpoint. In: IEEE International Conference on Computer Vision (2007)Google Scholar
  7. 7.
    Kontsevich, L.L., Petrov, A.P., Vergelskaya, I.S.: Reconstruction of shape from shading in color images. J. Opt. Soc. Am. A 11(3), 1047–1052 (1994)CrossRefGoogle Scholar
  8. 8.
    Moses, Y., Shimshoni, I.: 3d shape recovery of smooth surfaces: Dropping the fixed viewpoint assumption. In: Narayanan, P.J., Nayar, S.K., Shum, H.-Y. (eds.) ACCV 2006. LNCS, vol. 3851, pp. 429–438. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  9. 9.
    Nehab, D., Rusinkiewicz, S., Davis, J., Ramamoorthi, R.: Efficiently combining positions and normals for precise 3D geometry. ACM Trans. on Graphics 24(3), 536–543 (2005)CrossRefGoogle Scholar
  10. 10.
    Petrov, A.: Light, color and shape. Cognitive Processes and their Simulation, 350–358 (1987) (in Russian)Google Scholar
  11. 11.
    Simakov, D., Frolova, D., Basri, R.: Dense shape reconstruction of a moving object under arbitrary, unknown lighting. In: IEEE International Conference on Computer Vision (2003)Google Scholar
  12. 12.
    Simchony, T., Chellappa, R., Shao, M.: Direct analytical methods for solving poisson equations in computer vision problems. IEEE Trans. on Pattern Analysis and Machine Intelligence 12(5), 435–446 (1990)CrossRefGoogle Scholar
  13. 13.
    Vlasic, D., Peers, P., Baran, I., Debevec, P., Popović, J., Rusinkiewicz, S., Matusik, W.: Dynamic shape capture using multi-view photometric stereo. ACM Trans. on Graphics 28(5) (2009)Google Scholar
  14. 14.
    Weise, T., Leibe, B., Gool, L.V.: Fast 3d scanning with automatic motion compensation. In: IEEE Conference on Computer Vision and Pattern Recognition (2007)Google Scholar
  15. 15.
    Wenger, A., Gardner, A., Tchou, C., Unger, J., Hawkins, T., Debevec, P.: Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Trans. on Graphics 24(3), 756–764 (2005)CrossRefGoogle Scholar
  16. 16.
    Woodham, R.: Photometric method for determining surface orientation from multiple images. Optical Engineering 19(1), 139–144 (1980)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  1. 1.KAISTDaejeonRepublic of Korea
  2. 2.Microsoft Research AsiaBeijingChina

Personalised recommendations