Shape Reconstruction by Combination of Structured-Light Projection and Photometric Stereo Using a Projector-Camera System

High Quality Reproduction of a Virtual Reflectance Property on a Real Object Surface
  • Tomoya Okazaki
  • Takayuki Okatani
  • Koichiro Deguchi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5414)


In this paper, we present a method for synthesizing virtual appearance of an object by projecting images onto the surface of the object using projectors. The object surface is assumed to have a known diffuse reflectance property; its shape is allowed to have an arbitrary shape. Using a system consisting of multiple projectors and a camera, the method first estimates their internal and external parameters as well as the object surface based on the projection of structured patterns, and then measures surface normals by the method of photometric stereo that uses the same projectors as point sources of illumination. By enabling highly accurate calibration of the projectors as well as reconstruction of the object shape and also by reducing the random errors in surface normals that significantly affect final appearance, it is made possible to synthesize high-quality appearance associated with an arbitrary virtual reflectance property.


Projector-camera autocalibration photometric stereo augmented reality 


  1. 1.
    Raskar, R., Welch, G., Low, K., Bandyopadhyay, D.: Shader Lamps: Animating Real Objects With Image-Based Illumination. In: Eurographics Rendering Workshop 2001 (2001)Google Scholar
  2. 2.
    Raskar, R., van Baar, J., Beardsley, P., Willwacher, T., Rao, S.: Geometrically aware and self-configuring projectors. In: Proceedings of SIGGRAPH 2003 (2003)Google Scholar
  3. 3.
    Raskar, R., Ziegler, R., Willwacher, T.: Cartoon dioramas in motion. In: Proceedings of International Symposium on Non-Photorealistic Animation and Rendering (2002)Google Scholar
  4. 4.
    Grossberg, M.D., Peri, H., Nayar, S.K., Belhumeur, P.N.: Making one object look like another: Controlling appearance using a projector-camera system. In: Proc. CVPR 2004, pp. 452–459 (2004)Google Scholar
  5. 5.
    Fujii, K., Grossberg, M.D., Nayar, S.K.: A projector-camera system with real-time photometric adaptation for dynamic environments. In: Proc. CVPR 2005, pp. 814–821 (2005)Google Scholar
  6. 6.
    Yamamoto, S., Tsurase, M., Ueda, K., Tsumura, N., Nakaguchi, T., Miyake, Y.: Reproducing an appearance of the objects using high bright projector. In: AIC 2005 Annual Conference, pp. 1043–1046 (2005)Google Scholar
  7. 7.
    Woodham, R.J.: Photometric method for determining surface orientation from multiple images. Optical Engineering 19(1), 139–144 (1980)CrossRefGoogle Scholar
  8. 8.
    Nehab, D., Rusinkiewicz, S., Davis, J., Ramamoorthi, R.: Efficiently combining positions and normals for precise 3d geometry. In: SIGGRAPH 2005: ACM SIGGRAPH 2005 Papers, pp. 536–543 (2005)Google Scholar
  9. 9.
    Surrel, Y.: Design of algorithms for phase measurements by the use of phase-stepping. Applied Optics 35, 51–60 (1996)CrossRefGoogle Scholar
  10. 10.
    Pollefeys, M., Koch, R., Gool, L.V.: Self-calibration and metric reconstruction inspite of varying and unknown intrinsic camera parameters. International Journal of Computer Vision 32(1), 7–25 (1999)CrossRefGoogle Scholar
  11. 11.
    Kanatani, K.: Gauge-based reliability analysis of 3-d reconstruction from two uncalibrated perspective views. In: Proc. ICPR 2000, vol. I, pp. 76–79 (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Tomoya Okazaki
    • 1
  • Takayuki Okatani
    • 1
  • Koichiro Deguchi
    • 1
  1. 1.Graduate School of Information SciencesTohoku UniversitySendaiJapan

Personalised recommendations