Abstract
Computer vision systems can be used to determine the shapes of real three-dimensional objects for purposes of object recognition and pose estimation or for CAD applications. One method that has been developed is photometric stereo. This method uses several images taken from the same viewpoint, but with different lightings, to determine the three-dimensional shape of an object. Most previous work in photometric stereo has been with gray-tone images; color images have only been used for dielectric materials. In this paper we describe a procedure for color photometric stereo, which recovers the shape of a colored object from two or more color images of the object under white illumination. This method can handle different types of materials, such as composites and metals, and can employ various reflection models such as the Lambertian, dichromatic, and Torrance-Sparrow models. For composite materials, colored metals, and dielectrics, there are two advantages of utilizing color information: at each pixel, there are more constraints on the orientation, and the result is less sensitive to noise. Consequently, the shape can be found more accurately. The method has been tested on both artificial and real images of objects of various materials, and on real images of a multi-colored object.
Similar content being viewed by others
References
P. Bechmann and A. Spizzichino.The Scattering of Electromagnetic Waves from Rough Surfaces. Pergamon Press, 1963.
P. Bui-Tuong. Illumination for computer generated pictures.Comm. ACM, 18(6):311–317, June 1975.
P. H. Christensen and L. G. Shapiro. Determining the shape of multi-colored dichromatic surfaces using color photometric stereo. InProc. Conf. Comp. Vision Patt. Recog., pages 767–768, IEEE, June 1993.
E. N. Coleman and R. Jain. Obtaining 3-dimensional shape of textured and specular surface using four-source photometry.Comp. Graphics Image Processing, 18(4):309–328, 1982.
M. S. Drew. Shape from color. Technical Report CSS/LCCR TR 92-07, School of Computing Science, Simon Fraser Univ., Vancouver, BC, 1992.
B. K. P. Horn.Shape from Shading: A method for obtaining the shape of a smooth opaque object from one view. PhD thesis, MIT AI Lab., Nov. 1970.
B. K. P. Horn. Height and gradient from shading.Intl. J. Comp. Vision, 5(1):37–75, Aug. 1990.
B. K. P. Horn and M. J. Brooks, editors.Shape from Shading. MIT Press, 1989.
K. Ikeuchi. Determining surface orientations of specular surfaces by using the photometric stereo method.Trans. Pat. Analysis Machine Intel., 3(6):661–669, Nov. 1981.
G. J. Klinker, S. A. Shafer, and T. Kanade. A physical approach to color image understanding.Intl. J. Comp. Vision, 4:7–38, 1990.
R. Kozera. Existence and uniqueness in photometric stereo.Applied Mathematics and Computation, 44(1):1–103, July 1991.
J. H. Lambert.Photometria sive de mensura de gratibus luminis, colorum et umbrae. Eberhard Klett, Augsberg, Germany, 1760.
S. K. Nayar and Y. Gong. Colored interreflections and shape recovery. InDARPA Image Understanding Workshop, Jan. 1992.
S. K. Nayar, K. Ikeuchi, and T. Kanade. Determining shape and reflectance of hybrid surfaces by photometric sampling.IEEE Transactions on Robotics and Automation, 6(4):418–430, Aug. 1990.
S. K. Nayar, K. Ikeuchi, and T. Kanade. Shape from interreflections.Intl. J. Comp. Vision, 6(3):173–195, 1991.
C. L. Novak and S. A. Shafer. Anatomy of a histogram. InProc. Conf. Comp. Vision Pat. Recog., pages 599–505, June 1992.
J. Oliensis. Uniqueness in shape from shading.Intl. J. Comp. Vision, 6(2):75–104, 1991.
R. Onn and A. Bruckstein. Integrability disambiguates surface recovery in two-image photometric stereo.Intl. J. Comp. Vision, 5 (1):105–113, 1990.
J.-S. Park and J. T. Tou. Highlight separation and surface orientations for 3-D specular objects. InProc. Intern. Conf. Pat. Recog., pages 331–335, 1990.
D. F. Rogers and J. A. Adams.Mathematical Elements for Computer Graphics. McGraw-Hill, 2nd edition, 1990.
S. A. Shafer. Using color to separate reflection components.COLOR research and application, 10(4):210–218, 1985.
T. Simchony and R. Chellappa. Direct analytical methods for solving poisson equations in computer vision problems.Trans. Pat. Analysis Machine Intel., 12(5):435–445, May 1990.
K. E. Torrance and E. M. Sparrow. Theory for off-specular reflection from roughened surfaces.J. Opt. Soc. Amer., 57(9):1105–1114, Sept. 1967.
G. J. Ward. Measuring and modeling anisotropic reflection.Comp. Graphics, 26(2):265–272, July 1992. Proceedings ACM Siggraph '92.
L. B. Wolff. Spectral and polarization stereo methods using a single light source. InProc. Intl. Conf. Comp. Vision, pages 708–715, June 1987.
R. J. Woodham. Photometric stereo: A reflectance map technique for determining surface orientation from a single view. InProc. SPIE, volume 155, pages 136–143, 1978.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Christensen, P.H., Shapiro, L.G. Three-dimensional shape from color photometric stereo. Int J Comput Vision 13, 213–227 (1994). https://doi.org/10.1007/BF01427152
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01427152