The measurement of highlights in color images

  • Gudrun J. Klinker
  • Steven A. Shafer
  • Takeo Kanade


In this paper, we present an approach to color image understanding that accounts for color variations due to highlights and shading. We demonstrate that the reflected light from every point on a dielectric object, such as plastic, can be described as a linear combination of the object color and the highlight color. The colors of all light rays reflected from one object then form a planar cluster in the color space. The shape of this cluster is determined by the object and highlight colors and by the object shape and illumination geometry. We present a method that exploits the difference between object color and highlight color to separate the color of every pixel into a matte component and a highlight component. This generates two intrinsic images, one showing the scene without highlights, and the other one showing only the highlights. The intrinsic images may be a useful tool for a variety of algorithms in computer vision, such as stereo vision, motion analysis, shape from shading, and shape from highlights. Our method combines the analysis of matte and highlight reflection with a sensor model that accounts for camera limitations. This enables us to successfully run our algorithm on real images taken in a laboratory setting. We show and discuss the results.


Computer Vision Color Image Color Space Motion Analysis Color Variation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    D.H. Ballard and C.M. Brown,Computer Vision. Prentice Hall: Englewood Cliffs, NJ 07632, 1982.Google Scholar
  2. 2.
    P. Beckmann and A. Spizzichino,The Scattering of Electromagnetic Waves from Rough Surfaces. MacMillan: New York, 1963, pp. 1–33, 70–96.Google Scholar
  3. 3.
    J.D.E. Beynon and D.R. Lamb (eds.),Charge-coupled devices and their application. McGraw-Hill: London, 1980.Google Scholar
  4. 4.
    W. Budde,Optical Radiation Measurements. Volume 4:Physical Detectors of Optical Radiation. Academic Press: New York, 1983.Google Scholar
  5. 5.
    R.L. Cook and K.E. Torrance, “A reflectance model for computer graphics,”ACM Trans. Graphics 1(1): 7–24, January 1982. Also published in COMPUTER GRAPHICS 15(3), SIGGRAPH'81Google Scholar
  6. 6.
    M. D'Zmura and P. Lennie, “Mechanisms of color constancy,”J. Opt. Soc. Amer. A (JOSA-A), 3(10):1662–1672. October 1986.Google Scholar
  7. 7.
    L. Dreschler and H.-H. Nagel, “Volumetric model and 3D trajectory of a moving car derived from monocular TV frame Sequences of a Street Scene,”Comput. Graphics Image Process., 20:199–228, 1982.Google Scholar
  8. 8.
    R. Gershon, “The use of color in computational vision.” PhD thesis, Department of Computer Science, Univ. of Toronto, 1987.Google Scholar
  9. 9.
    R. Gershon, A.D. Jepson, and J.K. Tsotsos, “Highlight identification using chromatic information,” InProc. first Int. Conf. Computer Vision (ICCV), London, Computer Society Press (IEEE), June 8–11, 1987, pp. 161–171.Google Scholar
  10. 10.
    H. Grassmann, “On the theory of compound colors,”Phil. Mag., April 1854.Google Scholar
  11. 11.
    H.H. Harman,Modern Factor Analysis, 2nd ed. University of Chicago Press: Chicago and London, 1967.Google Scholar
  12. 12.
    G. Healey and T.O. Binford, “Local shape from specularity,” In J.M. Brady and A. Rosenfeld (eds.),Proc. First Int. Conf. Computer Vision (ICCV), Computer Society Press (IEEE), London, June 8–11, 1987, pp. 151–161. Also appeared in DARPA-Image Understanding Workshop. Los Angeles, CA, February 1987, pp. 874–887.Google Scholar
  13. 13.
    G. Healey and T.O. Binford, “The role and use of color in a general vision system,” In L.S. Bauman (ed.),DARPA-Image Understanding (IUS) workshop, Los Angeles, CA, February 1987, pp. 599–613.Google Scholar
  14. 14.
    B.K.P. Horn, “Understanding image intensities,”Artifical Interlligence 8(11):201–231, 1977.Google Scholar
  15. 15.
    B.K.P. Horn, “Exact reproduction of colored images,”Computer Vision, Graphics, and Image Processing (CVGIP) 26:135–167, 1984.Google Scholar
  16. 16.
    R.S. Hunter,The Measurement of Appearance Wiley: New York, 1975.Google Scholar
  17. 17.
    R.M. Johnston, “Geometric metamerism,”Color Engineering 5(3):42, May-June, 1967.Google Scholar
  18. 18.
    R.M. Johnston, “Color theory,”Pigment Handbook. Wiley: New York, 1974, pp. 229–287, ch. III-D-b.Google Scholar
  19. 19.
    D.B. Judd and G. Wyszecki,Color in Business, Science and Industry. Wiley, New York, 1975.Google Scholar
  20. 20.
    G.J. Klinker, S.A. Shafer, and T. Kanade, “Measurement of gloss from color images.” InInter-Society Color Council (ISCC) 87 Conf. on Appearance, Williamsburg, VA, February 8–11, 1987, pp. 9–12.Google Scholar
  21. 21.
    G.J. Klinker, S.A. Shafer, and T. Kanade, “Using a color reflection model to separate highlights from object color,” In J.M. Brady and A. Rosenfeld (ed.),Proc. First Int. Conf. Computer Vision (ICCV), Computer Society Press (IEEE), London, June 8–11, 1987, pp. 145–150. Also appeared in DARPA-Image Understanding Workshop, Los Angeles, CA, February 1987, pp. 614–619.Google Scholar
  22. 22.
    Y. LeClerc, “A Method for Spectral Linearization.” Private communication, 1986.Google Scholar
  23. 23.
    H.-C. Lee, “Method for computing the scene-illuminant chromaticity from specular highlights,”J. Opt. Soc. Amer. A (JOSA-A) 3(10):1694–1699, October 1986.Google Scholar
  24. 24.
    L.T. Maloney and B.A. Wandell, “Color constancy: a method for recovering surface spectral reflectance,”J. Opt. Soc. Amer. A (JOSA-A) 3(1):29–33, January 1986.Google Scholar
  25. 25.
    P. Moon, “A table of Fresnel reflection,”J. Math. Phys. 19(1), 1940.Google Scholar
  26. 26.
    F.E. Nicodemus, J.C. Richmond, J.J. Hsia, I.W. Ginsberg, and T. Limperis,Geometrical Considerations and Nomenclature for Reflectance, Tech. Report NBS Monograph 160, National Bureau of Standards, October 1977.Google Scholar
  27. 27.
    R. Ohlander, K. Price, and D.R. Reddy, “Picture segmentation using a recursive region splitting method,”Computer Graphics and Image Processing 8:313–333, 1978.Google Scholar
  28. 28.
    Y. Ohta, T. Kanade, and T. Sakai, “Color information for region segmentation,”Computer Graphics and Image Processing 13:222–231, 1980.Google Scholar
  29. 29.
    T. Pavlidis,Structural Pattern Recognition. Springer Verlag: Berlin, Heidelberg, New York, 1977.Google Scholar
  30. 30.
    B.T. Phong. “Illumination for computer generated pictures,”Communications of the ACM 18:311–317, 1975.Google Scholar
  31. 31.
    J.M. Rubin and W.A. Richards, “Color vision and image intensities: When are changes material?”Biological Cybernetics 45:215–226, 1982.Google Scholar
  32. 32.
    S.A. Shafer, “Describing light mixtures through linear algebra,”J. Opt. Soc. Amer. (JOSA) 72(2):299–300, February 1982.Google Scholar
  33. 33.
    S.A. Shafer, “Optical phenomena in computer vision,”Canad. Soc. Computational Studies of Intelligence (CSCSI-84), Ontario, May 1984. Also available as Tech. Report TR-135, Computer Science Department, Univ. Rochester, March 1984.Google Scholar
  34. 34.
    S.A. Shafer, “Using color to separate reflection components,”COLOR res. appl. 10(4):210–218, Winter 1985. Also avaible as Tech. Report TR-136, Computer Science Department, Univ. of Rochester, NY, April 1984.Google Scholar
  35. 35.
    C.E. Thorpe, “FIDO: Vision and navigation for a robot rover.” PhD thesis, Computer Science Department, Carnegie-Mellon University, December 1984. Available as Tech. Report CMU-CS-84-168.Google Scholar
  36. 36.
    K.E. Torrance and E.M. Sparrow, “Theory of off-specular reflection from roughened surfaces,”J. Opt. Soc. Amer. 57:1105–1114, September 1967.Google Scholar
  37. 37.
    S.J. Williamson and H.Z. Cummins,Light and Color in Nature and Art. Wiley, New York, 1983.Google Scholar
  38. 38.
    G.J. Klinker, S.A. Shafer, and T. Kanade, “Image segmentation and reflection analysis through color.” In SPIE's 1988 Techn. Symp. on Ophics, Electro-Ophics, and Sensors, April 4–8, 1988, Orlando, Florida. (Also in DARPA-Image Understanding Workshop, Boston, MA, April 1988.)Google Scholar

Copyright information

© Kluwer Academic Publishers 1988

Authors and Affiliations

  • Gudrun J. Klinker
    • 1
  • Steven A. Shafer
    • 1
  • Takeo Kanade
    • 1
  1. 1.Computer Science DepartmentCarnegie Mellon UniversityPittsburghPA

Personalised recommendations