Skip to main content
SpringerLink
Log in

A Solution of the Dichromatic Model for Multispectral Photometric Invariance

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

In this paper, we address the problem of photometric invariance in multispectral imaging making use of an optimisation approach based upon the dichromatic model. In this manner, we cast the problem of recovering the spectra of the illuminant, the surface reflectance and the shading and specular factors in a structural optimisation setting. Making use of the additional information provided by multispectral imaging and the structure of image patches, we recover the dichromatic parameters of the scene. To do this, we formulate a target cost function combining the dichromatic error and the smoothness priors for the surfaces under study. The dichromatic parameters are recovered through minimising this cost function in a coordinate descent manner. The algorithm is quite general in nature, admitting the enforcement of smoothness constraints and extending in a straightforward manner to trichromatic settings. Moreover, the objective function is convex with respect to the subset of variables to be optimised in each alternating step of the minimisation strategy. This gives rise to an optimal closed-form solution for each of the iterations in our algorithm. We illustrate the effectiveness of our method for purposes of illuminant spectrum recovery, skin recognition, material clustering and specularity removal. We also compare our results to a number of alternatives.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Angelopoulou, E. (2000). Objective colour from multispectral imaging. In European conf. on computer vision (pp. 359–374).

  • Angelopoulou, E. (2007). Specular highlight detection based on the Fresnel reflection coefficient. In IEEE international conference on computer vision (pp. 1–8). Los Alamitos: IEEE Computer Society.

    Google Scholar 

  • Barnard, K., Martin, L., & Funt, B. V. (2000). Colour by correlation in a three-dimensional colour space. In ECCV ’00: Proceedings of the 6th European conference on computer vision – part I (pp. 375–389). London: Springer.

    Google Scholar 

  • Barnard, K., Martin, L., Coath, A., & Funt, B. V. (2002a). A comparison of computational color constancy Algorithms – Part II: Experiments with image data. IEEE Transactions on Image Processing, 11(9), 985–996.

    Article  Google Scholar 

  • Barnard, K., Martin, L., Funt, B., & Coath, A. (2002b). A data set for colour research. Color Research and Application, 27(3), 147–151.

    Article  Google Scholar 

  • Boyd, S., & Vandenberghe, L. (2004). Convex optimization. Cambridge: Cambridge University Press.

    MATH  Google Scholar 

  • Brainard, D. H., & Freeman, W. T. (1997). Bayesian color constancy. Journal of Optical Society America A, 14(7), 1393–1411.

    Article  Google Scholar 

  • Brainard, D., & Wandell, B. (1986). Analysis of the retinex theory of color vision. Journal of Optical Society America A, 3, 1651–1661.

    Article  Google Scholar 

  • Brainard, D. H., Delahunt, P. B., Freeman, W. T., Kraft, J. M., & Xiao, B. (2006). Bayesian model of human color constancy. Journal of Vision, 6(11), 1267–1281.

    Article  Google Scholar 

  • Brelstaff, G., & Blake, A. (1988). Detecting specular reflection using lambertian constraints. In Int. conf. on comp. vision (pp. 297–302).

  • Brooks, M., & Horn, B. (1985). Shape and source from shading. In MIT AI Memo.

  • Buchsbaum, G. (1980). A spatial processor model for object color perception. Journal of The Franklin Institute, 310, 1–26.

    Article  Google Scholar 

  • Chang, C.-C., & Lin, C.-J. (2001). LIBSVM: a library for support vector machines.

  • Chang, J. Y., Lee, K. M., & Lee, S. U. (2003). Shape from shading using graph cuts. In Proc. of the int. conf. on image processing.

  • CIE (1932). Commission Internationale de l’Éclairage Proceedings, 1931. Cambridge: Cambridge University Press.

    Google Scholar 

  • Dror, R. O., Adelson, E. H., & Willsky, A. S. (2001). Recognition of surface reflectance properties from a single image under unknown real-world illumination. In Proc. of the IEEE workshop on identifying objects across variations in lighting.

  • Ferrie, F., & Lagarde, J. (1992). Curvature consistency improves local shading analysis. CVGIP: Image Understanding, 55(1), 95–105.

    Article  MATH  Google Scholar 

  • Finlayson, G., & Hordley, S. (2000). Improving gamut mapping color constancy. IEEE Transactions on Image Processing, 9, 10.

    Article  Google Scholar 

  • Finlayson, G. D., & Schaefer, G. (2001a). Convex and non-convex illuminant constraints for dichromatic colour constancy. CVPR, 1, 598–604.

    Google Scholar 

  • Finlayson, G. D., & Schaefer, G. (2001b). Solving for colour constancy using a constrained dichromatic reflection model. International Journal of Computer Vision, 42(3), 127–144.

    Article  MATH  Google Scholar 

  • Finlayson, G. D., Hordley, S. D., & Hubel, P. M. (2001). Color by correlation: a simple, unifying framework for color constancy. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(11), 1209–1221.

    Article  Google Scholar 

  • Finlayson, G. D., Hordley, S. D., & Tastl, I. (2006). Gamut constrained illuminant estimation. International Journal of Computer Vision, 67(1), 93–109.

    Article  Google Scholar 

  • Forsyth, D. A. (1990). A novel algorithm for color constancy. International Journal of Computer Vision, 5(1), 5–36.

    Article  Google Scholar 

  • Healey, G. (1991). Estimating spectral reflectance using highlights. Image and Vision Computing, 9(5), 333–337.

    Article  Google Scholar 

  • Healey, G., & Slater, D. (1999). Invariant recognition in hyperspectral images. In IEEE conf. on computer vision and pattern recognition (pp. 1438–1043).

  • Hoaglin, D. C., Mosteller, F., & Tukey, J. W. (2000). Understanding robust and exploratory data analysis. New York: Wiley.

    MATH  Google Scholar 

  • Hofmann, T., & Buhmann, M. (1997). Pairwise data clustering by deterministic annealing. IEEE Tansactions on Pattern Analysis and Machine Intelligence, 19(1), 1–14.

    Article  Google Scholar 

  • Horn, B. K. P. (1986). Robot vision. Cambridge: MIT.

    Google Scholar 

  • Horn, B. K. P., & Brooks, M. J. (1986). The variational approach to shape from shading. Computer Vision, Graphics and Image Processing, 33(2), 174–208.

    Article  Google Scholar 

  • Huber, P. J. (1981). Robust statistics. New York: Wiley.

    Book  MATH  Google Scholar 

  • Ikeuchi, K., & Horn, B. (1981). Numerical shape from shading and occluding boundaries. Artificial Intelligence, 17(1–3), 141–184.

    Article  Google Scholar 

  • Klinker, G., Shafer, S., & Kanade, T. (1990). A physical approach to color image understanding. International Journal of Computer Vision, 4(1), 7–38.

    Article  Google Scholar 

  • Klinker, G. J., Shafer, S. A., & Kanade, T. (1988). The measurement of highlights in color images. International Journal of Computer Vision, 2, 7–32.

    Article  Google Scholar 

  • Koenderink, J. J., & van Doorn, A. J. (1992). Surface shape and curvature scales. Image and Vision Computing, 10(8), 557–565.

    Article  Google Scholar 

  • Land, E. H. (1986). Recent advances in retinex theory. Vision Research, 26(1)

  • Land, E., & McCann, J. (1971). Lightness and retinex theory. Journal of Optical Society America, 61(1), 1–11.

    Article  Google Scholar 

  • Lee, H.-C. (1986). Method for computing the scene-illuminant chromaticity from specular highlights. Journal of the Optical Society of America A, 3, 1694–1699.

    Article  Google Scholar 

  • Li, S. Z. (1995). Discontinuous mrf prior and robust statistics: a comparative study. Image and Vision Computing, 13(3), 227–233.

    Article  Google Scholar 

  • Lin, S., & Shum, H.-Y. (2001). Separation of diffuse and specular reflection in color images. In Computer vision and pattern recognition, ieee computer society conference on 1 (p. 341).

  • Mallick, S. P., Zickler, T., Belhumeur, P. N., & Kriegman, D. J. (2006). Specularity removal in images and videos: A PDE approach. In ECCV (1) (pp. 550–563).

  • Narasimhan, S. G., Ramesh, V., & Nayar, S. K. (2003). A class of photometric invariants: separating material from shape and illumination. In International conference on computer vision (pp. 1387–1394). Washington: IEEE Computer Society.

    Chapter  Google Scholar 

  • Nayar, S. K., & Bolle, R. M. (1993). Computing reflectance ratios from an image. Pattern on Recognition, 26, 1529–1542.

    Article  Google Scholar 

  • Nayar, S., & Bolle, R. (1996). Reflectance based object recognition. International Journal of Computer Vision, 17(3), 219–240.

    Article  Google Scholar 

  • Phung, S. L., Bouzerdoum, A., & Chai, D. (2005). Skin segmentation using color pixel classification: Analysis and comparison. IEEE Transactions on Pattern Analyses and Machine Intelligence, 27(1), 148–154.

    Article  Google Scholar 

  • Poggio, T., & Torre, V. (1984). Ill-posed problems and regularization analysis in early vision. Tech. rep., Cambridge, MA, USA.

  • Ragheb, H., & Hancock, E. R. (2002). Highlight removal using shape-from-shading. In European conf. on comp. vision, LNCS (Vol. 2351, pp. 626–641).

  • Raskar, R., Tumblin, J., Mohan, A., Agrawal, A., & Li, Y. (2006). Computational photography. In Proceeding of Eurographics: state of the art report (STAR).

  • Shafer, S. A. (1985). Using color to separate reflection components. Color Research and Applications, 10(4), 210–218.

    Article  Google Scholar 

  • Schaefer, G., Hordley, S., & Finlayson, G. (2005). A combined physical and statistical approach to colour constancy. In Computer vision and pattern recognition, IEEE computer society conference on 1 (pp. 148–153).

  • Slater, D., & Healey, G. (1997). Object recognition using invariant profiles. In Computer vision and pattern recognition (pp. 827–832).

  • Stockman, H., & Gevers, T. (1999). Detection and classification of hyperspectral edges. In British machine vision conference (pp. 643–651).

  • Suen, P. H., & Healey, G. (2001). Invariant mixture recognition in hyperspectral images. In Int. conference on computer vision (pp. 262–267).

  • Sunshine, J. M., Pieters, C. M., & Pratt, S. F. (1990). Deconvolution of mineral absorption bands: an improved approach. Journal of Geophysical Research, 95(B5), 6955–6966.

    Article  Google Scholar 

  • Tan, R. T., Nishino, K., & Ikeuchi, K. (2004). Separating reflection components based on chromaticity and noise analysis. IEEE Transactions on Pattern Analyses and Machine Intelligence, 26(10), 1373–1379.

    Article  Google Scholar 

  • Tominaga, S., & Wandell, B. A. (1989). Standard surface-reflectance model and illuminant estimation. Journal of the Optical Society of America A, 6, 576–584.

    Article  Google Scholar 

  • Tominaga, S., & Wandell, B. A. (1990). Component estimation of surface spectral reflectance. Journal of the Optical Society of America A, 7(2), 312–317.

    Article  Google Scholar 

  • van de Weijer, J., & Gevers, T. (2005). Color constancy based on the grey-edge hypothesis. In IEEE international conference on image processing (Vol. 2, pp. 722–725).

  • Wang, J., & Dana, K. J. (2006). Relief texture from specularities. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(3), 446–457.

    Article  Google Scholar 

  • Worthington, P. L., & Hancock, E. R. (1999). New constraints on data-closeness and needle map consistency for shape-from-shading. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(12), 1250–1267.

    Article  Google Scholar 

  • Zheng, Q., & Chellapa, R. (1991). Estimation of illuminant direction, albedo, and shape from shading. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(7), 680–702.

    Article  Google Scholar 

  • Zickler, T., Mallick, S. P., Kriegman, D. J., & Belhumeur, P. N. (2008). Color subspaces as photometric invariants. International Journal of Computer Vision, 79(1), 13–30.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Engineering, Australian National University, Canberra, ACT, 0200, Australia

    Cong Phuoc Huynh & Antonio Robles-Kelly

  2. National ICT Australia (NICTA), Locked Bag 8001, Canberra, ACT, 2601, Australia

    Antonio Robles-Kelly

Authors
  1. Cong Phuoc Huynh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Antonio Robles-Kelly
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cong Phuoc Huynh.

Additional information

NICTA is funded by the Australian Government as represented by the Department of Broadband, Communications and the Digital Economy and the Australian Research Council through the ICT Centre of Excellence program.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Huynh, C.P., Robles-Kelly, A. A Solution of the Dichromatic Model for Multispectral Photometric Invariance. Int J Comput Vis 90, 1–27 (2010). https://doi.org/10.1007/s11263-010-0333-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-010-0333-y

Keywords

Search

Navigation