Skip to main content
Download book PDF
View expanded cover

European Conference on Computer Vision

ECCV 2010: Computer Vision – ECCV 2010 pp 115–126Cite as

Photometric Stereo from Maximum Feasible Lambertian Reflections

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNIP,volume 6314)

Abstract

We present a Lambertian photometric stereo algorithm robust to specularities and shadows and it is based on a maximum feasible subsystem (Max FS) framework. A Big-M method is developed to obtain the maximum subset of images that satisfy the Lambertian constraint among the whole set of captured photometric stereo images which include non-Lambertian reflections such as specularities and shadows. Our algorithm employs purely algebraic pixel-wise optimization without relying on probabilistic/physical reasoning or initialization, and it guarantees the global optimality. It can be applied to the image sets with the number of images ranging from four to hundreds, and we show that the computation time is reasonably short for a medium number of images (10~100). Experiments are carried out with various objects to demonstrate the effectiveness of the algorithm.

Keywords

  • Mixed Integer Linear Programming
  • Bidirectional Reflectance Distribution Function
  • Photometric Stereo
  • Picture Frame
  • Shadowed Pixel

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Download conference paper PDF

References

  1. Woodham, R.: Photometric method for determining surface orientation from multiple images. Opt. Eng. 19(1), 139–144 (1980)

    Google Scholar 

  2. Coleman Jr., E., Jain, R.: Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry. CGIP 18(4), 309–328 (1982)

    Google Scholar 

  3. Sato, Y., Ikeuchi, K.: Temporal-color space analysis of reflection. Journal of Optical Society of America A 11(11), 2990–3002 (1992)

    CrossRef  Google Scholar 

  4. Barsky, S., Petrou, M.: The 4-source photometric stereo technique for three-dimensional surfaces in the presence of highlights and shadows. PAMI 25(10), 1239–1252 (2003)

    Google Scholar 

  5. Nayar, S., Ikeuchi, K., Kanade, T.: Determining shape and reflectance of hybrid surfaces by photometric sampling. IEEE Trans. on Robotics and Automation 6(4), 418–431 (1990)

    CrossRef  Google Scholar 

  6. Chandraker, M., Agarwal, S., Kriegman, D.: Shadowcuts: Photometric stereo with shadows. In: IEEE Conference on Computer Vision and Pattern Recognition (2007)

    Google Scholar 

  7. Mallick, S.P., Zickler, T.E., Kriegman, D.J., Belhumeur, P.N.: Beyond Lambert: Reconstructing specular surfaces using color. In: IEEE International Conference on Computer Vision (2005)

    Google Scholar 

  8. Hertzmann, A., Seitz, S.: Shape and materials by example: a photometric stereo approach. In: IEEE Conference on Computer Vision and Pattern Recognition (2003)

    Google Scholar 

  9. Goldman, D., Curless, B., Hertzmann, A., Seitz, S.: Shape and spatially-varying brdfs from photometric stereo. In: IEEE International Conference on Computer Vision (2005)

    Google Scholar 

  10. Tagare, H., de Figueiredo, R.: A theory of photometric stereo for a class of diffuse non-lambertian surfaces. PAMI 13(2), 133–152 (1991)

    Google Scholar 

  11. Georghiades, A.S.: Incorporating the Torrance and Sparrow model of reflectance in uncalibrated photometric stereo. In: IEEE International Conference on Computer Vision (2003)

    Google Scholar 

  12. Chung, H.-S., Jia, J.: Efficient photometric stereo on glossy surfaces with wide specular lobes. In: IEEE Conference on Computer Vision and Pattern Recognition (2008)

    Google Scholar 

  13. Wu, T.-P., Tang, K.-L., Tang, C.-K., Wong, T.-T.: Dense photometric stereo: A markov random field approach. PAMI 28(11), 1830–1846 (2006)

    Google Scholar 

  14. Wu, T.-P., Tang, C.-K.: Dense photometric stereo by expectation maximization. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3954, pp. 159–172. Springer, Heidelberg (2006)

    CrossRef  Google Scholar 

  15. Verbiest, F., Van Gool, L.: Photometric stereo with coherent outlier handling and confidence estimation. In: IEEE Conference on Computer Vision and Pattern Recognition (2008)

    Google Scholar 

  16. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24(6), 381–395 (1981)

    CrossRef  MathSciNet  Google Scholar 

  17. Li, H.: Consensus Set Maximization with guaranteed global optimality for robust geometry estimation. In: IEEE International Conference on Computer Vision (2009)

    Google Scholar 

  18. Ke, Q., Kanade, T.: Quasiconvex optimization for robust geometric reconstruction. In: IEEE International Conference on Computer Vision (2005)

    Google Scholar 

  19. Chinneck, J.W.: Feasibility and infeasibility in optimization: algorithms and computational methods, 1st edn. Springer, Heidelberg (2007)

    Google Scholar 

  20. Parker, M.: A set covering approach to infeasibility analysis of linear programming problems and related issues. PhD thesis, University of Colorado at Denver (1995)

    Google Scholar 

  21. Makhorin, A.: GLPK (GNU linear programming kit) 4.1.6 (2004), http://www.gnu.org/software/glpk/glpk.html

  22. Agrawal, A., Raskar, R., Chellappa, R.: What is the range of surface reconstructions from a gradient field? In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 578–591. Springer, Heidelberg (2006)

    CrossRef  Google Scholar 

  23. Agrawal, A., Raskar, R., Chellappa, R.: An algebraic approach to surface reconstructions from gradient fields? In: IEEE International Conference on Computer Vision (2006)

    Google Scholar 

  24. Hernández, C., Vogiatzis, G., Cipolla, R.: Shadows in three-source photometric stereo. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part I. LNCS, vol. 5302, pp. 290–303. Springer, Heidelberg (2008)

    CrossRef  Google Scholar 

  25. Liu, C., Szeliski, R., Kang, S.B., Zitnick, C.L., Freeman, W.T.: Automatic estimation and removal of noise from a single image. PAMI 30(2), 299–314 (2008)

    Google Scholar 

  26. Mukaigawa, Y., Ishii, Y., Shakunaga, T.: Analysis of photo-metric factors based on photometric linearization. Journal of Optical Society of America A 24(10), 3326–3334 (2007)

    CrossRef  Google Scholar 

  27. Higo, T., Matsushita, Y., Joshi, N., Ikeuchi, K.: A hand-held photometric stereo camera for 3-D modeling. In: IEEE International Conference on Computer Vision (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Media Technology, Sogang University, Seoul, Korea

    Chanki Yu, Yongduek Seo & Sang Wook Lee

Authors
  1. Chanki Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yongduek Seo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sang Wook Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. GRASP Laboratory, University of Pennsylvania, 3330 Walnut Street, 19104, Philadelphia, PA, USA

    Kostas Daniilidis

  2. School of Electrical and Computer Engineering, National Technical University of Athens, 15773, Athens, Greece

    Petros Maragos

  3. Department of Applied Mathematics, Ecole Centrale de Paris, Grande Voie des Vignes, 92295, Chatenay-Malabry, France

    Nikos Paragios

Rights and permissions

Reprints and Permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yu, C., Seo, Y., Lee, S.W. (2010). Photometric Stereo from Maximum Feasible Lambertian Reflections. In: Daniilidis, K., Maragos, P., Paragios, N. (eds) Computer Vision – ECCV 2010. ECCV 2010. Lecture Notes in Computer Science, vol 6314. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15561-1_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-15561-1_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-15560-4

  • Online ISBN: 978-3-642-15561-1

  • eBook Packages: Computer ScienceComputer Science (R0)