Abstract
We tackle the problem of 3D surface reconstruction by a single static camera, extracting the maximum amount of information from gray level changes caused by object motion under illumination by a fixed set of light sources. We basically search for the depth at each point on the surface of the object while exploiting the recently proposed Geotensity constraint [11] that accurately governs the relationship between four or more images of a moving object in spite of the illumination variance due to object motion. The thrust of this paper is then to extend the availability of the Geotensity constraint to the case of multiple point light sources instead of a single light source. We first show that it is mathematically possible to identify multiple illumination subspaces for an arbitrary unknown number of light sources. We then propose a new technique to effectively carry out the separation of the subspaces by introducing the surface interaction matrix. Finally, we construct a framework for surface recovery, taking the multiple illumination subspaces into account. The theoretical propositions are investigated through experiments and shown to be practically useful.
Work performed while at Research and Development Center, TOSHIBA Co. The author is presently with Anthropics Technology, Ealing Studios, Ealing Green, Ealing, London W5 5EP, UK.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
P.A. Beardsley, P. Torr, and A.P. Zisserman. 3D model acquisition from extended image sequences. In 4rd ECCV, pages 683–695, Cambridge, UK, 1996.
P.N. Belhumeur and D.J. Kriegman. What is the set of images of an object under all possible illumination conditions? IJCV, 28:3:245–260, 1998.
J. Costeira and T. Kanade. A multi-body factorization method for independently moving objects. IJCV, 29:3:159–179, 1998.
F. Devernay and O. Faugeras. Computing differential properties of 3D shapes from stereoscopic images without 3d models. In CVPR, pages 208–213, 1994.
P. Fua. Object-centered surface reconstruction: combining multi-image stereo and shading. IJCV, 16:35–56, 1995.
G. W. Gear. Multibody grouping from motion images. IJCV, 29:2:133–150, 1998.
B.K.P. Horn. Robot Vision. The MIT Press, 1992.
K. Kanatani. Geometric computation for machine vision. Oxford University Press, Oxford, 1992.
K. Kanatani. Factorization without factorization: Multibody segmentation. Vol. 98 no. 395, IEICE, PRMU98-117, 1998.
A. Maki. Estimation of illuminant direction and surface reconstruction by Geotensity constraint. In 11th SCIA, pages 71–78, 1999.
A. Maki, M. Watanabe, and C.S. Wiles. Geotensity: Combining motion and lighting for 3d surface reconstruction. In 6th ICCV, pages 1053–1060, 1998.
J.L. Mundy and A. Zisserman, editors. Geometric invariance in computer vision. The MIT Press, 1992.
A.P. Pentland. Photometric motion. IEEE-PAMI, 13:9:879–890, 1991.
A. Shashua. Geometry and photometry in 3D visual recognition. PhD thesis, Dept. Brain and Cognitive Science, MIT, 1992.
C. Tomasi and T. Kanade. Shape and motion from image streams under orthography: a factorization method. IJCV, 9:2:137–154, 1992.
D. Weinshall and C. Tomasi. Linear and incremental acquisition of invariant shape models from image sequences. In 4th ICCV, pages 675–682, 1993.
C.S. Wiles, A. Maki, N. Matsuda, and M. Watanabe. Hyper-patches for 3d model acquisition and tracking. In CVPR, pages 1074–1080, 1997.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Maki, A., Wiles, C. (2000). Geotensity Constraint for 3D Surface Reconstruction under Multiple Light Sources. In: Computer Vision - ECCV 2000. ECCV 2000. Lecture Notes in Computer Science, vol 1842. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45054-8_47
Download citation
DOI: https://doi.org/10.1007/3-540-45054-8_47
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67685-0
Online ISBN: 978-3-540-45054-2
eBook Packages: Springer Book Archive