Abstract
We present confocal stereo, a new method for computing 3D shape by controlling the focus and aperture of a lens. The method is specifically designed for reconstructing scenes with high geometric complexity or fine-scale texture. To achieve this, we introduce the confocal constancy property, which states that as the lens aperture varies, the pixel intensity of a visible in-focus scene point will vary in a scene-independent way, that can be predicted by prior radiometric lens calibration. The only requirement is that incoming radiance within the cone subtended by the largest aperture is nearly constant. First, we develop a detailed lens model that factors out the distortions in high resolution SLR cameras (12MP or more) with large-aperture lenses (e.g., f1.2). This allows us to assemble an A × F aperture-focus image (AFI) for each pixel, that collects the undistorted measurements over all A apertures and F focus settings. In the AFI representation, confocal constancy reduces to color comparisons within regions of the AFI, and leads to focus metrics that can be evaluated separately for each pixel. We propose two such metrics and present initial reconstruction results for complex scenes.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Zitnick, C.L., Kang, S.B., Uyttendaele, M., Winder, S., Szeliski, R.: High-quality video view interpolation using a layered representation. In: SIGGRAPH, pp. 600–608 (2004)
Fitzgibbon, A., Wexler, Y., Zisserman, A.: Image-based rendering using image-based priors. IJCV 63, 141–151 (2005)
Hertzmann, A., Seitz, S.M.: Example-based photometric stereo: Shape reconstruction with general, varying BRDFs. PAMI 27, 1254–1264 (2005)
Wei, Y., Ofek, E., Quan, L., Shum, H.Y.: Modeling hair from multiple views. In: SIGGRAPH, pp. 816–820 (2005)
Darrell, T., Wohn, K.: Pyramid based depth from focus. In: CVPR, pp. 504–509 (1988)
Nayar, S., Watanabe, M., Noguchi, M.: Real-time focus range sensor. PAMI 18, 1186–1198 (1996)
Favaro, P., Soatto, S.: Learning shape from defocus. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2351, pp. 735–745. Springer, Heidelberg (2002)
Favaro, P., Osher, S., Soatto, S., Vese, L.A.: 3D shape from anisotropic diffusion. In: CVPR, vol. (1), pp. 179–186 (2003)
Pentland, A.P.: A new sense for depth of field. PAMI 9, 523–531 (1987)
Subbarao, M., Surya, G.: Depth from defocus: A spatial domain approach. IJCV 13, 271–294 (1994)
Farid, H., Simoncelli, E.P.: Range estimation by optical differentiation. J. Optical Society of America, A 15, 1777–1786 (1998)
Watanabe, M., Nayar, S.K.: Rational filters for passive depth from defocus. IJCV 27, 203–225 (1998)
Isaksen, A., McMillan, L., Gortler, S.J.: Dynamically reparameterized light fields. In: SIGGRAPH, pp. 297–306 (2000)
Levoy, M., Chen, B., Vaish, V., Horowitz, M., McDowall, I., Bolas, M.T.: Synthetic aperture confocal imaging. In: SIGGRAPH, pp. 825–834 (2004)
Favaro, P., Soatto, S.: Seeing beyond occlusions (and other marvels of a finite lens aperture). In: CVPR, vol. (2), pp. 579–586 (2003)
Debevec, P., Malik, J.: Recovering high dynamic range radiance maps from photographs. In: SIGGRAPH, pp. 369–378 (1997)
Smith, W.J.: Modern Optical Engineering, 3rd edn. McGraw-Hill, New York (2000)
Asada, N., Fujiwara, H., Matsuyama, T.: Seeing behind the scene: Analysis of photometric properties of occluding edges by the reversed projection blurring model. PAMI 20, 155–167 (1998)
Schechner, Y.Y., Kiryati, N.: Depth from defocus vs. stereo: How different really are they? IJCV 39, 141–162 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hasinoff, S.W., Kutulakos, K.N. (2006). Confocal Stereo. In: Leonardis, A., Bischof, H., Pinz, A. (eds) Computer Vision – ECCV 2006. ECCV 2006. Lecture Notes in Computer Science, vol 3951. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11744023_48
Download citation
DOI: https://doi.org/10.1007/11744023_48
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33832-1
Online ISBN: 978-3-540-33833-8
eBook Packages: Computer ScienceComputer Science (R0)