Abstract
We propose modifying the aperture of a conventional color camera so that the effective aperture size for one color channel is smaller than that for the other two. This produces an image where different color channels have different depths-of-field, and from this we can computationally recover scene depth, reconstruct an all-focus image and achieve synthetic re-focusing, all from a single shot. These capabilities are enabled by a spatio-spectral image model that encodes the statistical relationship between gradient profiles across color channels. This approach substantially improves depth accuracy over alternative single-shot coded-aperture designs, and since it avoids introducing additional spatial distortions and is light efficient, it allows high-quality deblurring and lower exposure times. We demonstrate these benefits with comparisons on synthetic data, as well as results on images captured with a prototype lens.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Levin, A., Fergus, R., Durand, F., Freeman, W.T.: Image and depth from a conventional camera with a coded aperture. ACM Trans. on Graph, SIGGRAPH (2007)
Veeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A., Tumblin, J.: Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing. ACM Trans. on Graph, SIGGRAPH (2007)
Zhou, C., Lin, S., Nayar, S.K.: Coded Aperture Pairs for Depth from Defocus and Defocus Deblurring. Intl. J. Computer Vision (2011)
Krishnan, D., Fergus, R.: Fast image deconvolution using Hyper-Laplacian priors. In: Advances in Neural Info. Process. Sys. (2009)
Chaudhuri, S., Rajagopalan, A.N.: Depth from defocus: A real aperture imaging approach. Springer, New York (1999)
Hasinoff, S.W., Kutulakos, K.N.: A layer-based restoration framework for variable-aperture photography. In: Intl. Conf. Computer Vision (2007)
Levin, A.: Analyzing Depth from Coded Aperture Sets. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 214–227. Springer, Heidelberg (2010)
Cossairt, O., Nayar, S.K.: Spectral Focal Sweep: Extended Depth of Field from Chromatic Aberrations. In: IEEE Intl. Conf. Computational Photography (2010)
Amari, Y., Adelson, E.: Single-eye range estimation by using displaced apertures with color filters. In: Intl. Conf. on Industrial Electronics, Control, Instrumentation, and Automation (1992)
Chang, I.C., Huang, C.L., Hsueh, W.J., Lin, H.C., Chen, C.C., Yeh, Y.H.: Novel 3D handheld camera based on triaperture lens. In: Proceedings of SPIE (2002)
Bando, Y., Chen, B., Nishita, T.: Extracting depth and matte using a color-filtered aperture. ACM Trans. on Graph, SIGGRAPH Asia (2008)
Rother, C., Kolmogorov, V., Blake, A.: Grabcut: Interactive foreground extraction using iterated graph cuts. ACM Trans. on Graph, SIGGRAPH (2004)
Levin, A., Rav Acha, A., Lischinski, D.: Spectral matting. IEEE Trans. Pattern Anal. & Mach. Intell. (2008)
Joshi, N., Zitnick, C.L., Szeliski, R., Kriegman, D.J.: Image deblurring and denoising using color priors. In: IEEE Conf. Computer Vision & Pattern Recognition (2009)
Chakrabarti, A., Zickler, T.: Statistics of real-world hyperspectral images. In: IEEE Conf. Computer Vision & Pattern Recognition (2011)
Rajagopalan, A., Chaudhuri, S.: Optimal selection of camera parameters for recovery of depth from defocused images. In: IEEE Conf. Computer Vision & Pattern Recognition (1997)
Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.T.: Removing camera shake from a single photograph. ACM Trans. on Graph, SIGGRAPH (2006)
Gehler, P.V., Rother, C., Blake, A., Minka, T., Sharp, T.: Bayesian color constancy revisited. In: IEEE Conf. Computer Vision & Pattern Recognition (2008)
Boykov, Y., Veksler, O., Zabih, R.: Efficient approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. & Mach. Intell. (2001)
Chakrabarti, A., Zickler, T.: Fast deconvolution with color constraints on gradients. Technical Report TR-06-12, Computer Science Group, Harvard University (2012)
Baek, J.: Multi-channel coded-aperture photography. Master’s thesis. MIT (2008)
Zhou, C., Nayar, S.K.: What are Good Apertures for Defocus Deblurring? In: IEEE Intl. Conf. Computational Photography (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chakrabarti, A., Zickler, T. (2012). Depth and Deblurring from a Spectrally-Varying Depth-of-Field. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7576. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33715-4_47
Download citation
DOI: https://doi.org/10.1007/978-3-642-33715-4_47
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33714-7
Online ISBN: 978-3-642-33715-4
eBook Packages: Computer ScienceComputer Science (R0)