Advertisement

Unified Frequency Domain Analysis of Lightfield Cameras

  • Todor Georgiev
  • Chintan Intwala
  • Sevkit Babakan
  • Andrew Lumsdaine
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5304)

Abstract

This paper presents a theory that encompasses both “plenoptic” (microlens based) and “heterodyning” (mask based) cameras in a single frequency-domain mathematical formalism. Light-field capture has traditionally been analyzed using spatio-angular representation, with the exception of the frequency-domain “heterodyning” work. In this paper we interpret “heterodyning” as a general theory of multiplexing the radiance in the frequency domain. Using this interpretation, we derive a mathematical theory of recovering the 4D spatial and angular information from the multiplexed 2D frequency representation. The resulting method is applicable to all lightfield cameras, lens-based and mask-based. The generality of our approach suggests new designs for lightfield cameras. We present one such novel lightfield camera, based on a mask outside a conventional camera. Experimental results are presented for all cameras described.

Keywords

Frequency Domain Frequency Domain Analysis Bandlimited Signal Conventional Camera Camera Design 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Download to read the full conference paper text

Supplementary material

978-3-540-88690-7_17_MOESM1_ESM.gif (4.9 mb)
Supplementary material (5,046 KB)

References

  1. 1.
    Guillemin, V., Sternberg, S.: Symplectic techniques in physics (1985)Google Scholar
  2. 2.
    Ives, F.: Patent US 725,567 (1903)Google Scholar
  3. 3.
    Lippmann, G.: Epreuves reversible donnant la sensation du relief. J. Phys. 7, 821–825 (1908)Google Scholar
  4. 4.
    Levoy, M., Hanrahan, P.: Light field rendering. ACM Trans. Graph, 31–42 (1996)Google Scholar
  5. 5.
    Gortler, S.J., Grzeszczuk, R., Szeliski, R., Cohen, M.F.: The lumigraph. ACM Trans. Graph, 43–54 (1996)Google Scholar
  6. 6.
    Ng, R., Levoy, M., Brdif, M., Duval, G., Horowitz, M., Hanrahan, P.: Light field photography with a hand-held plenoptic camera. Tech. Rep. (2005)Google Scholar
  7. 7.
    Chai, J., Chan, S., Shum, H., Tong, X.: Plenoptic sampling. ACM Trans. Graph, 307–318 (2000)Google Scholar
  8. 8.
    Durand, F., Holzschuch, N., Soler, C., Chan, E., Sillion, F.: A frequency analysis of light transport. ACM Trans. Graph, 1115–1126 (2005)Google Scholar
  9. 9.
    Ng, R.: Fourier slice photography. ACM Trans. Graph, 735–744 (2005)Google Scholar
  10. 10.
    Veeraraghavan, A., Mohan, A., Agrawal, A., Raskar, R., Tumblin, J.: Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing. ACM Trans. Graph 26(3), 69 (2007)CrossRefGoogle Scholar
  11. 11.
    Gerrard, A., Burch, J.M.: Introduction to matrix methods in optics (1994)Google Scholar
  12. 12.
    Georgiev, T., Zheng, K.C., Curless, B., Salesin, D., Nayar, S., Intwala, C.: Spatio-angular resolution tradeoffs in integral photography. In: Rendering Techniques 2006: 17th Eurographics Workshop on Rendering, pp. 263–272 (June 2006)Google Scholar
  13. 13.
    Oppenheim, A.V., Willsky, A.S.: Signals and Systems. Prentice Hall, Upper Saddle River, New Jersey (1997)zbMATHGoogle Scholar
  14. 14.
    Adelson, T., Wang, J.: Single lens stereo with a plenoptic camera. IEEE Transactions on Pattern Analysis and Machine Intelligence, 99–106 (1992)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Todor Georgiev
    • 1
    • 2
  • Chintan Intwala
    • 1
    • 2
  • Sevkit Babakan
    • 1
    • 2
  • Andrew Lumsdaine
    • 1
    • 2
  1. 1.Adobe SystemsSan Jose, CA
  2. 2.Computer Science DepartmentIndiana UniversityBloomington, IN

Personalised recommendations

Cite paper