Abstract
In this work, we introduce a light field acquisition approach for standard smartphones. The smartphone is manually translated along a horizontal rail, while recording synchronized video with front and rear camera. The front camera captures a control pattern, mounted parallel to the direction of translation to determine the smartphones current position. This information is used during a postprocessing step to identify an equally spaced subset of recorded frames from the rear camera, which captures the actual scene. From this data we assemble a light field representation of the scene. For subsequent disparity estimation, we apply a structure tensor approach in the epipolar plane images.
We evaluate our method by comparing the light fields resulting from manual translation of the smartphone against those recorded with a constantly moving translation stage.
Chapter PDF
Similar content being viewed by others
References
Adelson, E.H., Bergen, J.R.: The plenoptic function and the elements of early vision. Computational Models of Visual Processing 1, 43–54 (1991)
Bolles, R.C., Baker, H.H., Marimont, D.H.: Epipolar-plane image analysis: An approach to determining structure from motion. International Journal of Computer Vision 1(1), 7–55 (1987)
Davis, A., Levoy, M., Durand, F.: Unstructured Light Fields. Comp. Graph. Forum, 31, 305–314 (2012)
Georgiev, T., Lumsdaine, A.: Focused plenoptic camera and rendering. Journal of Electronic Imaging 19, 021106 (2010)
Raytrix GmbH. Raytrix (2014). http://www.raytrix.de/
Google. Project tango (2014). https://www.google.com/atap/projecttango/
Gortler, S.J., Grzeszczuk, R., Szeliski, R., Cohen, M.F.: The Lumigraph. In: Siggraph (1996)
HTC. Htc one m8 (2014). http://www.htc.com/us/smartphones/htc-one-m8/
Lytro Inc., Lytro (2014). https://store.lytro.com/
Occipital Inc., Structure sensor (2014). http://structure.io/
Levoy, M.: Synthcam (2014). https://sites.google.com/site/marclevoy/
Levoy, M., Hanrahan, P.: Light field rendering. pp. 31–42 (1996)
Liang, C.-K., Lin, T.-H., Wong, B.-Y., Liu, C., Chen, H.: Programmable Aperture Photography: Multiplexed Light Field Acquisition 27(3), 1–10 (2008)
Lumsdaine, A.. Georgiev, T.: The Focused Plenoptic Camera. In: Proc. IEEE Int. Conference on Computational Photography, pp. 1–8 (2009)
McMillan, L., Bishop, G.: Plenoptic modeling: An image-based rendering system. pp. 39–46 (1995)
Ng, R.: Digital Light Field Photography. PhD thesis, Stanford University (2006). Note: thesis led to commercial light field camera, see also http://www.lytro.com
Ng, R., Levoy, M., Brédif, M., Duval, G., Horowitz, M., Hanrahan, P.: Light field photography with a hand-held plenoptic camera. Technical Report CSTR 2005–02, Stanford University (2005)
Perwass, C., Wietzke, L.: The Next Generation of Photography (2010). http://www.raytrix.de
Snavely, N., Seitz, S., Szeliski, R.: Photo Tourism: Exploring image collections in 3D (2006). http://phototour.cs.washington.edu/bundler/
Taguchi, Y., Agrawal, A., Ramalingam, S., Veeraraghavan, A.: Axial Light Fields for Curved Mirrors: Reflect your Perspective, Widen your View (2010)
Veeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A., Tumblin, J.: Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocussing 26(3), 1–69 (2007)
Venkataraman, K., Lelescu, D., Duparré, J., McMahon, A., Molina, G., Chatterjee, P., Mullis, R., Nayar, S.: Picam: an ultra-thin high performance monolithic camera array. ACM Transactions on Graphics (TOG) 32(6), 166 (2013). http://www.pelicanimaging.com/technology/
Vogiatzis, G., Hernández, C.: Video-based, real-time multi-view stereo. Image and Vision Computing 29(7), 434–441 (2011)
Wanner, S., Goldluecke, B.: Variational Light Field Analysis for Disparity Estimation and Super-Resolution (2013)
Wilburn, B., Joshi, N., Vaish, V., Talvala, E.-V., Antunez, E., Barth, A., Adams, A., Horowitz, M., Levoy, M.: High performance imaging using large camera arrays. ACM Transactions on Graphics 24, 765–776 (2005)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Krolla, B., Diebold, M., Stricker, D. (2015). Light Field from Smartphone-Based Dual Video. In: Agapito, L., Bronstein, M., Rother, C. (eds) Computer Vision - ECCV 2014 Workshops. ECCV 2014. Lecture Notes in Computer Science(), vol 8926. Springer, Cham. https://doi.org/10.1007/978-3-319-16181-5_46
Download citation
DOI: https://doi.org/10.1007/978-3-319-16181-5_46
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16180-8
Online ISBN: 978-3-319-16181-5
eBook Packages: Computer ScienceComputer Science (R0)