Skip to main content
SpringerLink
Log in

Spatio-angular consistent editing framework for 4D light field images

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper presents a practical framework for various light field editing algorithms, such as segmentation, sparse edit propagation, and inpainting. A novel framework is introduced with its user interface to perform the light field editing algorithms. Unlike single-image algorithms, the coherence between light field subaperture images is fully considered. Instead of processing all light field subaperture images independently, the proposed framework performs editing in the cluster image domain. The edit result in the cluster image is propagated back to each light field subaperture image using 2D-to-4D light field edit propagation. Experimental results on test images captured by a Lytro off-the-shelf light field camera confirm that the proposed method provides robust and consistent results of edited light field subaperture images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. An X, Pellacini F (2008) Appprop: all-pairs appearance-space edit propagation. ACM Trans Graph 27(3):40:1–40:9

    Article  Google Scholar 

  2. Ao H, Zhang Y, Jarabo A, Masia B, Liu Y, Gutierrez D, Dai Q (2015) Light field editing based on reparameterization. In: Proceedings of the 16th pacific-rim conference on multimedia, pp 601–610

  3. Bie X, Huang H, Wang W (2011) Real time edit propagation by efficient sampling. Comput Graphics Forum 30(7):2041–2048

    Article  Google Scholar 

  4. Bok Y, Jeon HG, Kweon IS (2014) Geometric calibration of micro-lens-based light-field cameras using line features. In: Proceedings of the european conference on computer vision (ECCV), pp 47–61

  5. Chen C, Lin H, Yu Z, Kang SB, Yu J (2014) Light field stereo matching using bilateral statistics of surface cameras. In: Proceedings of IEEE computer vision and pattern recognition, pp 1518–1525

  6. Chen X, Zou D, Zhao Q, Tan P (2012) Manifold preserving edit propagation. ACM Trans Graph 31(6):132:1–132:7

    Google Scholar 

  7. Cho D, Kim S, Tai YW (2014) Consistent matting for light field images. In: Proceedings of the european conference on computer vision (ECCV), pp 90–104

  8. Cho D, Lee M, Kim S, Tai YW (2013) Modeling the calibration pipeline of the lytro camera for high quality light-field image reconstruction. In: Proceedings of IEEE international conference on computer vision, pp 3280–3287

  9. Criminisi A, Perez P, Toyama K (2004) Region filling and object removal by exemplar-based inpainting. IEEE Trans Image Process 13(9):1200–1212

    Article  Google Scholar 

  10. Criminisi A, Sharp T, Rother C, P’erez P (2010) Geodesic image and video editing. ACM Trans Graph 29(5):134:1–134:15

    Article  Google Scholar 

  11. Dansereau DG, Pizarro O, Williams SB (2013) Decoding, calibration and rectification for lenselet-based plenoptic cameras. In: Proceedings of IEEE computer vision and pattern recognition, pp 1027–1034

  12. Gastal ESL, Oliveira MM (2011) Domain transform for edge-aware image and video processing. ACM Trans Graph 30(4):69:1–69:11

    Article  Google Scholar 

  13. Gortler SJ, Grzeszczuk R, Szeliski R, Cohen MF (1996) The lumigraph. In: Proceedings of SIGGRAPH, pp 43–54

  14. Jarabo A, Masia B, Bousseau A, Pellacini F, Gutierrez D (2014) How do people edit light fields?. ACM Trans Graph 33(4)

  15. Jarabo A, Masia B, Gutierrez D (2011) Efficient propagation of light field edits. In: Proceedings of the fifth ibero-american symposium in computer graphics, pp 75–80

  16. Lang M, Wang O, Aydin T, Smolic A, Gross M (2012) Practical temporal consistency for image-based graphics applications. ACM Trans Graph 31(4):34:1–34:8

    Article  Google Scholar 

  17. Levin A, Lischinski D, Weiss Y (2004) Colorization using optimization. ACM Trans Graph 23(3):689–694

    Article  Google Scholar 

  18. Levin A, Lischinski D, Weiss Y (2008) A closed-form solution to natural image matting. IEEE Trans Pattern Anal Mach Intell 30(2):228–242

    Article  Google Scholar 

  19. Levoy M, Hanrahan P (1996) Light field rendering. In: Proceedings of SIGGRAPH, pp 31–42

  20. Li N, Ye J, Ji Y, Ling H, Yu J (2014) Saliency detection on light field. In: Proceedings of IEEE computer vision and pattern recognition, pp 2806–2813

  21. Li Y, Ju T, Hu SM (2010) Instant propagation of sparse edits on images and videos. Comput Graphics Forum 29(7):2049–2054

    Article  Google Scholar 

  22. Lischinski D, Farbman Z, Uyttendaele M, Szeliski R (2006) Interactive local adjusment of tonal values. ACM Trans Graph 25(3):646–653

    Article  Google Scholar 

  23. Lytro (2014) The Lytro camera. https://www.lytro.com

  24. Ng R, Levoy M, Bredif M, Duval G, Horowitz M, Hanrahan P (2005) Light field photography with a hand-held plenoptic camera. In: Stanford tech report CTSR 2005-02

  25. Raytrix (2013) 3D light field camera technology. www.raytrix.de

  26. Tang M, Gorelick L, Veksler O, Boykov Y (2013) Grabcut in one cut. In: Proceedings of IEEE international conference on computer vision, pp 1769–1776

  27. Tao M, Hadap S, Malik J, Ramamoorthi R (2013) Depth from combining defocus and correspondence using light-field cameras. In: Proceedings of IEEE international conference on computer vision, pp 673–680

  28. Wilburn B, Joshi N, Vaish V, Talvala E, Artunez E, Barth A, Adams A, Horowitz M, Levoy M (2005) High perofrmance imaging using large camera arrays. ACM Trans Graph 24(3):765–779

    Article  Google Scholar 

  29. Xu K, Li Y, Ju T, Hu SM, Liu TQ (2009) Efficient affinity-based edit propagation using K-D tree. ACM Trans Graph 28(5):118:1–118:6

    Google Scholar 

Download references

Acknowledgments

This work was supported by Inha University Research Grant.

Author information

Authors and Affiliations

  1. Department of Information and Communication Engineering, Inha University, Incheon, South Korea

    Williem, Ki Won Shon & In Kyu Park

Authors
  1. Williem
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ki Won Shon
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. In Kyu Park
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to In Kyu Park.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Williem, Shon, K.W. & Park, I.K. Spatio-angular consistent editing framework for 4D light field images. Multimed Tools Appl 75, 16615–16631 (2016). https://doi.org/10.1007/s11042-016-3754-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3754-y

Keywords

Search

Navigation