Light Field Editing Based on Reparameterization
Edit propagation algorithms are a powerful tool for performing complex edits with a few coarse strokes. However, current methods fail when dealing with light fields, since these methods do not account for view-consistency and due to the large size of data that needs to be handled. In this work we propose a new scalable algorithm for light field edit propagation, based on reparametrizing the input light field so that the coherence in the angular domain of the edits is preserved. Then, we handle the large size and dimensionality of the light field by using a downsampling-upsampling approach, where the edits are propagated in a reduced version of the light field, and then upsampled to the original resolution. We demonstrate that our method improves angular consistency in several experimental results.
KeywordsLight field Edit propagation Reparameterization Clustering
The project is supported by the National key foundation for exploring scientific instrument No. 2013YQ140517 and partially supported by the National Natural Science Foundation of China under Grants 61170195, U1201255 & U1301257, the Spanish Ministry of Science and Technology (project LIGHTSLICE) and the BBVA Foundation. Diego Gutierrez is additionally supported by a Google Faculty Research Award. Belen Masia is partially supported by the Max Planck Center for Visual Computing and Communication.
- 2.Ao, H., Zhang, Y., Dai, Q.: Image colorization using hybrid domain transform. In: ICASSP, January 2015Google Scholar
- 3.Chen, B., Ofek, E., Shum, H.Y., Levoy, M.: Interactive deformation of light fields. In: Proceedings of the I3D 2005, pp. 139–146 (2005)Google Scholar
- 4.Chen, X., Zou, D., Li, J., Cao, X., Zhao, Q., Zhang, H.: Sparse dictionary learning for edit propagation of high-resolution images. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2854–2861. IEEE (2014)Google Scholar
- 5.Chen, X., Zou, D., Zhao, Q., Tan, P.: Manifold preserving edit propagation. ACM Trans. Graph. (TOG) 31(6), 132 (2012)Google Scholar
- 7.Jarabo, A., Masia, B., Gutierrez, D.: Efficient propagation of light field edits. In: Proceedings of the SIACG 2011 (2011)Google Scholar
- 10.Levoy, M., Hanrahan, P.: Light field rendering. In: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, pp. 31–42. ACM (1996)Google Scholar
- 11.Li, Y., Ju, T., Hu, S.M.: Instant propagation of sparse edits on images and videos. In: Computer Graphics Forum, vol. 29, pp. 2049–2054. Wiley Online Library (2010)Google Scholar
- 12.Masia, B., Jarabo, A., Gutierrez, D.: Favored workflows in light field editing. In: CGVCVIP (2014)Google Scholar
- 15.Xu, K., Li, Y., Ju, T., Hu, S.M., Liu, T.Q.: Efficient affinity-based edit propagation using kd tree. ACM Trans. Graph. (TOG) 28, 118 (2009). ACMGoogle Scholar
- 16.Xu, L., Yan, Q., Jia, J.: A sparse control model for image and video editing. ACM Trans. Graph. (TOG) 32(6), 197 (2013)Google Scholar
- 18.Zhang, Z., Wang, L., Guo, B., Shum, H.Y.: Feature-based light field morphing. ACM Trans. Graph. 21(3) (2002). http://doi.acm.org/10.1145/566654.566602