Abstract
Bokeh effect is an artistic effect in photography, which is the out-of-focus blur caused by the camera lens, typically, professional cameras with wide aperture lenses are necessary to obtain the Bokeh effect. In this paper, we propose a computational method to simulate the Bokeh effect with the RGBD data captured by Kinect. The proposed method first refines the depth map by modeling it as an optimization problem with the guidance of the corresponding RGB image; the size of the filter kernel is calculated from the refined depth map afterwards, finally, the RGB image with Bokeh effect is computed by filtering with the varying-sized and varying-shaped kernels. We have conducted experiment on 4 sets of data, and the experiment result suggests that the proposed method is optimistic in computing natural Bokeh effect.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Levin, A., Lischinski, D., Weiss, Y.: Colorization using optimization. In: ACM SIGGRAPH, pp. 689–694. ACM (2004)
Garro, V., Zanuttigh, P., Cortelazzo, G.M.: A new super resolution technique for range data (2010)
Kopf, J., Cohen, M.F., Lischinski, D.: Joint bilateral upsampling. ACM Trans. Graph. (TOG) 26(6), 96 (2007)
Matsuo, T., Fukushima, N., Ishibashi, Y.: Weighted joint bilateral filter with slope depth compensation filter for depth map refinement. In: International Conference on Computer Vision Theory and Applications (2015)
Lo, K.H., Wang, Y.F., Hua, K.L.: Edge-preserving depth map upsampling by joint trilateral filter. IEEE Trans. Cybern. 48(1), 371–384 (2018)
Zhang, S., Zhong, W., Ye, L., Zhang, Q.: A modified joint trilateral filter for depth image super resolution. In: Yang, X., Zhai, G. (eds.) IFTC 2016. CCIS, vol. 685, pp. 53–62. Springer, Singapore (2017). https://doi.org/10.1007/978-981-10-4211-9_6
Liu, M.Y., Tuzel, O., Taguchi, Y.: Joint geodesic upsampling of depth images. In: Computer Vision and Pattern Recognition, pp. 169–176 (2013)
He, K., Sun, J., Tang, X.: Guided image filtering. IEEE Trans. Pattern Anal. Mach. Intell. 35(6), 1397–1409 (2013)
Ho, Y.S., Lee, S.B.: Joint multilateral filtering for stereo image generation using depth camera (2013)
Yang, J., Ye, X., Li, K.: Color-guided depth recovery from RGB-D data using an adaptive autoregressive model. IEEE Trans. Image Process. 23(8), 3443–3458 (2014)
Ma, Z., He, K., Wei, Y.: Constant time weighted median filtering for stereo matching and beyond. In: IEEE International Conference on Computer Vision, pp. 49–56 (2014)
Krivanek, J., Zara, J., Bouatouch, K.: Fast depth of field rendering with surface splatting. In: Computer Graphics International, pp. 196–201 (2003)
Lee, S., Kim, G.J., Choi, S.: Real-time depth-of-field rendering using point splatting on per-pixel layers. Comput. Graph. Forum 27(7), 1955–1962 (2008)
Cook, R.L.: Stochastic sampling in computer graphics. ACM Trans. Graph. 5(1), 51–72 (1986)
Buhler, J., Wexler, D.: A phenomenological model for Bokeh rendering. In: Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH Abstracts and Applications, p. 142 (2002)
Justin, H., Thorsten, S., Greg, C., et al.: Fast summed-area table generation and its applications. Comput. Graph. Forum 24(3), 547–555 (2010)
Kraus, M.: Using opaque image blur for real-time depth-of-field rendering. In: GRAPP 2011 - Proceedings of the International Conference on Computer Graphics Theory and Application, pp. 153–159 (2011)
Rokita, P.: Fast generation of depth of field effects in computer graphics. Comput. Graph. 17(5), 593–595 (1993)
Zhou, T., Chen, J.X., Pullen, M.: Accurate depth of field simulation in real time. In: Computer Graphics Forum, pp. 15–23 (2007)
Gonzalez, R.C., Woods, R.E.: Digital Image Processing, vol. 28(4), pp. 484–486. Prentice Hall International (1977)
Acknowledgment
This work was supported by National Natural Science Foundation of China (Grant No. 61402205), China Postdoctoral Science Foundation (Grant No. 2015-M571688), University Science Research Project of Jiangsu Province (Grant No. 16KJB520008), Natural Science Foundation of Jiangsu Province (Grant No. BK20170558), Postgraduate Research & Practice Innovation Program of Jiangsu Province (Grant No. SJCX17_0575).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Yang, Y., Bian, H., Peng, Y., Shen, X., Song, H. (2018). Simulating Bokeh Effect with Kinect. In: Hong, R., Cheng, WH., Yamasaki, T., Wang, M., Ngo, CW. (eds) Advances in Multimedia Information Processing – PCM 2018. PCM 2018. Lecture Notes in Computer Science(), vol 11164. Springer, Cham. https://doi.org/10.1007/978-3-030-00776-8_67
Download citation
DOI: https://doi.org/10.1007/978-3-030-00776-8_67
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-00775-1
Online ISBN: 978-3-030-00776-8
eBook Packages: Computer ScienceComputer Science (R0)