Abstract
Depth image can be easily obtained by RGB-D sensors such as Microsoft Kinect, but the low resolution and poor quality of the obtained results pose a notable challenge on practical applications. To solve this problem, this paper proposes an algorithm of modified joint trilateral filter for depth image super resolution. In the proposed method, considering less texture contained in depth image, the high resolution (HR) edge is first extracted from its corresponding HR color image and then introduced to guide the modified joint trilateral filter primarily. Meanwhile, the intensity information is taken into account to avoid the fake edges in the HR edge map. With the guidance of HR edge and intensity information, the HR depth image could be simply interpolated via the modified joint trilateral filter. The experimental results manifest that our approach could not only save the running time but also obtain better performance compared with the state-of-the-art methods.
This work is supported by the National Natural Science Foundation of China under Grant Nos. 61201236 and 61371191, and the Project of State Administration of Press, Publication, Radio, Film and Television under Grant No. 2015-53.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Hornacek, M., Rhemann, C., Gelautz, M., Rother, C.: Depth super resolution by rigid body self-similarity in 3D. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1123–1130 (2013)
Mac Aodha, O., Campbell, Neill, D.,F., Nair, A., Brostow, Gabriel, J.: Patch based synthesis for single depth image super-resolution. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7574, pp. 71–84. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33712-3_6
Li, J., Lu, Z.C., Zeng, G., Gan, R., Zha, H.B.: Similarity-aware patchwork assembly for depth image super-resolution. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 3374–3381 (2014)
Xie, J., Chou, C.C., Feris, R., Sun, M.T.: Single depth image super resolution and denoising via coupled dictionary learning with local constraints and shock filtering. In: Proceedings of IEEE International Conference on Multimedia and Expo, pp. 1–6 (2014)
Xie, J., Feris, R.S., Yu, S.S., Sun, M.T.: Joint super resolution and denoising from a single depth image. IEEE Trans. Multimedia 17(9), 1525–1537 (2015)
Xie, J., Ferisand, R.S., Sun, M.T.: Edge-guided single depth image super resolution. IEEE Trans. Image Process. 25(1), 428–438 (2016)
Kopf, J., Cohen, M.F., Lischinski, D.: Joint bilateral upsampling. ACM Trans. Graph. 26(3), 96 (2007)
Yang, Q., Yang, R., Davis, J.: Spatial-depth super resolution for range images. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)
Diebel, J., Thrun, S.: An application of Markov random fields to range sensing. In: Proceedings of Conference on Neural Information Processing Systems, pp. 291–298 (2005)
Park, J., Kim, H., Tai, Y.W., Brown, M.S., Kweon, I.: High quality depth map upsampling for 3D-TOF cameras. In: Proceedings of IEEE International Conference on Computer Vision, pp. 1623–1630 (2011)
Lu, J., Min, D., Pahwa, R.S.: A revisit to MRF-based depth map super-resolution and enhancement. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 985–988 (2011)
Daeyoung, K., Kuk-jin, Y.: High-quality depth map upsampling robust to edge of range sensors. In: Proceedings of IEEE International Conference on Image Processing, pp. 553–556 (2012)
Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)
Dong, C., Loy, C.C., He, K., Tang, X.: Learning a deep convolutional network for image super-resolution. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8692, pp. 184–199. Springer, Heidelberg (2014). doi:10.1007/978-3-319-10593-2_13
Huang, J.B., Singh, A., Ahuja, N.: Single image super-resolution from transformed self-exemplars. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 5197–5206 (2015)
Gilboa, G., Sochen, N., Zeevi, Y.Y.: Image enhancement and denoising by complex diffusion processes. IEEE Trans. Pattern Anal. Mach. Intell. 26(8), 1020–1036 (2004)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhang, S., Zhong, W., Ye, L., Zhang, Q. (2017). A Modified Joint Trilateral Filter for Depth Image Super Resolution. In: Yang, X., Zhai, G. (eds) Digital TV and Wireless Multimedia Communication. IFTC 2016. Communications in Computer and Information Science, vol 685. Springer, Singapore. https://doi.org/10.1007/978-981-10-4211-9_6
Download citation
DOI: https://doi.org/10.1007/978-981-10-4211-9_6
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-4210-2
Online ISBN: 978-981-10-4211-9
eBook Packages: Computer ScienceComputer Science (R0)