Abstract
The current depth up-sampling cannot effectively using the pixel correlation and the edge structure between depth map and color map. In this paper, we proposes a new depth up-sampling method based on the local edge structure. Firstly, the non-robust pixel refinement in the low resolution (LR) depth image is obtained from the LR sobel-based edge map. Then, the structural consistency judgment within the depth map and the color map and the pixels classification is implemented with the guidance of the gradient matrix of the high resolution (HR) color image. Finally, according to the influence between pixels and spatial location constraints, the depth map is refined by the effective depth. Extensive experiments demonstrate that the proposed method outperforms conventional interpolation algorithms and some other edge-based depth up-sampling methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kopf, J., Cohen, M., Lischinski, D., Uyttendaele, M.: Joint bilateral upsampling. In: ACM Transactions on Graphics (ToG), vol. 26, no. 3, pp. 96–100. ACM (2007)
Ren, Y., Liu, J., Yuan, H., et al.: Depth up-sampling via pixel-classifying and joint bilateral filtering. KSII Trans. Internet Inf. Syst. 12(7) (2018)
Liu, M.-Y., Tuzel, O., Taguchi, Y.: Joint geodesic upsampling of depth images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 169–176 (2013)
Qiao, Y., Jiao, L., Yang, S., et al.: A novel segmentation based depth map up-sampling. IEEE Trans. Multimed. 21(1), 1–14 (2018)
Ren, Y., Liu, J., Yuan, H., et al.: Edge-guided with gradient-assisted depth up-sampling. Electron. Lett. 53(21), 1400–1402 (2017)
Jung, C., Joo, S., Ji, S.M.: Depth map upsampling with image decomposition. Electron. Lett. 51(22), 1782–1784 (2015)
Ferstl, D., Reinbacher, C., Ranftl, R., Ruether, M., Bischof, H.: Image guided depth upsampling using anisotropic total generalized variation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 993–1000 (2013)
Middlebury Datasets (2013). http://vision.middlebury.edu/stereo/data
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wang, C. et al. (2023). Local Edge Structure Guided Depth Up-Sampling. In: Sun, J., Wang, Y., Huo, M., Xu, L. (eds) Signal and Information Processing, Networking and Computers. Lecture Notes in Electrical Engineering, vol 917. Springer, Singapore. https://doi.org/10.1007/978-981-19-3387-5_133
Download citation
DOI: https://doi.org/10.1007/978-981-19-3387-5_133
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-19-3386-8
Online ISBN: 978-981-19-3387-5
eBook Packages: EngineeringEngineering (R0)