Skip to main content
SpringerLink
Log in

Depth Map Boundary Filter for Enhanced View Synthesis in 3D Video

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

In 3D video systems, view synthesis is performed at the receiver end using decoded texture and depth videos. Due to errors and noise, boundary pixels at coded depth data exhibit inaccuracy, which affects the rendering quality. In this paper, we propose a boundary refinement filter for coded depth data. Initially, we estimate the boundary region based on gradient magnitudes, using its standard deviation as a threshold. Consecutively, we replace the depth value at the boundary region with a weighted average by means of the proposed filter. Three weights are calculated in this process: depth similarity, distance, and boundary direction. Experiment results demonstrate that the proposed filter increases the PSNR of synthesized images. The improvements are confirmed subjectively as well. Hence, the quality of synthesized images is enhanced, aided by the proposed depth map filter.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11

Similar content being viewed by others

References

  1. Smolic, A., Muller, K., Merkle, P., Fehn, C., Kauff, P., Eisert, P., & Wiegand, T. (2006). 3D video and free viewpoint video - technologies, applications and MPEG standards. In Proc. IEEE International Conference on Multimedia and Expo (pp. 2161–2164).

  2. Fehn, C. (2004). Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. In Proc. Electronic Imaging (pp. 93–104).

  3. Mori, Y., Fukushima, N., Yendo, T., Fujii, T., & Tanimoto, M. (2009). View generation with 3D warping using depth information for FTV. Signal Processing: Image Communication, 24, 65–72.

    Google Scholar 

  4. Kim, W. S., Ortega, A., Lai, P., Tian, D., & Gomila, C. (2009). Depth map distortion analysis for view rendering and depth coding. In Proc. IEEE International Conference on Image Processing (pp. 721–724).

  5. Tomasi, C., & Manduchi, R. (1998). Bilateral filtering for gray and color images. In Proc. of IEEE International Conference on Computer Vision (pp. 839–846).

  6. Oh, K. J., Vetro, A., & Ho, Y. S. (2011). Depth coding using a boundary reconstruction filter for 3-D video systems. IEEE Transactions on Circuits and Systems for Video Technology., 21(3), 350–359.

    Article  Google Scholar 

  7. Dorea, C., & de Queioriz, R. L. (2011). Depth map reconstruction using color-based region merging. In Proc. IEEE International Conference on Image Processing (pp. 1977–1980).

  8. Merkle, P., Morvan, Y., Smolic, A., Muller, K., de With, P. H. N., & Wiegand, T. (2008). The effect of depth compression on multiveiew rendering quality. In Proc. of 3DTV Conference (pp. 245–248).

  9. 3DV-ATM 13.0, http://mpeg3dv.research.nokia.com/svn/mpeg3dv/tags/3DV-ATMv13.0.

  10. VSRS-1D-Fast, https://hevc.hhi.fraunhofer.de/svn/svn_3DVCSoftware/tags/HTM-13.0.

  11. Rusanovskyy, D., Muller, K., & Vetro, A. (2013). Common test conditions of 3DV core experiments. ITU-T/ISO/IEC JCT3V, C1100.

Download references

Acknowledgments

This research was supported by the‘Cross-Ministry Giga KOREA Project’ of the Ministry of Science, ICT and Future Planning, Republic of Korea(ROK). [GK16C0100, Development of Interactive and Realistic Massive Giga-Content Technology].

Author information

Authors and Affiliations

  1. Gwangju Institute of Science and Technology (GIST), 123 Cheomdangwagi-ro, Buk-gu, Gwangju, 61005, Republic of Korea

    Yunseok Song & Yo-Sung Ho

Authors
  1. Yunseok Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yo-Sung Ho
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yo-Sung Ho.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Song, Y., Ho, YS. Depth Map Boundary Filter for Enhanced View Synthesis in 3D Video. J Sign Process Syst 88, 323–331 (2017). https://doi.org/10.1007/s11265-016-1158-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-016-1158-x

Keywords

Search

Navigation