Multimedia Tools and Applications

, Volume 77, Issue 7, pp 7909–7927 | Cite as

Analysis of maximum tolerant depth distortion in view synthesis

Article
  • 93 Downloads

Abstract

In view synthesis, pixels in an original view are warped into a virtual view with depth-image-based rendering (DIBR). During the procedure of DIBR, distortions in depth map may lead to geometric errors in the synthesized view which will induce quality degradation of synthesized view. Therefore, how to efficiently preserve the fidelity of depth information is extremely important. In this paper, we explore and develop a maximum tolerable depth distortion (MTDD) model to examine the allowable depth distortion which will not introduce any texture distortion for a rendered virtual view and accordingly develop. Experimental results show that a virtual view can be synthesized without introducing any geometric changes if depth distortions follow the MTDD specified thresholds.

Keywords

Depth-image-based rendering (DIBR) Multi-view plus depth (MVD) View synthesis distortion Geometry distortion 

Notes

Acknowledgements

This work is supported by the National Natural Science Foundation of China under Grants 61471262, 61520106002 and 61601261, and by Ph.D. Programs Foundation of Ministry of Education of China under Grants 20110032110029 and 20130032110010, Doctoral Fund of Natural Science Foundation of Shandong Province under Grants 2016ZRB01AIU and a Smart Future Fellowship sponsored by the Queensland Government of Commonwealth Australia.

References

  1. 1.
    Daribo I, Tillier C, Pesquet-Popescu B (2008) Adaptive wavelet coding of the depth map for stereoscopic view synthesis. In: Proc. IEEE 10th Workshop MSP, pp 413–417Google Scholar
  2. 2.
    Fang L, Cheung NM, Tian D, Vetro A, Sun HF, Au OC (2014) An analytical model for synthesis distortion estimation in 3D video. J IEEE Trans Image Process 23(1):185–199MathSciNetCrossRefMATHGoogle Scholar
  3. 3.
    Fang L, Xiang YJ, Cheung NM, Wu F (2016) Estimation of virtual view synthesis distortion toward virtual view position. J IEEE Trans Image Process 25(5):1961–1976MathSciNetCrossRefGoogle Scholar
  4. 4.
    Federica B, Emilie B, Marco C, Patrick L, Simone P (2015) Objective image quality assessment of 3D synthesized views. J Signal Proc image Com 30(2015):78–88Google Scholar
  5. 5.
    Hannuksela M, Rusanovskyy D, Su W, Chen R, Li P, Aflaki P, Lan D, Joachimiak M, Li H, Gabbouj M (2013) Multi-view-video-plus-depth coding based on the advanced video coding standard. J IEEE Trans Image Proc 22(9):3449–3458CrossRefGoogle Scholar
  6. 6.
    Lei J, Li S, Zhu C, Sun M, Hou C (2015) Depth coding based on depth-texture motion and structure similarities. J IEEE Trans Circuits Syst Video Technol 25(2):275–286CrossRefGoogle Scholar
  7. 7.
    Liu YW, Huang QM, Ma SW, Zhao DB, Gao W (2009) Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model. J Sign Process Image Communic 24(8):666–681CrossRefGoogle Scholar
  8. 8.
    Loghman M, Kim J (2015) Segmentation-based view synthesis for multi-view video plus depth. J Multimedia Tools Appl 74(5):1611–1625CrossRefGoogle Scholar
  9. 9.
    Mateusz G, Krzysztof W, Marek D (2008) View synthesis software and assessment of its performance. ISO/IEC JTC1/SC29/WG11 MPEG/M15672Google Scholar
  10. 10.
    McMillan L Jr (1997) An image-based approach to three-dimensional computer graphics. Ph.D. dissertation, University of North Carolina at Chapel Hill, Chapel Hill, NC Natural Science Foundation of Shandong ProvinceGoogle Scholar
  11. 11.
    Merkle P, Smolic A, Mller K, Wiegand T (2007) Multi-view video plus depth representation and coding. In: Proc. IEEE Int. Conf. Image Process. (ICIP), I-201CI-204Google Scholar
  12. 12.
    Merkle P, Jaehwan J, Smolic A, Farin K, Muller P (2009) The effects of multiview depthvideo compression on multiview rendering. J Signal Proc Image Com 24(2009):73–88CrossRefGoogle Scholar
  13. 13.
    Sanchez A, Shen G, Ortega A (2009) Edge-preserving depth-map coding using tree-based wavelets. In: Proc. 43rd Asilomar Conf. Signals, Syst. Proc. IEEE 10th Workshop MSP, pp 578–582Google Scholar
  14. 14.
    Shao F, Lin WS, Jiang GY, Yu M, Dai QH (2014) Depth map coding for view synthesis based on distortion analyses. J IEEE Journ Emerg Select Top Circuits Syst 4(1):106–117CrossRefGoogle Scholar
  15. 15.
    Xu X, Po L, Ng K, Feng L, Cheung C, Cheung C (2013) Depth map misalignment correction and dilation for DIBR view synthesis. J Signal Proc Image Com 28(9):1023–1045CrossRefGoogle Scholar
  16. 16.
    Yuan H, Kwong S, Liu J, Sun J (2014) A novel distortion model and Lagrangian multiplier for depth maps coding. J IEEE Trans Circuits Syst Video Technol 24(3):443–451CrossRefGoogle Scholar
  17. 17.
    Zhang QW, An P, Zhang Y, Zhang ZY (2011) Efficient rendering distortion estimation for depth map compression. In: Proc. IEEE 18th ICIP, pp 1105–1108Google Scholar
  18. 18.
    Zhang Y, Kwong S, Hu S, Jay Kuo C-C (2014) Efficient Multiview depth coding optimization based on allowable depth distortion in view synthesis. IEEE Trans Image Process 23(11):4879–4892MathSciNetCrossRefMATHGoogle Scholar
  19. 19.
    Zhang Y, Kwong S, Hu SD, Jay Kuo CC (2014) Efficient Multiview depth coding optimization based on allowable depth distortion in view synthesis. J IEEE Trans Image Process 23(11):4879–4892MathSciNetCrossRefMATHGoogle Scholar
  20. 20.
    Zhao Y, Zhu C, Chen Z, Yu L (2011) Depth no-synthesis-error model for view synthesis in 3-D video. J IEEE Trans Image Proc 20(8):2221–2228MathSciNetCrossRefMATHGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2017

Authors and Affiliations

  1. 1.School of softwareQufu Normal UniversityJiningChina
  2. 2.School of Electronic Information EngineeringTianjin UniversityTianjinChina

Personalised recommendations