An Improvement for View Synthesis Optimization Algorithm

  • Chang Liu
  • Kebin JiaEmail author
  • Pengyu Liu
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 834)


View synthesis optimization (VSO) allows 3D video system to improve the quality of synthesized views (SVs). Based on the latest segment-based VSO scheme, we find that not all of the intra mode and skip interval are necessary to be considered. Therefore, in this paper, an early determination of intra mode and optimal skip interval based on VSO scheme in 3D-HEVC is presented. First, we discuss a measure to select the best intra mode. Then, we decide the optimal skip interval based on statistical analysis. Experimental results indicate that the proposed algorithm achieves a reduction of 21.711% with negligible loss in rate-distortion performance compared with the original 3D-HEVC encoder, and the encoding time has also reduced to 7.869% compared with the others.


VSO SVDC Intra mode Skip interval 3D-HEVC 



This work is supported by the Project for the National Natural Science Foundation of China (Grant No. 61672064), the Beijing Natural Science Foundation (Grant No. KZ201610005007), the China Postdoctoral Science Foundation (Grant No. 2015M580029), and the Beijing Postdoctoral Research Foundation (Grant No. 2015ZZ-23).


  1. 1.
    Sullivan, G.J., et al.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1649–1688 (2012)CrossRefGoogle Scholar
  2. 2.
    Sullivan, G.J., et al.: Standardized extensions of high efficiency video coding (HEVC). IEEE J. Sel. Top. Signal Process. 7(6), 1001–1016 (2013)CrossRefGoogle Scholar
  3. 3.
    Li, Z., et al.: A novel representation and compression method in layered depth video. In: Proceedings of the SPIE/COS Photonics Asia (2016)Google Scholar
  4. 4.
    Zhang, Q., Wu, Q., Wang, X.: Early skip mode decision for three-dimensional high efficiency video coding using spatial and interview correlations. J. Electron. Imaging 23(5), 053017 (2014)CrossRefGoogle Scholar
  5. 5.
    Guo, L., et al.: Hole-filling map-based coding unit size decision for dependent views in three-dimensional high-efficiency video coding. J. Electron. Imaging 25(3), 033020 (2016)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Dou, H., et al.: Segment-based view synthesis optimization scheme in 3D-HEVC. J. Vis. Commun. Image Represent. 42, 104–111 (2017)CrossRefGoogle Scholar
  7. 7.
    Yang, C., et al.: Virtual view distortion estimation for depth map coding. In: Proceedings of the Visual Communication and Image Processing (VCIP), pp. 1–4 (2015)Google Scholar
  8. 8.
    Zhang, Y., et al.: Efficient multiview depth coding optimization based on allowable depth distortion in view synthesis. IEEE Trans. Image Process. 23(11), 4879–4892 (2014)MathSciNetCrossRefGoogle Scholar
  9. 9.
    De Silva, D., Fernando, W., Arachchi, H.: A new mode selection technique for coding depth maps of 3D video. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 686–689 (2010)Google Scholar
  10. 10.
    Zheng, Z., et al.: Fine virtual view distortion estimation method for depth map coding. IEEE Signal Process. Lett. 1–1 (2017)Google Scholar
  11. 11.
    Yang, C., et al.: Depth map coding based on virtual quality. In: Proceedings of the IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP), pp. 1367–1371 (2016)Google Scholar
  12. 12.
    Gao, M., et al.: Estimation of end-to-end distortion of virtual for error-resilient depth map coding. In: Proceedings IEEE Processing International Conference on Image Processing, pp. 1816–1820 (2013)Google Scholar
  13. 13.
    Wang, L., Yu, L.: Rate-distortion optimization for depth map coding with distortion estimation of synthesized view. In: International Symposium on Proceedings of the Circuits and Systems (ISCAS), pp. 17–20 (2013)Google Scholar
  14. 14.
    Yang, M., et al.: A novel method of minimizing view synthesis distortion based on its non-monotonicity in 3D video. IEEE Trans. Image Process. 26(11), 5122–5137 (2017)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Yuan, H., Kwong, S., Liu, J., Sun, J.: A novel distortion model and lagrangian multiplier for depth maps coding. IEEE Trans. Circuits Syst. Video Technol. 24(3), 443–451 (2014)CrossRefGoogle Scholar
  16. 16.
    Ma, S.W., Wang, S.Q., Gao, W.: Low complexity adaptive view synthesis optimization in HEVC based 3D video coding. IEEE Trans. Multimed. 16(1), 266–271 (2014)CrossRefGoogle Scholar
  17. 17.
    Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Faculty of Information TechnologyBeijing University of TechnologyBeijingChina
  2. 2.Beijing Laboratory of Advanced Information NetworksBeijingChina
  3. 3.Beijing Advanced Innovation Center for Future Internet Technology, Beijing University of TechnologyBeijingChina
  4. 4.Beijing Key Laboratory of Computational Intelligence and Intelligent SystemBeijing University of TechnologyBeijingChina

Personalised recommendations