Abstract
The MVC+D standard specifies coding of Multiview Video plus Depth (MVD) data for enabling advanced 3D video applications. MVC+D defines that all views are coded with H.264/MVC encoder at equal spatial resolution. To improve compression efficiency it is possible to use mixed resolution coding in which part of texture views are coded at reduced spatial resolution. In this paper we evaluate the performance of Depth-Based Super Resolution (DBSR) on compressed mixed resolution MVD data. Experimental results show that for sequences with accurate depth data the objective coding performance metric increases. Even though some sequences, with poor depth quality, show slight decrease in coding performance with respect to objective metric, subjective evaluation shows that perceived quality of DBSR method is equal to symmetric resolution case. We also show that depth re-projection consistency check step of the DBSR can be changed to simpler consistency check method. In this way the DBSR computational complexity is reduced by 26 % with 0.2 % dBR average bitrate reduction for coded views and 0.1 % average bitrate increase for synthesized views. We show that proposed scheme outperforms the anchor MVC+D coding scheme by 7.2 % of dBR on average for total coded bitrate and by 10.9 % of dBR on average for synthesized views.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Common test conditions of 3DV core experiments. ISO/IEC JTC1/SC29/WG11 JCT3V-E1100 (2013)
ITU-R Rec. BT.500-11, Methodology for the subjective assessment of the quality of television pictures (2002)
ITU-T and ISO/IEC JTC 1: Advanced video coding for generic audiovisual services. ITU-T Recommendation H.264 and ISO/IEC 14496–10 (MPEG-4 AVC) (2013)
JSVM Software. http://ip.hhi.de/imagecom_G1/savce/downloads/SVCReferenceSoftware.htm
MPEG Video and Requirement Groups: Call for Proposals on 3D Video Coding Technology. MPEG output document N12036, Geneva, Switzerland (2011)
Test model for AVC based 3D video coding, ISO/IEC JTC1/SC29/WG11 MPEG2012/N12558 (2012)
Aflaki, P., Hannuksela, M.M., Gabbouj, M.: Subjective quality assessment of asymmetric stereoscopic 3D video. J. Signal Image Video Process. 9(2), 331–345 (2013)
Aflaki, P., Su, W., Joachimiak, M., Rusanovskyy, D., Hannuksela, M.M., Gabbouj, M.: Coding of mixed-resolution multiview video in 3D video application. In: IEEE International Conference on Image Processing (ICIP) (2013)
Asher, H.: Suppression theory of binocular vision. Br. J. Ophthalmol. 37(1), 37–49 (1953)
Bjontegaard, G.: Calculation of average PSNR differences between RD-Curves. ITU-T SG16 Q.6 document VCEG-M33 (2001)
Chen, J., Boyce, J., Ye, Y., Hannuksela, M.: Scalable HEVC (SHVC) Test Model 4 (SHM 4) ISO/IEC JTC1/SC29/WG11 MPEG2013/N13939 (2013)
Chen, Y., Hannuksela, M.M., Suzuki, T., Hattori, S.: Overview of the MVC+D 3D video coding standard. J. Vis. Commun. Image Represent. 25(4), 679–688 (2013)
Chen, Y., Wang, Y.K., Ugur, K., Hannuksela, M.M., Lainema, J., Gabbouj, M.: The emerging MVC standard for 3D video services. EURASIP J. Appl. Signal Process. 8 (2009)
Domanski, M., Grajek, T., Klimaszewski, K., Kurc, M., Stankiewicz, O., Stankowski, J., Wegner, K.: Poznan Multiview Video Test Sequences and Camera Parameters. ISO/IEC JTC1/SC29/WG11 MPEG 2009/M17050 (2009)
Dong, J., He, Y., Ye, Y.: Downsampling filters for anchor generation for scalable extensions of HEVC. ISO/IEC JTC1/SC29/WG11 MPEG2012/M23485 (2012)
Fehn, C.: Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV. In: Proceedings of the SPIE Conference on Stereoscopic Displays and Virtual Reality Systems XI, CA, vol. 5291, pp. 93–104 (2004)
Garcia, D.C., Dorea, C., Queiroz, R.L.: Super resolution for multiview images using depth information. IEEE Trans. Circuits Syst. Video Technol. 22(9), 1249–1256 (2012)
Hannuksela, M.M., Rusanovskyy, D., Su, W., Chen, L., Li, R., Aflaki, P., Lan, D., Joachimiak, M., Li, H., Gabbouj, M.: Multiview-video-plus-depth coding based on the advanced video coding standard. IEEE Trans. Image Process. 22(9), 3449–3458 (2013)
Joachimiak, M., Hannuksela, M.M., Gabbouj, M.: View synthesis quality mapping for depth-based super resolution on mixed resolution 3D video. In: 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON) (2014)
Kauff, P., Atzpadin, N., Fehn, C., Muller, M., Schreer, O., Smolic, A., Tanger, R.: Depth map creation and image-based rendering for advanced 3DTV services providing interoperability and scalability. EURASIP Int. J. Signal Process. 22(2), 217–234 (2007)
Perkins, M.G.: Data compression of stereopairs. IEEE Trans. Commun. 40(4), 684–696 (1992)
Sawhney, H.S., Guo, Y., Hanna, K., Kumar, R., Adkins, S., Zhou, S.: Hybrid stereo camera: an IBR approach for synthesis of very high resolution stereoscopic image sequences. In: Proceedings of the 28th Conference on Computer Graphics and Interactive Techniques, New York, pp. 451–460 (2001)
Schwarz, H., et al.: Description of 3D Video Technology Proposal by Fraunhofer HHI (MVC compatible). ISO/IEC JTC1/SC29/WG11 MPEG2011/M22569 (2011)
Tam, W.J.: Image and depth quality of asymmetrically coded stereoscopic video for 3D-TV. Joint Video Team document JVT-W094 (2007)
Wilcoxon, F.: Individual comparisons by ranking methods. Biometrics 1, 80–83 (1945)
Acknowledgement
Authors would like to thank professor Marek Domanski et al. for sharing the 3D video test sequences [14] and Maryam Homayouni for the help with subjective test arrangement.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Joachimiak, M., Aflaki, P., Hannuksela, M.M., Gabbouj, M. (2015). Evaluation of Depth-Based Super Resolution on Compressed Mixed Resolution 3D Video. In: Jawahar, C., Shan, S. (eds) Computer Vision - ACCV 2014 Workshops. ACCV 2014. Lecture Notes in Computer Science(), vol 9008. Springer, Cham. https://doi.org/10.1007/978-3-319-16628-5_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-16628-5_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16627-8
Online ISBN: 978-3-319-16628-5
eBook Packages: Computer ScienceComputer Science (R0)