Advertisement

Multimedia Systems

, Volume 25, Issue 6, pp 723–730 | Cite as

A novel depth perception prediction metric for advanced multimedia applications

  • Gokce Nur YilmazEmail author
Regular Paper
  • 40 Downloads

Abstract

Ubiquitous multimedia applications diffuse our everyday life activities which appreciate their significance about improving our experiences. Therefore, proliferation of the multimedia applications enhancing these experiences needs critical attention of the researchers. Considering this motivation, to overcome the possible barrier of the proliferation of the 3D video-related multimedia applications providing enhanced quality of experience (QoE) to the end users, an objective metric is proposed in this study. The proposed metric tackles the depth perception prediction part reflecting the most important aspect of the 3D video QoE from the user point of view. Considering that the no reference metric type is the most effective one compared to its counterparts, the proposed metric is developed based on this type. In the light of the envision that human visual system-related cues have critical importance on developing accurate metrics, the focus of the proposed metric is directed on the association of the z-direction motion and stereopsis depth cues in the metric development. These cues are derived from the depth map contents having stressed significant depth levels. In addition, the analysis results of the conducted subjective experiments which are currently the “gold standards” for the reliable depth perception prediction are incorporated with the proposed metric. Considering the effective correlation coefficient and root mean square error performance assessment results taken using the proposed metric in comparison to the widely exploited quality assessment metrics in literature, it can be clearly stated that the development of the improved 3D video multimedia applications can be accelerated using it.

Keywords

3-Dimensional (3D) video Depth perception Quality of experience (QoE) Multimedia applications 

Notes

Acknowledgements

This work has been supported by the Scientific and Technological Research Council of Turkey, Project Number: 114E551.

References

  1. 1.
    Tian S., Zhang, L., Morin, L., Deforges, O.: A full-reference image quality assessment metric for 3D synthesized views. In: International Symposium on Electronic Imaging (2018)Google Scholar
  2. 2.
    Galkandage, C., Calic, J., Dogan, S., Guillemaut, J.-Y.: Stereoscopic video quality assessment using binocular energy. IEEE J. Sel. Top. Signal Process. 11, 102–112 (2017)CrossRefGoogle Scholar
  3. 3.
    Battisti, F., Bosc, E., Carli, M., Callet, P.L., Perugia, S.: Objective image quality assessment of 3D synthesized views. Signal Process. Image Commun. 30, 78–88 (2015)CrossRefGoogle Scholar
  4. 4.
    Le Callet, P., Möller, S., Perkis, A.: Qualinet white paper on definitions of quality of experience. Lausanne, Switzerland (2012)Google Scholar
  5. 5.
    Parametric Bit-stream based Quality Assessment of Progressive Download and Adaptive Audio-visual Streaming Services over Reliable Transport. ITU-T Recommendation P.1203 (2017)Google Scholar
  6. 6.
    Subjective Video Quality Assessment Methods for Multimedia Applications. ITU-T Recommendation P.910 (2008)Google Scholar
  7. 7.
    Rouse, D.M., Pepion, R., Le Callet, P., Hemami, S.S.: Tradeoffs in subjective testing methods for image and video quality assessment. In: Proceedings of the Human Vision and Electronic Imaging XV, USA (2010)Google Scholar
  8. 8.
    Bayrak, H., Nur Yilmaz, G.: A depth perception evaluation metric for immersive user experience towards 3D multimedia services. Multimedia Syst 25(3), 253–261 (2019)CrossRefGoogle Scholar
  9. 9.
    Nur, G., Akar, G.B.: An abstraction based reduced reference depth perception metric for 3D video. In: 19th IEEE International Conference on Image Processing (2012)Google Scholar
  10. 10.
    Nur Yilmaz, G.: A depth perception evaluation metric for immersive 3D video services. In: IEEE 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video, Copenhagen, Denmark (2017)Google Scholar
  11. 11.
    Hewage, C.T.E.R., Worrall, S.T., Dogan, S., Villette, S., Kondoz, A.M.: Quality evaluation of color plus depth map based 3D video. IEEE J. Sel. Top. Signal Process. 3(2), 304–318 (2009)CrossRefGoogle Scholar
  12. 12.
    Nur, G., Kodikara Arachchi, H., Dogan, S., Kondoz, A.M.: Advanced adaptation techniques for improved video perception. IEEE Trans. Circuit Syst. Video Technol. 22(2), 225–240 (2012)CrossRefGoogle Scholar
  13. 13.
    Cheda, D.: Monocular depth cues in computer vision applications. Electron. Lett. Comput. Vis. Image Anal. 13(2), 65–66 (2014)CrossRefGoogle Scholar
  14. 14.
    Westheimer, G.: Clinical evaluation of stereopsis. Vis. Res. 90, 38–40 (2013)CrossRefGoogle Scholar
  15. 15.
    Huynh-Thu, J.Q., Ghanbari, M.: Scope of validity of PSNR in image/video quality assessment. IET Electron. Lett. 44(13), 800–801 (2008)CrossRefGoogle Scholar
  16. 16.
    Wang, Z., Lu, L., Bovik, A.C.: Video quality assessment based on structural distortion measurement. Proc. Signal Process. Image Commu. 19(2), 121–132 (2004)CrossRefGoogle Scholar
  17. 17.
    Pinson, M.H., Wolf, S.: A new standardized method for objectively measuring video quality. IEEE Trans. Broadcast. 50(3), 312–322 (2004)CrossRefGoogle Scholar
  18. 18.
    Hekstraa, A.P., Beerendsa, J.G., Ledermannb, D., de Caluwec, F.E., Kohlerb, S., Koenend, R.H., Rihsb, S., Ehrsame, M., Schlaussb, D.: PVQM-A perceptual video quality measure. Signal Process. Image Commun. 17, 781–798 (2002)CrossRefGoogle Scholar
  19. 19.
    Joveluro, P., Malekmohamadi, H., Fernando, W.A.C., Kondoz, A.M.: Perceptual video quality metric for 3D video quality assessment. In: 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (2010)Google Scholar
  20. 20.
    De Silva, V., Nur, G., Ekmekcioglu, E., Kondoz, A.M.: QoE of 3D media delivery systems. In: Moustafa, H., Zeadally, S. (Eds.) Media Networks: Architectures, Applications, and Standards. CRC Press Taylor and Francis Group (2012)Google Scholar
  21. 21.
    Erofeev, M., Vatolin, D., Voronov, A., Fedorov, A.: Toward an objective stereo-video quality metric depth perception of textured areas. In: International Conference on 3D Imaging (2012)Google Scholar
  22. 22.
    Wolf, S., Pinson, M.H.: Low bandwidth reduced reference video quality monitoring system. In: First International Workshop on Video Processing and Quality Metrics for Consumer Electronics, Scottsdale, Arizona (2005)Google Scholar
  23. 23.
    Hewage, C.T.E.R., Martini, M.G.: Reduced-reference quality evaluation for compressed depth maps associated with colour plus depth 3D video. In: 17th IEEE international conference on image processing, Hong Kong (2010)Google Scholar
  24. 24.
    Martini, M.G., Villarini, B., Fiorucci, F.: A reduced-reference perceptual image and video quality metric based on edge preservation. EURASIP J. Adv. Signal Process. 1, 1–13 (2012)Google Scholar
  25. 25.
    Nur, G.: Cartoon effect and ambient illumination based depth perception assessment of 3D Video. World Acad Sci Eng Technol Int J Comput Electri. Autom. Control Inf. Eng. 7(7), 890–893 (2013)MathSciNetGoogle Scholar
  26. 26.
    Hibbard, P.B., Haines, A.E., Hornsey, R.L.: Magnitude, precision, and realism of depth perception in stereoscopic vision. Cognit. Res. Princ. Implic. 2(1), 25 (2017)CrossRefGoogle Scholar
  27. 27.
    Lebreton, P., Raake, A., Barkowsky, M., Callet, P.L.: Evaluating depth perception of 3D stereoscopic videos. IEEE J. Sel. Top. Signal Process. 6, 710–720 (2012)CrossRefGoogle Scholar
  28. 28.
    Kim, D., Min, D., Oh, J., Jeon, S., Sohn, K.: Depth map quality metric for three-dimensional video. In: SPIE Stereoscopic Displays and Applications, San Jose, CA, USA (2009)Google Scholar
  29. 29.
    Mittal, A., Moorthy, A.K., Ghosh, J., Bovik, A.C.: Algorithm assessment of 3D quality of experience for images and videos. In: IEEE Digital Signal Processing Workshop (2011)Google Scholar
  30. 30.
    Solh, M., AlRegib, G.: A no-reference quality measure for DIBR-based 3D videos. In: IEEE International Workshop on Hot Topics in 3D, Barcelona, Spain (2011)Google Scholar
  31. 31.
    Nur Yilmaz, G.: A no reference depth perception assessment metric for 3D video. Multimedia Tools Appl. 74(17), 6937–6950 (2015)CrossRefGoogle Scholar
  32. 32.
    Nur Yilmaz, G.: Depth perception prediction of 3D video QoE for future internet services. In: 32nd International Conference on Information Networking. Chiang Mai, Thailand (2018)Google Scholar
  33. 33.
    JSVM 9.13.1. CVS Server [Online]. Available Telnet: garcon.ient.rwth aachen.de:/cvs/jvtGoogle Scholar
  34. 34.
    Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: IEEE International Conference on Computer Vision. Bombay, India (1998)Google Scholar
  35. 35.
    Xuan, G., Zhang, W., Chai, P.: EM Algorithms of Gaussian Mixture Model and Hidden Markov Model. In: International Conference on Image Processing. Thessaloniki, Greece (2001)Google Scholar
  36. 36.
    Do, C.B., Batzoglou, S.: What is the expectation maximization algorithm? Nat. Biotechnol. 26(8), 897–899 (2008)CrossRefGoogle Scholar
  37. 37.
    Methodology for the Subjective Assessment of the Quality of Television Pictures. ITU-T Recommendation BT.500 (2012)Google Scholar
  38. 38.

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Electrical and Electronics Engineering DepartmentKirikkale UniversityKirikkaleTurkey

Personalised recommendations