MobiMedia 2011: Mobile Multimedia Communications pp 1-15 | Cite as
Tackling the Sheer Scale of Subjective QoE
Conference paper
Abstract
Maximum Likelihood Difference Scaling (MLDS) used as a method for subjective assessment of video quality alleviates the inconveniencies associated with high variation and biases common in rating methods. However, the number of tests in a MLDS study rises fairly quickly with the number of samples that we want to test. This makes the MLDS studies not scalable for the diverse video delivery environments commonly met in pervasive media networks. To tackle this issue we have developed an active learning approach that decreases the number of MLDS tests and improves the scalability of this method.
Keywords
Maximum Likelihood Difference Scaling adaptive MLDS Video Quality Assessment Quality of Experience QoEPreview
Unable to display preview. Download preview PDF.
References
- 1.Watson, A.B.: Proposal: Measurement of a JND scale for video quality. IEEE G-2.1. 6 Subcommittee on Video Compression Measurements (2000)Google Scholar
- 2.Wang, Z., Simoncelli, E.P., Bovik, A.C.: Multiscale structural similarity for image quality assessment. In: Thirty-Seventh Asilomar Conference on Record of the Signals, Systems and Computers, vol. 2, pp. 1398–1402 (2003)Google Scholar
- 3.Hekstra, A.P., et al.: PVQM-A perceptual video quality measure. Signal Processing: Image Communication 17(10), 781–798 (2002)Google Scholar
- 4.Seshadrinathan, K., Bovik, A.C.: Motion-based perceptual quality assessment of video. In: Proc. SPIE-Human Vision and Electronic Imaging (2009)Google Scholar
- 5.Gunawan, I.P., Ghanbari, M.: Efficient reduced-reference video quality meter. IEEE Transactions on Broadcasting 54(3), 669–679 (2008)CrossRefGoogle Scholar
- 6.Winkler, S., Mohandas, P.: The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics. IEEE Transactions on Broadcasting 54(3), 660–668 (2008)CrossRefGoogle Scholar
- 7.Kalpana Seshadrinathan, A., Rajiv Soundararajan, B., Alan, C.B.B., Lawrence, K.C.B.: A Subjective Study to Evaluate Video Quality Assessment AlgorithmsGoogle Scholar
- 8.Krantz, D.H., Luce, R.D., Suppes, P., Tversky, A.: Foundations of measurement, vol. 1: Additive and polynomial representations. Academic, New York (1971)MATHGoogle Scholar
- 9.Shepard, R.N.: On the status of’direct’psychophysical measurement. Minnesota Studies in the Philosophy of Science 9, 441–490Google Scholar
- 10.Shepard, R.N.: Psychological relations and psychophysical scales: on the status of direct. Journal of Mathematical Psychology 24(1), 21–57 (1981)MathSciNetCrossRefMATHGoogle Scholar
- 11.Ehrenstein, W.H., Ehrenstein, A.: Psychophysical methods. Modern Techniques in Neuroscience Research, 1211–1241 (1999)Google Scholar
- 12.Knoblauch, K., Maloney, L.T.: MLDS: Maximum likelihood difference scaling in R. Journal of Statistical Software 25(2), 1–26 (2008)CrossRefGoogle Scholar
- 13.Green, D.M., Swets, J.A.: Signal detection theory and psychophysics (1966)Google Scholar
- 14.Menkovski, V., Exarchakos, G., Liotta, A.: The value of relative quality in video delivery. Eindhoven University of Technology, Eindhoven (2011)Google Scholar
- 15.Charrier, C., Maloney, L.T., Cherifi, H., Knoblauch, K.: Maximum likelihood difference scaling of image quality in compression-degraded images. Journal of the Optical Society of America A 24(11), 3418–3426 (2007)CrossRefGoogle Scholar
Copyright information
© ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering 2012