Evaluation of Audio Quality Requirements over Extended Periods of Time Using Long Duration Audiovisual Content
Using our novel methodology for quality evaluation of long duration multimedia content, the effect of the time dimension on quality ratings and user responses was investigated. We were particularly interested in checking how audio artifacts related to different compression rates influence participants’ reactions to quality changes over extended periods of time. By employing the mixed-effects ANOVA model we have revealed dependencies between time periods and a lack of such between the subjects. It turned out that participants’ quality expectations are rather constant throughout the entire duration of the clip, which also holds for subjects’ reaction time to quality degradations. Furthermore, it has been shown that the test persons were substantially more sensitive to quality changes when they were able to influence the quality themselves.
KeywordsSubjective audiovisual quality assessment audio quality quality of experience (QoE)
Unable to display preview. Download preview PDF.
- 1.Lodge, N.K., Wood, D.: Subjectively Optimizing Low Bit-Rate Television. In: Proceedings of the IEEE International Broadcasting Convention, IBC 1994, Amsterdam, pp. 333–339 (1994)Google Scholar
- 2.Aldridge, R., Davidoff, J., Ghanbari, M., Hands, D., Pearson, D.: Measurement of Scene-dependent Quality Variations in Digitally Coded Television Pictures. In: IEEE Proceedings Vision, Image and Signal Processing, vol. 142(3), pp. 149–154 (1995)Google Scholar
- 3.ITU-R Recommendation BT.500-7: Methodology for the Subjective Assessment of the Quality of Television Pictures. International Telecommunication Union, Geneva (1996) Google Scholar
- 4.Bouch, A., Sasse, M.A.: The Case for Predictable Media Quality in Networked Multimedia Applications. In: Proceedings of ACM/SPIE Multimedia Computing and Networking (MMCN 2000), San Jose, pp. 188–195 (2000)Google Scholar
- 5.Borowiak, A., Reiter, U., Svensson, U.P.: Quality Evaluation of Long Duration Audiovisual Content. In: The 9th Annual IEEE Consumer Communications and Networking Conference – Special Session on Quality of Experience (QoE) for Multimedia Communications, Las Vegas, pp. 353–357 (2012)Google Scholar
- 6.Borowiak, A., Reiter, U., Tomic, O.: Measuring the Quality of Long Duration AV Content – Analysis of Test Subject/Time Interval Dependencies. In: EuroITV 2012 – Adjunct Proceedings, Berlin, pp. 266–269 (2012)Google Scholar
- 7.Chen, K.T., Wu, C.C., Chang, Y.C., Lei, C.L.: A Crowdsourceable QoE Evaluation Framework for Multimedia Content. In: Proceedings of the 17th ACM International Conference on Multimedia, New York, pp. 491–500 (2009)Google Scholar
- 8.L.A.M.E (Lame Ain’t an MP3 Encoder) - The Hydrogenaudio recommended MP3 encoder, http://lame.sourceforge.net
- 9.ITU-R Recommendation BS.1116 (rev. 1): Methods for the Subjective Assessment of Small Impairments in Audio Systems Including Multichannel Sound Systems. International Telecommunication Union, Geneva (1997) Google Scholar
- 10.ITU-R, Methodology for the Subjective Assessment of the Quality of Television Pictures BT.500-12, International Telecommunication Union (2009) Google Scholar
- 11.ITU-T, Subjective Audiovisual Quality Assessment Methods for Multimedia Applications P.911, International Telecommunication Union (1998) Google Scholar
- 12.Huber, R., Kollmeier, B.: PEMO-Q—A New Method for Objective Audio Quality Assessment Using a Model of Auditory Perception. IEEE Transactions on Audio Speech and Language Processing (2006)Google Scholar