Abstract
This chapter addresses QoE in the context of video streaming services. Both reliable and unreliable transport mechanisms are covered. An overview of video quality models is provided for each case, with a focus on standardized models. The degradations typically occurring in video streaming services, and which should be covered by the models, are also described. In addition, the chapter presents the results of various studies conducted to fill the gap between the existing video quality models and the estimation of QoE in the context of video streaming services. These studies include work on audiovisual quality modeling, field testing, and on the user impact. The chapter finishes with a discussion on the open issues related to QoE.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Note that the focus was so far on visual stimuli and, therefore, video quality models. Due to its impact on the scientific work dedicated to rebuffering models, and although it is audiovisual, the model of [26] is presented in this section.
References
Al-Qeisi KI (2009) Analyzing the use of UTAUT model in explaining an online behaviour: Internet banking adoption. Ph.D. thesis, Brunel University
Argyropoulos S, Raake A, Garcia MN, List P (2011) No-reference video quality assessment for SD and HD H.264/AVC sequences based on continuous estimates of packet loss visibility. In: International workshop on Quality of Multimedia Experience (QoMEX), pp 31–36
Beerends JG, Caluwe F (1999) The influence of video quality on perceived audio quality and vice versa. J Audio Eng Soc 47:355
Belmudez B, Möller S, Lewcio B, Raake A, Mehmood A (2009) Audio and video channel impact on perceived audio-visual quality in different interactive contexts. In: IEEE international workshop on Multimedia Signal Processing (MMSP)
Borowiak A, Reiter U, Svensson UP (2012) Quality evaluation of long duration audiovisual content. In: IEEE Consumer Communications and Networking Conference, pp 337–341
Bosc E, Le Callet P, Morin L, Pressigout M (2013) Visual quality assessment of synthesized views in the context of 3D-TV. In: Zhu C, Zhao Y, Yu L, Tanimoto M (eds) 3D-TV systems with depth-based-image-rendering architectures, techniques and challenges, Springer, New York
Boulos F, Parrein B, Callet PL, Hands D (2009) Perceptual effects of packet loss on H.264/AVC encoded videos. In: International workshop on video processing and quality metrics for consumer electronics
Chateau N (1998) ITU-T Contribution COM 12–61 Relations between audio, video and audio-visual quality. International Telecommunication Union (ITU-T), Geneva
Chikkerur S, Sundaram V, Reisslein M, Karam LJ (2011) Objective video quality assessment methods: A classification, review, and performance comparison. IEEE Trans Broadcasting 57(2):165–182
Corriveau P, Gojmerac C, Hughes B, Stelmach L (1999) All subjective scales are not created equal: The effects of context on different scales. Signal Process 77(1):1–9
Cranley N, Perry P, Murphy L (2006) User perception of adapting video quality. Int J Hum Comput Stud 64(8):637–647
Daly S (1992) The visible difference predictor: an algorithm for the assessment of image fidelity. In: SPIE human vision, visual processing and digital display, vol 1666
Davis AG, Bayart D, Hands DS (2009) Hybrid no-reference video quality prediction. In: Proceedings of IEEE international symposium on broadband multimedia systems and broadcasting, pp 1–6
Davis F, Bagozzi R, Warshaw P (1989) User acceptance of computer technology: a comparison of two theoretical models. Manage Sci 35:982–1003
De Moor K, Ketyko I, Joseph W, Deryckere T, De Marez L, Martens L, Verleye G (2010) Proposed framework for evaluating quality of experience in a mobile, testbed-oriented living lab setting. Mob Netw Appl 15(3):378–391
De Pessemier T, De Moor K, Joseph W, De Marez L, Martens L (2013) Quantifying the influence of rebuffering interruptions on the user’s quality of experience during mobile video watching. IEEE Trans Broadcast 59(1):47–61
Dobrian F, Awan A, Joseph D, Ganjam A, Zhan J, Sekar V, Stoica I, Zhang H (2013) Understanding the impact of video quality on user engagement. Comm ACM 56(3):91–99
DSL Forum Technical Report, TR-126 (2006) Triple-play services quality of experience (QoE) requirements, DSL Forum
EBU-SAMVIQ (2003) SAMVIQ subjective assessment methodology for video quality. Report by the EBU Project Group B/VIM, European Broadcasting Union, Geneva
Frossard P, Verscheure O (2001) Joint source/FEC rate selection for quality-optimal MPEG-2 video delivery. IEEE Trans Image Process 10(12):1815–1825
Garcia MN, Raake A (2010) Parametric packet-layer video quality model for IPTV. In: International conference on information science, signal processing and their applications
Garcia MN, Schleicher R, Raake A (2011) Impairment-factor-based audiovisual quality model for IPTV: influence of video resolution, degradation type, and content type. EURASIP J Image and Video Process 2011:1–14
Gros L, Chateau N (2001) Instantaneous and overall judgements for time-varying speech quality: assessments and relationships. Acta Acustica 87(3):367–377
Hands D (2004) A basic multimedia quality model. IEEE Trans Multimedia 6(6):806–816
Hoßfeld T, Egger S, Schatzand R, Fiedler M, Masuch K, Lorentzen C (2012) Initial delay vs. interruptions: between the devil and the deep blue sea. In: International workshop on Quality of Multimedia Experience
Hoßfeld T, Schatz R, Biersack E, Plissonneau L (2013) Internet video delivery in Youtube: from traffic measurements to quality of experience. In: Biersack E, Callegari C, Matijasevic M (eds) Data traffic monitoring and analysis: from measurement, classification and anomaly detection to quality of experience. Springer, Berlin
Huynh-Thu Q, Garcia MN, Corriveau FS, Raake PJ (2011) Study of rating scales for subjective quality assessment of high-definition video. IEEE Trans Broadcast 57(1):1–14
Huynh-Thu Q, Ghanbari M (2012) The accuracy of PSNR in predicting video quality for different video scenes and frame rates. Telecommun Syst 49(1):35–48
ITU-R Recommendation BT.500 (2012) Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union, Geneva
ITU-R Recommendation BT.500-12 (2009) Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union, Geneva
ITU-R Recommendation BT.710-4 (1998) Subjective assessment methods for image quality in high-definition television. International Telecommunication Union, Geneva
ITU-R Recommendation P.1202 (2012) Parametric non-intrusive bitstream assessment of video media streaming quality. International Telecommunication Union, Geneva
ITU-R Recommendation P.1202.1 (2012) Parametric non-intrusive bitstream assessment of video media streaming quality–lower resolution application area. International Telecommunication Union, Geneva
ITU-R Recommendation P.1202.2 (2012) Parametric non-intrusive bitstream assessment of video media streaming quality–higher resolution application area. International Telecommunication Union, Geneva
ITU-T Contribution COM 12–27 (1994) Extension of combined audio/video quality model. Bellcore, USA
ITU-T Recommendation G. 1070 (2007) Opinion model for video-telephony applications. International Telecommunication Union, Geneva
ITU-T Recommendation G.1080 (2008) Quality of experience requirements for IPTV services. International Telecommunication Union, Geneva
ITU-T Recommendation H.264 (2013) Advanced video coding for generic audiovisual services. International Telecommunication Union, Geneva
ITU-T Recommendation J.144 (2001) Objective perceptual video quality measurement techniques for digital cable television in the presence of a full reference. International Telecommunication Union, Geneva
ITU-T Recommendation J.341 (2011) Objective perceptual multimedia video quality measurement of HDTV for digital cable television in the presence of a full reference. International Telecommunication Union, Geneva
ITU-T Recommendation P.10/G.100 Amd 2 (2008) Vocabulary for performance and quality of service. International Telecommunication Union, Geneva
ITU-T Recommendation P.1201.1 (2012) Parametric non-intrusive assessment of audiovisual media streaming quality–lower resolution application area. International Telecommunication Union, Geneva
ITU-T Recommendation P.1201.2 (2012) Parametric non-intrusive assessment of audiovisual media streaming quality–higher resolution application area. International Telecommunication Union, Geneva
ITU-T Recommendation P.910 (1999) Subjective video quality assessment methods for multimedia applications. International Telecommunication Union, Geneva
ITU-T Recommendation P.910 (2008) Subjective video quality assessment methods for multimedia applications. International Telecommunication Union, Geneva
ITU-T Recommendation P.911 (1998) Subjective audiovisual quality assessment methods for multimedia applications. International Telecommunication Union, Geneva
ITU-T Recommendation P.920 (2000) Interactive test methods for audiovisual communications. International Telecommunication Union, Geneva
ITU-T Recommendation P.930 (1996) Principles of a reference impairment system for video. International Telecommunication Union, Geneva
ITU-T Contr. COM 12–20 (1993) Experimental combined audio/video subjective test method. Bellcore, USA
ITU-T Delayed Contribution COM 12 D.038 (1998) Results of an audio-visual desktop teleconferencing subjective experiment. NTIA/ITS, USA
Jang YH, Noh JM (2011) Customer acceptance of IPTV service quality. Int J Inf Manage 31(6):582–592
Jones C, Atkinson D (1998) Development of opinion-based audio-visual quality models for desktop video-teleconferencing. In: IEEE International workshop on quality of service
Jumisko-Pyykkö S, Häkkinen J (2008) Profiles of the evaluators: impact of psychographic variables on the consumer-oriented quality assessment of mobile television. In: Proceedings of SPIE, vo 6821, article id. 68210L, p 14
Jumisko-Pyykkö S, Strohmeier D (2013) Cognitive styles and visual quality. IS&T/SPIE Electron Imaging 4(4):86670K–86670K
Kanumuri S, Cosman P, Reibman A, Vaishampayan V (2006) Modeling packet-loss visibility in MPEG-2 video. IEEE Trans Multimedia 8(2):341–355
Kanumuri S, Subramanian S, Cosman P, Reibman A (2006) Predicting H.264 packet loss visibility using a generalized linear model. In: IEEE International Conference on Image Processing (ICIP), pp 2245–2248
Keimel C, Habigt J, Diepold K (2012) Hybrid no-reference video quality metric based on multiway plsr. In: Proceedings of the 20th European signal processing conference, pp 1244–1248
Keimel C, Habigt J, Klimpke M, Diepold K (2011) Design of no-reference video quality metrics with multiway partial least squares regression. In: International workshop on Quality of Multimedia Experience (QoMEX), pp 49–54
Keimel C, Klimpke M, Habigt J, Diepold K (2011) No-reference video quality metric for HDTV based on H.264/AVC bitstream features. In: IEEE International Conference on Image Processing (ICIP), pp 3325–3328
Kohlrausch A, van de Par S (2005) Audio-visual interaction in the context of multi-media applications. In: Blauert J (ed) Communication acoustics. Springer, Berlin, pp 109–138
Lee K, Park J, Lee S, Bovik A (2010) Temporal pooling of video quality estimates using perceptual motion models. In: IEEE International Conference on Image Processing, pp 2493–2496
Lee SO, Jung KS, Sim DG (2010) Real-time objective quality assessment based on coding parameters extracted from H.264/AVC bitstream. IEEE Trans Consum Electron 56(2):1071–1078
Liao N, Chen Z (2011) A packet-layer video quality assessment model with spatiotemporal complexity estimation. EURASIP J Image Video Process 5:1
Lin TL, Kanumuri S, Zhi Y, Poole D, Cosman P, Reibman A (2010) A versatile model for packet loss visibility and its application to packet prioritization. IEEE Trans Image Process 19(3):722–735
Lin X, Ma H, Luo L, Chen Y (2012) No-reference video quality assessment in the compressed domain. IEEE Trans Consum Electron 58(2):505–512
Naccari M, Tagliasacchi M, Tubaro S (2009) No-reference video quality monitoring for H.264/AVC coded video. IEEE Trans Multimedia 11(5):932–946
Next Generation Mobile Networks (2013) Service quality definition and measurement. White Paper. http://www.ngmn.org/uploads/media/NGMN-P-SERQU_Service_Quality_Definition_and_Measurement_-_A_Technical_Report_by_NGMN_Alliance__v1_0_4_.pdf
Ninassi A, Le Meur O, Le Callet P, Barba D (2009) Considering temporal variations of spatial visual distortions in video quality assessment. IEEE J Sel Top Signal Process 3(2):253–265
Park J, Seshadrinathan K, Lee S, Bovik A (2013) Video quality pooling adaptive to perceptual distortion severity. IEEE Trans Image Process 22(2):610–620
Pinson M, Ingram W, Webster A (2011) Audiovisual quality components. IEEE. Signal Process 28:60–67
Pinson M, Janowski L, Pepion R, Huynh-Thu Q, Schmidmer C, Corriveau P, Younkin A, Le Callet P, Barkowsky M, Ingram W (2012) The influence of subjects and environment on audiovisual subjective tests: an international study. IEEE J Sel Top Signal Process 6(6):640–651
Pinson M, Wolf S (2003) Comparing subjective video quality testing methodologies. In: Proceedings of SPIE
Pinson MH, Wolf S (2004) A new standardized method for objectively measuring video quality. IEEE Trans Broadcast 50(3):312–322
Qualinet White Paper on Definitions of Quality of Experience-Output Version of the Dagstuhl Seminar 12181 (2012). In: Möller S, Le Callet P, Perkis A (eds) European network on quality of experience in multimedia systems and services (COST Action IC 1003), 1.1 edn, Lausanne
Raake A, Gustafsson J, Argyropoulos S, Garcia MN, Lindegren D, Heikkilä G, Pettersson M, Feiten B, List P (2011) Monitoring the quality of IP-based mobile and fixed network audiovisual media services. IEEE Signal Proces Mag 28(6):68–79
Redi J (2013) Visual quality beyond artifact visibility. In: SPIE human vision and electronic imaging XVIII
Reibman A, Kanumuri S, Vaishampayan V, Cosman P (2004) Visibility of individual packet losses in MPEG-2 video. IEEE International Conference on Image Processing (ICIP). 1:171–174
Reibman AR, Vaishmpayan VA, Sermadevi Y (2004) Quality monitoring of video over a packet network. IEEE Trans Multimedia 6(2):327–334
Ries M, Puglia R, Tebaldi T, Nemethova O, Rupp M (20058) Audiovisual quality estimation for mobile video services. In: 2nd IEEE symposium on wireless communication systems
Seshadrinathan K, Bovik A (2011) Temporal hysteresis model of time varying subjective video quality. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp 1153–1156
Seufert M, Slanina M, Egger S, Kottkamp M (2013) To pool or not to pool: a comparison of temporal pooling methods for http adaptive video streaming. In: International workshop on video processing and quality metrics for consumer electronics
Shi Z, Chen P, Feng C, Huang L, Xu W (2012) Research on quality assessment metric based on H.264/AVC bitstream. In: International conference on anti-counterfeiting, security and identification, pp 1–5
Sodagar I (2011) The MPEG-DASH standard for multimedia streaming over the internet. IEEE Multimedia 18(4):62–67
Staelens N, Van den Broeck W, Pitrey Y, Vermeulen B, Demeester P (2012) Lessons learned during real-life QoE assessment. In: EuroITV–10th European conference on interactive TV
Staelens N, Moens S, Van den Broeck W, Mariën I, Vermeulen B, Lambert P, Van de Walle R, Demeester P (2010) Assessing quality of experience of IPTV and Video on Demand services in real-life environments. IEEE Trans Broadcast 56(4):458–466
Staelens N, Sedano I, Barkowsky M, Janowski L, Brunnström K, Le Callet P (2011) Standardized toolchain and model development for video quality assessment–the mission of the joint effort group in VQEG. In: International workshop on Quality of Multimedia Experience
Staelens N, Van Wallendael G, Crombecq K, Vercammen N, De Cock J, Vermeulen B, Van de Walle R, Dhaene T, Demeester P (2012) No-reference bitstream-based visual quality impairment detection for high definition H.264/AVC encoded video sequences. IEEE Trans Broadcast 58(2):187–199
Strohmeier D (2012) Open profiling of quality: a mixed methods research approach for audiovisual quality evaluations. SIG Multimedia Rec 4(4):5–6
Tao S, Apostolopoulos J, Guerin R (2008) Real-time monitoring of video quality in IP networks. IEEE/ACM Trans Networking 16(5):1052–1065
Valenzise G, Magni S, Tagliasacchi M, Tubaro S (2012) No-reference pixel video quality monitoring of channel-induced distortion. IEEE Trans Circ Syst Video Technol 22(4):605–618
Verscheure O, Frossard P, Hamdi M (1999) User-oriented qos analysis in MPEG-2 video delivery. Real-Time Imaging 5(5):305–314
Waltl M, Timmerer C, Hellwagner H (2009) A test-bed for quality of multimedia experience evaluation of sensory effects. In: International workshop on Quality of Multimedia Experience, pp 145–150
Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612
Wang Z, Lu L, Bovik AC (2004) Video quality assessment based on structural distortion measure. Signal Process Image Commun 19(2):121–132
Weniger S (2010) User adoption of IPTV: a research model. In: International bled e-conference
Winkler S, Faller C (2006) Perceived audiovisual quality of low-bitrate multimedia content. IEEE Trans Multimedia 8(5):973–980
Winkler S, Mohandas P (2008) The evolution of video quality measurement: from PSNR to hybrid metrics. IEEE Trans Broadcast 54(3):660–668
Wu HR, Rao KR (2006) Digital video image quality and perceptual coding. Taylor & Francis, Boca Raton
Xue Y, Song Y, Ou YF, Wang Y (2013) Video adaptation considering the impact of temporal variation on quantization stepsize and frame rate on perceptual quality. In: International workshop on video processing and quality metrics for consumer electronics, pp 70–74
Yamada T, Yachida S, Senda Y, Serizawa M (2010) Accurate video-quality estimation without video decoding. In: International Conference on Acoustics, Speech, and Signal Processing (ICASSP)
Yamagishi K, Hayashi T (2008) Parametric packet-layer model for monitoring video quality of IPTV services. In: IEEE international conference on communications
Yamagishi K, Okamoto J, Hayashi T, Takahashi T (2012) No reference video-quality-assessment model for monitoring video quality of IPTV services. IEICE Trans Commun 95:435–448
Yang F, Song J, Wan S, Wu H (2012) Content-adaptive packet-layer model for quality assessment of networked video services. IEEE J Sel Top Signal Process 6(6):672–683
You F, Zhang W, Xiao J (2009) Packet loss pattern and parametric video quality model for IPTV. In: International conference on computer and information science
You J, Reiter U, Hannuksela M, Gabbouj M, Perkis A (2010) Perceptual-based quality assessment for audio-visual services:a survey. J Signal Process Image Commun 25:482
Yuen M, Wu H (1998) A survey of hybrid MC/DPCM/DCT video coding distortions. EURASIP J Signal Process 70:247
Zieliński S, Rumsey F, Bech S (2008) On some biases encountered in modern audio quality listening testsa review. J Audio Eng Soc 56(6):427–451
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Garcia, MN., Argyropoulos, S., Staelens, N., Naccari, M., Rios-Quintero, M., Raake, A. (2014). Video Streaming. In: Möller, S., Raake, A. (eds) Quality of Experience. T-Labs Series in Telecommunication Services. Springer, Cham. https://doi.org/10.1007/978-3-319-02681-7_19
Download citation
DOI: https://doi.org/10.1007/978-3-319-02681-7_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-02680-0
Online ISBN: 978-3-319-02681-7
eBook Packages: EngineeringEngineering (R0)