Abstract
Over the past decade, video streaming on the Internet has become the primary source of our media consumption. Billions of users stream online video on multiple devices with an increasing expectation that video will be delivered at high quality without any rebuffering or other events that affect their Quality of Experience (QoE). Video streaming platforms leverage Content Delivery Networks (CDNs) to achieve this at scale. However, there is a gap in how the quality of video streams is monitored. Current solutions rely on client-side beacons that are issued actively by video players. While such approaches may be feasible for streaming platforms that deploy their own CDN, they are less applicable for third-party CDNs with multiple tenants and diverse video players.
In this paper, we present a characterization of video workload from a global multi-tenant CDN and develop SSQoE: a methodology deployed on the server side which estimates rebuffering experienced by video clients using passive measurements. Using this approach, we calculate a QoE score which represents the health of a video stream across multiple consumers. We present our findings using this QoE score for various scenarios and compare it to traditional server and network monitoring metrics. We also demonstrate the QoE score’s efficacy during large streaming events such as the 2020 Superbowl LIV. We show that this server-side QoE estimation methodology is able to track video performance at an AS or user agent level and can easily pinpoint regional issues at the CDN, making it an attractive solution to be explored by researchers and other CDNs.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
For visualization simplicity in the figures, each PoP is represented by the city/metro name it is located in.
- 2.
Network Operations Center (NOC) is responsible for 24\(\,\times \,\)7 monitoring of global CDN performance and respond to customer incidents.
References
Adaptive bitrate (ABR). https://en.wikipedia.org/wiki/Adaptive_bitrate_streaming
Conviva platform. https://www.conviva.com/about/
FFmpeg utility. https://ffmpeg.org
HLS.js player. https://github.com/video-dev/hls.js
Linux Traffic Control (TC) utility. https://man7.org/linux/man-pages/man8/tc.8.html
NGNIX RTMP. https://github.com/arut/nginx-rtmp-module
Ahmed, A., Shafiq, Z., Bedi, H., Khakpour, A.: Suffering from buffering? detecting qoe impairments in live video streams. In: 2017 IEEE 25th International Conference on Network Protocols (ICNP), pp. 1–10 (2017)
Ahmed, A., Shafiq, Z., Khakpour, A.: Qoe analysis of a large-scale live video streaming event. In: Proceedings of the 2016 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Science, SIGMETRICS 2016, pp. 395–396. Association for Computing Machinery, New York (2016)
Añorga, J., Arrizabalaga, S., Sedano, B., Goya, J., Alonso-Arce, M., Mendizabal, J.: Analysis of Youtube?s traffic adaptation to dynamic environments. Multimedia Tools Appl. 77, 7977–8000 (2017). https://doi.org/10.1007/s11042-017-4695-9
Böttger, T., Cuadrado, F., Uhlig, S.: Looking for hypergiants in PeeringDB. SIGCOMM Comput. Commun. Rev. 48(3), 13–19 (2018)
Bronzino, F., Schmitt, P., Ayoubi, S., Martins, G., Teixeira, R., Feamster, N.: Inferring streaming video quality from encrypted traffic: practical models and deployment experience. Proc. ACM Meas. Anal. Comput. Syst. 3(3), 1–25 (2019)
Calder, M., et al.: Odin: microsoft’s scalable fault-tolerant CDN measurement system. In: USENIX NSDI, April 2018
D’Alconzo, A., Casas, P., Fiadino, P., Bar, A., Finamore, A.: Who to blame when YouTube is not working? detecting anomalies in CDN-provisioned services. In: 2014 International Wireless Communications and Mobile Computing Conference (IWCMC), pp. 435–440 (2014)
Dimopoulos, G., Leontiadis, I., Barlet-Ros, P., Papagiannaki, K.: Measuring video QoE from encrypted traffic. In: Proceedings of the 2016 Internet Measurement Conference, IMC 2016, pp. 513–526. Association for Computing Machinery, New York (2016)
Dobrian, F., et al.: Understanding the impact of video quality on user engagement. Commun. ACM 56(3), 91–99 (2013)
Hohlfeld, O., Pujol, E., Ciucu, F., Feldmann, A., Barford, P.: A QoE perspective on sizing network buffers. In: Proceedings of the 2014 Conference on Internet Measurement Conference, IMC 2014, pp. 333–346. Association for Computing Machinery, New York (2014)
Hyndman, R.J., Athanasopoulos, G.: Classical decomposition of time-series data. https://otexts.com/fpp2/classical-decomposition.html
Jiang, J., Sekar, V., Milner, H., Shepherd, D., Stoica, I., Zhang, H.: CFA: a practical prediction system for video QoE optimization. In: Proceedings of the 13th USENIX Conference on Networked Systems Design and Implementation, NSDI 2016, pp. 137–150. USENIX Association, USA (2016)
Jin, Y., et al.: Zooming in on wide-area latencies to a global cloud provider. In: ACM SIGCOMM, August 2019
Khokhar, M.J., Ehlinger, T., Barakat, C.: From network traffic measurements to QoE for internet video. In: 2019 IFIP Networking Conference (IFIP Networking), pp. 1–9 (2019)
Licciardello, M., Grüner, M., Singla, A.: Understanding video streaming algorithms in the wild. In: Sperotto, A., Dainotti, A., Stiller, B. (eds.) Passive and Active Measurement. pp, pp. 298–313. Springer International Publishing, Cham (2020). https://doi.org/10.1007/978-3-030-44081-7_18
Mok, R.K., Chan, E.W., Luo, X., Chang, R.K.: Inferring the QoE of http video streaming from user-viewing activities. In: Proceedings of the First ACM SIGCOMM Workshop on Measurements up the Stack, W-MUST 2011, pp. 31–36. Association for Computing Machinery, New York (2011)
Nam, H., Kim, K., Schulzrinne, H.: QoE matters more than QOS: why people stop watching cat videos. In: IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications, pp. 1–9 (2016)
Richter, P., et al.: A multi-perspective analysis of carrier-grade NAT deployment. In: Proceedings of the 2016 Internet Measurement Conference, IMC 2016, pp. 215–229. Association for Computing Machinery, New York (2016)
Rüth, J., Wolsing, K., Wehrle, K., Hohlfeld, O.: Perceiving QUIC: do users notice or even care? arXiv:1910.07729 (2019)
Schlinker, B., Cunha, I., Chiu, Y.-C., Sundaresan, S., Katz-Bassett, E.: Internet performance from facebook’s edge. In: Proceedings of the Internet Measurement Conference, IMC 2019, pp. 179–194. Association for Computing Machinery, New York (2019)
Schlinker, B., et al.: Engineering egress with edge fabric: steering oceans of content to the world. In: Proceedings of the Conference of the ACM Special Interest Group on Data Communication, SIGCOMM 2017, pp. 418–431. Association for Computing Machinery, New York (2017)
Yap, K.: et al.: Taking the edge off with espresso: scale, reliability and programmability for global internet peering (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Shah, A., Bran, J., Zarifis, K., Bedi, H. (2022). SSQoE: Measuring Video QoE from the Server-Side at a Global Multi-tenant CDN. In: Hohlfeld, O., Moura, G., Pelsser, C. (eds) Passive and Active Measurement. PAM 2022. Lecture Notes in Computer Science, vol 13210. Springer, Cham. https://doi.org/10.1007/978-3-030-98785-5_27
Download citation
DOI: https://doi.org/10.1007/978-3-030-98785-5_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-98784-8
Online ISBN: 978-3-030-98785-5
eBook Packages: Computer ScienceComputer Science (R0)