Abstract
Video streaming has emerged as a major form of entertainment and is more ubiquitous than ever before. However, as per the recent surveys, poor video quality and buffering continue to remain major concerns causing users to abandon streaming video. This is due to the conditional rule-based logic used by state-of-the-art algorithms, which cannot adapt to all the network conditions. In this paper, a Deep Neural Network (DNN) based adaptive streaming system is proposed, which is trained using a combination of supervised learning and reinforcement learning that can adapt to all the network conditions. This method aims to pre-train the model using supervised learning with a labelled data set generated using state-of-the-art rule based algorithm. This pre-trained model will be used as the base model and is trained with reinforcement learning, which aims to maximize quality, minimize buffering and maintain smooth playback. Training can happen on Personal Computer (PC) based server or edge server setup as well as On-Device, which can even be beneficial in providing user personalization based on network throughput collected on the device. It has been shown that this method will give users a superior video streaming experience, and achieve performance improvement of around 30% on QoE over the existing commercial solutions.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
MRF Forecast. https://www.marketresearchfuture.com/reports/video-streaming-market-3150
Mux Report. https://static.mux.com/downloads/2017-Video-Streaming-Perceptions-Report.pdf
Vargas, R., et al.: Deep learning: a review. Adv. Intell. Syst. Comput. 29, 232–244 (2017)
Mao, H., et al.: Neural adaptive video streaming with pensieve (2017)
Spiteri, K., Urgaonkar, R., Sitaraman, R.K.: BOLA: near-optimal bitrate adaptation for online videos (2016)
Huang, T.Y., et al.: A buffer-based approach to rate adaptation: evidence from a large video streaming service. In: SIGCOMM. ACM (2014)
Sun, Y., et al.: CS2P: improving video bitrate selection and adaptation with data-driven throughput prediction. In: SIGCOMM. ACM (2016)
Yin, X., Jindal, A., Sekar, V., Sinopoli, B.: A control-theoretic approach for dynamic adaptive video streaming over HTTP. In: SIGCOMM. ACM (2015)
Akhtar, Z., Nam, Y.S., Govindan, R., et al.: Oboe: auto-tuning video ABR algorithms to network conditions. In: SIGCOMM. ACM (2018)
Silver, D., et al.: Mastering the game of Go with deep neural networks and tree search. Nature 529, 484 (2016)
Mnih, V., et al.: Asynchronous methods for deep reinforcement learning. In: International Conference on Machine Learning (2016)
Exoplayer. https://github.com/google/ExoPlayer
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Rakesh, K., Kumar, L.S., Mittar, R., Chakraborty, P., Ankush, P.A., Gairuboina, S.K. (2020). DNN Based Adaptive Video Streaming Using Combination of Supervised Learning and Reinforcement Learning. In: Nain, N., Vipparthi, S., Raman, B. (eds) Computer Vision and Image Processing. CVIP 2019. Communications in Computer and Information Science, vol 1148. Springer, Singapore. https://doi.org/10.1007/978-981-15-4018-9_13
Download citation
DOI: https://doi.org/10.1007/978-981-15-4018-9_13
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-4017-2
Online ISBN: 978-981-15-4018-9
eBook Packages: Computer ScienceComputer Science (R0)