Skip to main content

Modeling Request Patterns in VoD Services with Recommendation Systems

  • Conference paper
  • First Online:
Communication Systems and Networks (COMSNETS 2017)

Part of the book series: Lecture Notes in Computer Science ((LNCCN,volume 10340))

Included in the following conference series:

Abstract

Video on Demand (VoD) services like Netflix and YouTube account for ever increasing fractions of Internet traffic. It is estimated that this fraction will cross \(80\%\) in the next three years. Most popular VoD services have recommendation engines which recommend videos to users based on their viewing history, thus introducing time-correlation in user requests. Understanding and modeling this time-correlation in user requests is critical for network traffic engineering. The primary goal of this work is to use empirically observed properties of user requests to model the effect of recommendation engines on request patterns in VoD services. We propose a Markovian request model to capture the time-correlation in user requests and show that our model is consistent with the observations of existing empirical studies.

Most large-scale VoD services deliver content to users via a distributed network of servers as serving users requests via geographically co-located servers reduces latency and network bandwidth consumption. The content replication policy, i.e., determining which contents to cache on the servers is a key resource allocation problem for VoD services. Recent studies show that low start-up delay is a key Quality of Service (QoS) requirement of users of VoD services. This motivates the need to pre-fetch (fetch before contents are requested) and cache content likely to be requested in the near future. Since pre-fetching leads to an increase in the network bandwidth usage, we use our Markovian model to explore the trade-offs and feasibility of implementing recommendation based pre-fetching.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Adamic, L.A., Huberman, B.A.: Zipfs law and the internet. Glottometrics 3(1), 143–150 (2002)

    Google Scholar 

  2. Albert, R., Barabási, A.L.: Statistical mechanics of complex networks. Rev. Mod. Phys. 74(1), 47 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  3. Bollobás, B., Borgs, C., Chayes, J., Riordan, O.: Directed scale-free graphs. In: Proceedings of the Fourteenth Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 132–139. Society for Industrial and Applied Mathematics (2003)

    Google Scholar 

  4. Breslau, L., Cao, P., Fan, L., Phillips, G., Shenker, S.: Web caching and Zipf-like distributions: evidence and implications. In: Proceedings of Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies, INFOCOM 1999, vol. 1, pp. 126–134. IEEE (1999)

    Google Scholar 

  5. Cheng, X., Dale, C., Liu, J.: Understanding the characteristics of internet short video sharing: Youtube as a case study. arXiv preprint arXiv:0707.3670 (2007)

  6. Cheng, X., Liu, J.: NetTube: exploring social networks for peer-to-peer short video sharing. In: INFOCOM 2009, pp. 1152–1160. IEEE (2009)

    Google Scholar 

  7. Cisco Whitepaper. http://www.cisco.com/c/en/us/solutions/collateral/service-provider/ip-ngn-ip-next-generation-network/white_paper_c11-481360.html

  8. Davidson, J., Liebald, B., Liu, J., Nandy, P., Van Vleet, T., Gargi, U., Gupta, S., He, Y., Lambert, M., Livingston, B., et al.: The youtube video recommendation system. In: Proceedings of the Fourth ACM Conference on Recommender Systems, pp. 293–296. ACM (2010)

    Google Scholar 

  9. Du, M., Kihl, M., Arvidsson, Ã…., Lagerstedt, C., Gawler, A.: Analysis of prefetching schemes for TV-on-demand service. In: The Tenth International Conference on Digital Telecommunications, ICDT 2015. International Academy, Research and Industry Association (IARIA) (2015)

    Google Scholar 

  10. Fricker, C., Robert, P., Roberts, J., Sbihi, N.: Impact of traffic mix on caching performance in a content-centric network. In: 2012 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), pp. 310–315. IEEE (2012)

    Google Scholar 

  11. Gupta, S., Moharir, S.: Request patterns and caching in VoD services with recommendation systems. In: COMSNETS (2017)

    Google Scholar 

  12. Iamnitchi, A., Ripeanu, M., Foster, I.: Small-world file-sharing communities. In: Twenty-third Annual Joint Conference of the IEEE Computer and Communications Societies, INFOCOM 2004, vol. 2, pp. 952–963. IEEE (2004)

    Google Scholar 

  13. Khemmarat, S., Zhou, R., Krishnappa, D.K., Gao, L., Zink, M.: Watching user generated videos with prefetching. Sig. Process. Image Commun. 27(4), 343–359 (2012)

    Article  Google Scholar 

  14. Krishnan, S.S., Sitaraman, R.K.: Video stream quality impacts viewer behavior: inferring causality using quasi-experimental designs. IEEE/ACM Trans. Networking 21(6), 2001–2014 (2013)

    Article  Google Scholar 

  15. Krishnappa, D.K., Khemmarat, S., Gao, L., Zink, M.: On the feasibility of prefetching and caching for online TV services: a measurement study on Hulu. In: Spring, N., Riley, G.F. (eds.) PAM 2011. LNCS, vol. 6579, pp. 72–80. Springer, Heidelberg (2011). doi:10.1007/978-3-642-19260-9_8

    Chapter  Google Scholar 

  16. Krishnappa, D.K., Zink, M., Griwodz, C., Halvorsen, P.: Cache-centric video recommendation: an approach to improve the efficiency of youtube caches. ACM Trans. Multimed. Comput. Commun. Appl. (TOMM) 11(4), 48 (2015)

    Google Scholar 

  17. Liang, K., Hao, J., Zimmermann, R., Yau, D.K.: Integrated prefetching and caching for adaptive video streaming over HTTP: an online approach. In: Proceedings of the 6th ACM Multimedia Systems Conference, pp. 142–152. ACM (2015)

    Google Scholar 

  18. Liu, Y., Li, F., Guo, L., Shen, B., Chen, S.: A server’s perspective of internet streaming delivery to mobile devices. In: 2012 Proceedings of INFOCOM, pp. 1332–1340. IEEE (2012)

    Google Scholar 

  19. Liu, Y., Li, F., Guo, L., Shen, B., Chen, S., Lan, Y.: Measurement and analysis of an internet streaming service to mobile devices. IEEE Trans. Parallel Distrib. Syst. 24(11), 2240–2250 (2013)

    Article  Google Scholar 

  20. Moharir, S., Ghaderi, J., Sanghavi, S., Shakkottai, S.: Serving content with unknown demand: the high-dimensional regime. In: ACM SIGMETRICS (2014)

    Google Scholar 

  21. Netflix. www.netflix.com

  22. Pleşca, C., Charvillat, V., Ooi, W.T.: Multimedia prefetching with optimal Markovian policies. J. Netw. Comput. Appl. 69, 40–53 (2016)

    Article  Google Scholar 

  23. Suman, S., Shubham, S.: Understanding the characteristic of youtube video graph (2016). https://www.dropbox.com/s/vpgxsvm5je9264q/Youtube-Video-Graph.pdf?dl=0

  24. Veloso, E., Almeida, V., Meira, W., Bestavros, A., Jin, S.: A hierarchical characterization of a live streaming media workload. In: Proceedings of the 2nd ACM SIGCOMM Workshop on Internet Measurment, pp. 117–130. ACM (2002)

    Google Scholar 

  25. Wang, J.: A survey of web caching schemes for the internet. ACM SIGCOMM Comput. Commun. Rev. 29(5), 36–46 (1999)

    Article  Google Scholar 

  26. Watts, D.J., Strogatz, S.H.: Collective dynamics of small-world networks. Nature 393(6684), 440–442 (1998)

    Article  MATH  Google Scholar 

  27. YouTube Statistics. http://www.youtube.com/yt/press/statistics.html

  28. Yu, H., Zheng, D., Zhao, B.Y., Zheng, W.: Understanding user behavior in large-scale video-on-demand systems. ACM SIGOPS Oper. Syst. Rev. 40, 333–344 (2006). ACM

    Article  Google Scholar 

  29. Zhou, R., Khemmarat, S., Gao, L.: The impact of youtube recommendation system on video views. In: Proceedings of the 10th ACM SIGCOMM Conference on Internet Measurement, pp. 404–410. ACM (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sharayu Moharir .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Gupta, S., Moharir, S. (2017). Modeling Request Patterns in VoD Services with Recommendation Systems. In: Sastry, N., Chakraborty, S. (eds) Communication Systems and Networks. COMSNETS 2017. Lecture Notes in Computer Science(), vol 10340. Springer, Cham. https://doi.org/10.1007/978-3-319-67235-9_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-67235-9_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-67234-2

  • Online ISBN: 978-3-319-67235-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics