Skip to main content
SpringerLink
Log in

Migrating big video data to cloud: a peer-assisted approach for VoD

  • Published:
Peer-to-Peer Networking and Applications Aims and scope Submit manuscript

Abstract

Since user demand for a Video-on-demand (VoD) service varies with time in one-day period, provisioning self-owned servers for the peak load it must sustain afew hours per day leads to bandwidth under-utilization at other times. Content clouds, e.g. Amazon CloudFront and Azure CDN, let VoD providers pay by bytes for bandwidth resources, potentially leading to cost savings even if the unit rate to rent a machine from a cloud provider is higher than the rate to own one. In addition, recent studies have presented fog computing as a new paradigm to extend the cloud-based platform for a cost-effective and highly scalable service. In this paper, based on long-term traces from two large-scale VoD systems and temporal development model of content clouds, we tackle challenges, design and potential benefits in migrating both Clients/Server-based and peer-assisted VoD services into the hybrid cloud and edge peers in fog computing environment. Our measurements show that the popularity of the most popular videos decays so quickly, for example, by 11% after one hour that it poses large challenges on updating videos in the cloud. However, the trace-driven evaluations show that our proposed migration strategies (active, reactive and smart strategies), although simply based on the current information, can make the hybrid cloud-assisted VoD deployment save up to 30% bandwidth expense compared with the Clients/Server mode. Moreover, they can also handle the flash crowd traffic with little cost. Leveraging the edge peers in fog computing, we propose a cloud-friendly peer replication strategy, which further reduces the migration cost by a factor of 4. Our simulation also shows that the cloud price and server bandwidth chosen play the most important roles in saving cost, while the cloud storage size and cloud content update strategy play the key roles in the user experience improvement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

Notes

  1. http://www.twitch.tv/

  2. http://www.hulu.com/popular?h=18&page=1&timeframe=today

References

  1. Amazon CloudFront. http://my.url.com/

  2. Amazon S3. http://aws.amazon.com/s3

  3. Azure CDN. http://www.microsoft.com/windowsazure/cdn/default.aspx

  4. Azure Storage. http://www.microsoft.com/windowsazure/storage/default.aspx

  5. Hulu. http://www.hulu.com/popular

  6. ISP price compare. http://www.ispcompared.com/broadband.html

  7. Joost. http://www.joost.com

  8. PPLive. http://www.pplive.com

  9. PPStream. http://www.ppstream.com

  10. Baik E, Pande A, Zheng Z, Mohapatra P (2016) VSync: Cloud based video streaming service for mobile devices Proceedings of IEEE INFOCOM

    Google Scholar 

  11. Bruin XM, Tordera EM, Tashakor G, Jukan A, Ren GJ (2016) Foggy clouds and cloudy fogs: a real need for coordinated management of fog-to-cloud computing systems. IEEE Wirel Commun 23(5):120–128

    Article  Google Scholar 

  12. Chen F, Zhang C, Wang F, Liu J, Wang X, Liu Y (2015) Cloud-assisted live streaming for crowdsourced multimedia content. IEEE Trans Multimedia 17(9):1471–1483

    Article  Google Scholar 

  13. Hajjat M, Sun X, Sung E, Maltz D, Rao S, Sripanidkulchai K, Tawarmalani M (2010) Cloudward Bound: Planning for Beneficial Migration of Enterprise Applications to the Cloud Proceedings of ACM SIGCOMM

    Google Scholar 

  14. Hou X, Li Y, Chen M, Wu D, Jin D, Chen S (2016) Vehicular fog computing: a viewpoint of vehicles as the infrastructures. IEEE Trans Veh Technol 65(6):3860–3873

    Article  Google Scholar 

  15. Hu H, Wen Y, Chua TS, Huang J, Zhu W, Li X (2016) Joint content replication and request routing for social video distribution over cloud cdn: a community clustering method. IEEE Trans Circuits Syst Video Technol 26(7):1320–1333

    Article  Google Scholar 

  16. Hu H, Wen Y, Niyato D (2017) Public Cloud Storage Assisted Mobile Social Video Sharing: A Supermodular Game Approach. IEEE Journal on Selected Areas in Communications. doi:10.1109/JSAC.2017.2659478

  17. Huang Y, Fu TZ, Chiu D-M, Lui JC, Huang C (2008) Challenges, Design and Analysis of a Large-scale P2P-VoD Syste Proceedings of ACM SIGCOMM

    Google Scholar 

  18. Jalali F, Hinton K, Ayre R, Alpcan T, Tucker RS (2016) Fog computing may help to save energy in cloud computing. IEEE J Sel Areas Commun 34(5):1728–1739

    Article  Google Scholar 

  19. Lai Z, Cui Y, Li M, Li Z, Dai N, Chen Y (2016) TailCutter: Wisely Cutting Tail Latency in Cloud CDN under Cost Constraints Proceedings of IEEE INFOCOM

    Google Scholar 

  20. Li B, Wang Z, Liu J, Zhu W (2013) Two decades of internet video streaming A retrospective view. ACM Trans Multimed Comput Commun Appl 9(1):2284–2294

    Google Scholar 

  21. Nan G, Mao Z, Yu M, Li M, Wang H, Zhang Y (2014) stackelberg game for bandwidth allocation in Cloud-Based wireless Live-Streaming social networks. IEEE Syst J 8(1):256 –267

    Article  Google Scholar 

  22. Peng M, Yan S, Zhang K, Wang C (2016) Fog-computing-based radio access networks: issues and challenges. IEEE Netw 30(4):46–53

    Article  Google Scholar 

  23. Qiu X, Li H, Wu C, Li Z, Lau FCM (2015) Cost-minimizing dynamic migration of content distribution services into hybrid clouds. IEEE Trans Parallel Distrib Syst 26(12):3330–3345

    Article  Google Scholar 

  24. Wang F, Liu J, Chen M, Wang H (2016) Migration towards cloud-assisted live media streaming. IEEE/ACM Trans Networking 24(1):272–282

    Article  Google Scholar 

  25. Wang X, Chen M, Kwon TT, Yang L, Leung VCM (2013) AMES-cloud A Framework of Adaptive Mobile Video Streaming and Efficient Social Video Sharing in the Clouds. IEEE Trans Multimedia 15(4):811–820

    Article  Google Scholar 

  26. Wen Y, Zhu X, Rodrigues J, Chen C (2014) Cloud Mobile Media Reflections and Outlook. IEEE Trans Multimedia 16(4):885 –902

    Article  Google Scholar 

  27. Wu W, Lui JC (2011) Exploring the Optimal Replication Strategy in P2P-VoD Systems: Characterization and Evaluation Proceedings of IEEE INFOCOM

    Google Scholar 

  28. Yan Z, Xue J, Chen CW (2017) Prius: Hybrid edge cloud and client adaptation for http adaptive streaming in cellular networks. IEEE Trans Circuits Syst Video Technol 27(1):209–222

    Article  Google Scholar 

  29. Zakerinasab MR, Wang M (2013) A Cloud-Assisted Energy-Efficient Video Streaming System for Smartphones IEEE/ ACM IWQoS

    Google Scholar 

  30. Zhang H, Xiao Y, Bu S, Niyato D, Yu R, Han Z (2016) Fog computing in multi-tier data center networks: A hierarchical game approach ICC. IEEE

    Google Scholar 

  31. Zhang X, Wu C, Li Z, Lau FCM (2015) Online Cost Minimization for Operating Geo-distributed Cloud CDNs Proceedings of IEEE IWQoS

    Google Scholar 

  32. Zhao H, Zheng Q, Zhang W, Du B, Li H (2017) A segment-based storage and transcoding trade-off strategy for multi-version vod systems in the cloud. IEEE Trans Multimedia 19(1):149–159

    Article  Google Scholar 

  33. Zhou Y, Fu TZJ, Chiu DM (2011) Statistical Modeling and Analysis of P2P Replication to Support VoD Service Proceedings of IEEE INFOCOM

    Google Scholar 

Download references

Acknowledgments

This research is supported by the following grants: “Multi-source heterogeneous big data management, analysis and mining for urban renewal” (National Natural Science Foundation of China, U1301253), “Application demonstration of big data for land resources management and service” (Science and Technology Planning Project of Guangdong Province, China, 2015B010110006), “Cooperative resource allocation optimization for software-defined network based virtual CDN” (National Natural Science Foundation of China 61602214), Natural Science Foundation of Jiangsu Province in China (BK20160191), National Natural Science Foundation of China (61472212).

Author information

Authors and Affiliations

  1. School of Digital Media, Jiangnan University, Jiangnan, China

    Fei Chen

  2. UCAR Technology (China) Limited, Beijing, China

    Haitao Li

  3. College of Natural Resources and Environment, South China Agricultural University, Guangzhou, China

    Jiangchuan Liu, Bo Li & Yuemin Hu

  4. Department of Computer Science and Technology, Tsinghua University, Haidian Qu, China

    Ke Xu

Authors
  1. Fei Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Haitao Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jiangchuan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bo Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ke Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yuemin Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yuemin Hu.

Additional information

This article is part of the Topical Collection: Special Issue on Big Data Networking

Guest Editors: Xiaofei Liao, Song Guo, Deze Zeng, and Kun Wang

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, F., Li, H., Liu, J. et al. Migrating big video data to cloud: a peer-assisted approach for VoD. Peer-to-Peer Netw. Appl. 11, 1060–1074 (2018). https://doi.org/10.1007/s12083-017-0575-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12083-017-0575-3

Keywords

Search

Navigation