Skip to main content
Log in

Supporting efficient video file streaming in P2P cloud storage

  • Published:
Peer-to-Peer Networking and Applications Aims and scope Submit manuscript

Abstract

Peer-to-Peer cloud storage has emerged as an alternative to address the high installation and maintenance costs in conventional cloud storage based on client/server architectures. Since P2P cloud storage must guarantee the same level of data availability as conventional cloud storage, it has employed replication and erasure coding to redundantly store data among peers in P2P environments where the peer churn rate is high. However, most studies using two techniques have focused only on increasing data availability. Especially for video files stored in P2P cloud storage, in addition to guaranteeing their availability, it is critical but challenging to ensure that they are played back in real time by video player applications as if they were being read from local storage. To address this challenge in this paper, we propose a novel hybrid redundancy scheme to support efficient video file streaming while ensuring the availability of video files in P2P cloud storage. The main contributions of our work are threefold. First, we can achieve higher storage efficiency and better streaming performance by employing both erasure coding and replication simultaneously. Second, we can maximize the number of concurrent playback requests supported while minimizing the decrease in file availability by dynamically adjusting the redundancy degree of each video file according to its popularity. Third, we can further improve the performance by efficiently using storage space with our proposed two-phase replacement policy. Finally, we demonstrate through extensive experiments that our scheme outperforms other techniques by utilizing the benefits of both replication and erasure coding.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Algorithm 1
Algorithm 2
Algorithm 3
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

Data availability

The data that support the findings of this study are available from the corresponding author upon reasonable request.

References

  1. Sadiku M, Musa S, Momoh O (2014) Cloud Computing: opportunities and Challenges. IEEE Potentials 33:34–36

    Article  Google Scholar 

  2. Dikaiakos M, Katsaros D, Mehra P, Pallis G, Vakali A (2009) Cloud Computing: distributed Internet Computing for IT and Scientific Research. IEEE Internet Comput 13(5):10–13

    Article  Google Scholar 

  3. Dai X, Wang X, Liu N (2017) Optimal Scheduling of Data-Intensive Applications in Cloud-Based Video Distribution Services. IEEE Trans Circuits Syst Video Technol 27(1):73–83

    Article  Google Scholar 

  4. Huang Y, Li Z, Liu G, Dai Y (2011) Cloud download: using cloud utilities to achieve high-quality content distribution for unpopular videos. In: Proceedings ACM international conference on multimedia, pp 213–222

  5. Chu Y, Huang N, Lin S (2014) Quality of Service Provision in Cloud-Based Storage System for Multimedia Delivery. IEEE Syst J 8(1):292–303

    Article  Google Scholar 

  6. Sosa-Sosa V, Barron A, Gonzalez-Compean JL, Carretero J, Lopez-Arevalo I (2022) Improving Performance and Capacity Utilization in Cloud Storage for Content Delivery and Sharing Services. IEEE Transactions on Cloud Computing. 10(1):439–450

    Article  Google Scholar 

  7. Xiong H, Zhang X, Zhu W, Yao D (2012) CloudSeal: End-to-End Content Protection in Cloud-Based Storage and Delivery Services. In Lecture Notes of the Institute for Computer Sciences. 96:491–500

    Google Scholar 

  8. Hu H, Wen Y, Niyato D (2017) Public Cloud Storage-Assisted Mobile Social Video Sharing: A Supermodular Game Approach. IEEE J Sel Areas Commun 35(3):545–556

    Article  Google Scholar 

  9. Babaoglu O, Marzolla M, Tamburini M (2012) Design and implementation of a P2P Cloud system. In: Proceedings ACM symposium on applied computing, pp 412–417

  10. Li J, Wu J, Chen L (2018) Block-secure: Blockchain based scheme for secure P2P cloud storage. Inf Sci 465:219–231

    Article  Google Scholar 

  11. Hassanzadeh-Nazarabadi Y, Kupcu A, Ozkasap O (2016) Awake: Decentralized and Availability Aware Replication for P2P Cloud Storage. In: IEEE International conference on smart cloud, pp 289–294

  12. Majed A, Raji F, Miri A (2022) Replication management in peer-to-peer cloud storage systems. Clust Comput 25:401–416

    Article  Google Scholar 

  13. Kim J, Kim E (2015) A Hybrid Data Redundancy Scheme for Video Streaming in P2P Cloud Storage. Journal of Korean Institute of Next Generation Computing. 11(1):16–24

    Google Scholar 

  14. Huang Z, Yuan Y, Peng Y (2011) Storage allocation for redundancy scheme in reliability-aware cloud systems. In: Proceedings IEEE international conference on communication software and networks, pp 275–279

  15. Panda S, Naik S (2018) An Efficient Data Replication Algorithm for Distributed Systems. International Journal of Cloud Applications and Computing. 8(3):18–18

    Article  Google Scholar 

  16. Wiesmann M, Pedone F, Schiper A, Kemme B, Alonso G (2000) Understanding replication in databases and distributed systems. In: Proceedings IEEE international conference on distributed computing systems, pp 464–474

  17. Bhagwan R, Savage S, Voelker G (2003) Understanding Availability. In: Proceedings peer-to-peer systems, pp 256–267

  18. Balaji S, Krishnan M, Vajha M, Ramkumar V, Sasidharan B, Kumar P (2018) Erasure coding for distributed storage: an overview. SCIENCE CHINA Inf Sci 61(100301):1869–1919

    Google Scholar 

  19. Li J, Li B (2013) Erasure coding for cloud storage systems: a survey. Tsinghua Science and Technology. 18(3):259–272

    Article  Google Scholar 

  20. Weatherspoon H, Kubiatowicz J (2002) Erasure Coding Vs. Replication: a Quantitative Comparison. In: Proceedings peer-to-peer systems, pp 2429–2429

  21. Ma Y, Nandagopal T, Puttaswamy K, Banerjee S (2013) An ensemble of replication and erasure codes for cloud file systems. In: Proceedings IEEE international conference on computer communications, pp 1276–1284

  22. Kim J (2015) An Efficient Data Redundancy Scheme for Video Streaming in P2P Cloud Storage. In: Hongik University

  23. Google Drive, http://drive.google.com

  24. Rodrigues R, Liskov B (2005) High Availability in DHTs: Erasure Coding vs. Replication. In: Peer-to-peer systems, pp 226–239

  25. Araujo J, Giroire F, Monteiro J (2011) Hybrid Approaches for Distributed Storage System. In: Proceedings data management in grid and peer-to-peer systems, pp 1–12

  26. Dimakis A, Godfrey P, Wu Y, Wainwright M, Ramchandran K (2010) Network Coding for Distributed Storage Systems. IEEE Trans Inf Theory 56(9):4539–4551

    Article  Google Scholar 

  27. Houri Y, Fuhrmann T (2010) Hybrid Redundancy Schemes with Random Linear Coding for Peer-to-Peer Storage Systems. In: Proceedings international conference on computer communications and networks, pp 1–6

  28. Li Z, Xiao C (2021) ER-Store: A Hybrid Storage Mechanism with Erasure Coding and Replication in Distributed Database Systems. Sci Program 2021:1058–9244

    Google Scholar 

  29. Cowling J, Liskov B (2012) Granola: Low-Overhead Distributed Transaction Coordination. In: Proceedings USENIX annual technical conference, pp 223–235

  30. Bhagwan R, Tati K, Cheng Y, Savage S, Voelker G (2004) Total Recall: System Support for Automated Availability Management. In: Proceedings ACM/USENIX symposium on networked systems design and implementation

  31. Cheng Z, Luan Z, Meng Y, Xu Y, Qian D, Roy A, Zhang N, Guan G (2012) ERMS: An Elastic Replication Management System for HDFS. In: Proceedings IEEE international conference on cluster computing workshops, pp 32–40

  32. Liu F, Shen S, Li B, Li B, Jin H (2013) Cinematic-Quality VoD in a P2P Storage Cloud: Design, Implementation and Measurements. IEEE J Sel Areas Commun 31(9):214–226

    Article  Google Scholar 

  33. Zhao W, Liu J, Hara T (2018) Optimal Replica Distribution in Edge-Node-Assisted Cloud-P2P Platforms for Real-Time Streaming. IEEE Trans Veh Technol 67(9):8637–8646

    Article  Google Scholar 

  34. Amoretti M, Grazioli A, Zanichelli F (2016) An autonomic approach for P2P/cloud collaborative environments. Peer-to-Peer Netw Appl 9:1226–1241

    Article  Google Scholar 

  35. Zhao J, Wu C, Lin X (2015) Locality-aware streaming in hybrid P2P-cloud CDN systems. Peer-to-Peer Netw Appl 8:320–335

    Article  Google Scholar 

  36. Sina M, Dehghan M, Rahmani A (2019) CaR-PLive: Cloud-assisted reinforcement learning based P2P live video streaming: a hybrid approach. Multimed Tools Appl 78:34095–34127

    Article  Google Scholar 

  37. Torres-Cruz N, Rivero-Angeles M, Rubino G, Menchaca-Mendez R, Menchaca-Mendez R, Ramirez D (2020) A comprehensive analytical framework for VoD services in hybrid CDN-P2P systems. J Netw Comput Appl 161:1–17

    Article  Google Scholar 

  38. Mondal A, Lifu Y, Kitsuregawa M (2004) P2PR-tree: An R-tree-based spatial index for peer-to-peer environments. In: Proceedings current trends in database technology, pp 516–525

  39. Hudzia B, Kechadi M, Ottewill A (2005) TreeP: A Tree Based P2P Network Architecture. In: Proceedings IEEE international conference on cluster computing, pp 1–15

  40. Li Z, Cao J, Chen G (2008) ContinuStreaming: Achieving high playback continuity of Gossip-based Peer-to-Peer streaming. In: Proceedings IEEE international symposium on parallel and distributed processing, pp 1–12

  41. Kim E, Kim J, Lee C (2019) Efficient neighbor selection through connection switching for P2P live streaming. J Ambient Intell Humaniz Comput 10:1413–1423

    Article  Google Scholar 

  42. Lee C, Kim S, Kim E (2015) Expediting P2P Video Delivery through a Hybrid Push-Pull Protocol. Advances in Electrical and Computer Engineering Journal. 15(4):3–8

    Article  Google Scholar 

  43. Dan A, Sitaram D, Shahabuddin P (1996) Dynamic batching policies for an on-demand video server. Multimedia Syst 4:112–121

    Article  Google Scholar 

Download references

Funding

This work was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT) (No. RS-2023-00252186).

Author information

Authors and Affiliations

Authors

Contributions

Conceptualization and design: Eunsam Kim, Experimentation: Jinsung Kim, Analysis and interpretation of data: Jinsung Kim and Eunsam Kim, Drafting the manuscript: Eunsam Kim.

Corresponding author

Correspondence to Eunsam Kim.

Ethics declarations

Ethics approval

This work does not involve any work related to ethics.

Consent for publication

All authors consent to publication.

Conflict of interest

In terms of competing financial and non-financial interests, the authors declare no conflicts of interest.

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kim, J., Kim, E. Supporting efficient video file streaming in P2P cloud storage. Peer-to-Peer Netw. Appl. (2024). https://doi.org/10.1007/s12083-024-01691-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s12083-024-01691-1

Keywords

Navigation