Skip to main content
SpringerLink
Log in

Scalable and Cost-Efficient Algorithms for Reliable and Distributed Cloud Storage

  • Conference paper
  • First Online:
Cloud Computing and Services Science (CLOSER 2015)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 581))

Included in the following conference series:

  • 767 Accesses

Abstract

This paper focuses on minimizing jointly data storage and networking costs in a distributed cloud storage environment. We present two new efficient algorithms to place encrypted data chunks and enhance data availability when guaranteeing a minimum cost of storage and communication in the same time. The proposed underlying solutions, based on linear programming approach lead to an exact formulation with convergence times feasible for small and medium network sizes. A new polynomial time algorithm is presented and shown to scale to much larger network sizes. Performance assessment results, using simulations, show the scalability and cost-efficiency of the proposed distributed cloud storage solutions.

M. Hadji—A research fellow at the Technological Research Institute - IRT SystemX.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Varghese, L.A., Bose, S.: Integrity verification in multi cloud storage. In: Proceedings of International Conference on Advanced Computing (2013)

    Google Scholar 

  2. Balasaraswathi, V.R., Manikandan, S.: Enhanced security for multi-cloud storage using cryptographic data splitting with dynamic approach. In: Advanced Communication Control and Computing Technologies (ICACCCT) Conference, pp. 1190–1194 (2014)

    Google Scholar 

  3. Thanasis, P.G., Bonvin, N., Aberer, K.: Scalia: an adaptive scheme for efficient multi-cloud storage. In: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, Los Alamitos, CA, USA, pp. 20: 1–20: 10 (2012)

    Google Scholar 

  4. Srivastava, S., Gupta, V., Yadav, R., Kant, K.: Enhanced distributed storage on the cloud. In: Computer and Communication Technology (ICCCT) Conference, pp. 321–325 (2012)

    Google Scholar 

  5. Yanzhen, Q., Naixue, X.: RFH: A resilient, fault-tolerant and high-efficient replication algorithm for distributed cloud storage. In: Parallel Processing (ICPP) Conference, pp. 520–529 (2012)

    Google Scholar 

  6. Qingsong, W., Veeravalli, B., Bozhao, G., Lingfang, Z., Dan, F.: CDRM: a cost-effective dynamic replication management scheme for cloud storage cluster. In: Cluster Computing (CLUSTER) IEEE Conference, pp. 188–196 (2010)

    Google Scholar 

  7. Mansouri, Y., Toosi, A.N., Buyya, R.: Brokering algorithms for optimizing the availability and cost of cloud storage services. In: Proceedings of the 2013 IEEE International Conference on Cloud Computing Technology and Science, Washington, DC, USA, vol. 01, pp. 581–589 (2013)

    Google Scholar 

  8. Bonvin, N., Papaioannou, T.G., Aberer, K.: A self-organized, fault-tolerant and scalable replication scheme for cloud storage. In: Proceedings of the 1st ACM Symposium on Cloud Computing, Indianapolis, Indiana, USA, pp. 205–216 (2010)

    Google Scholar 

  9. Rodrigues, R., Liskov, B.: High availability in DHTs: erasure coding vs. replication. In: van Renesse, R. (ed.) IPTPS 2005. LNCS, vol. 3640, pp. 226–239. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  10. Li, J., Li, B.: Erasure coding for cloud storage systems: a survey. Tsinghua Sci. Technol. J. 18, 259–272 (2013)

    Article  Google Scholar 

  11. Jindarak, K., Uthayopas, P.: Enhancing cloud object storage performance using dynamic replication approach. In: Parallel and Distributed Systems (ICPADS) IEEE Conference, pp. 800–803 (2012)

    Google Scholar 

  12. Abu-Libdeh, H., Princehouse, L., Weatherspoon, H.: RACS: a case for cloud storage diversity. In: Proceedings of the 1st ACM Symposium on Cloud Computing, New York, NY, USA, pp. 229–240 (2010)

    Google Scholar 

  13. Ford, D., Labelle, F., Popovici, F., Stokely, M., Truong, V.A., Barroso, L., Grimes, C., Quinlan, S.: Availability in globally distributed storage systems. In: Proceedings of the 9th USENIX Symposium on Operating Systems Design and Implementation (2010)

    Google Scholar 

  14. Myint, J., Thinn Thu, N.: A data placement algorithm with binary weighted tree on PC cluster-based cloud storage system. In: Cloud and Service Computing (CSC) Conference, pp. 315–320 (2011)

    Google Scholar 

  15. Negru, C., Pop, F., Cristea, V., Bessisy, N., Jing, L.: Energy efficient cloud storage service: key issues and challenges. In: Emerging Intelligent Data and Web Technologies (EIDWT) Conference, pp. 763–766 (2013)

    Google Scholar 

  16. Chia-Wei, C., Pangfeng, L., Jan-Jan, W.: Probability-based cloud storage providers selection algorithms with maximum availability. In: Parallel Processing (ICPP) Conference, pp. 199–208 (2012)

    Google Scholar 

  17. Ghemawat, S., Gobioff, H., Leung, S.T.: The google file system. SIGOPS Oper. Syst. Rev. 37, 29–43 (2003)

    Article  Google Scholar 

  18. Zhang, Q.F., Xue-zeng, P., Yan, S., Wen-juan, L.: A novel scalable architecture of cloud storage system for small files based on P2P. In: Cluster Computing Workshops (CLUSTER WORKSHOPS) Conference, pp. 41–47 (2012)

    Google Scholar 

  19. Openstack. https://www.openstack.org/

  20. Swift. http://docs.openstack.org/developer/swift/

  21. Amazon Web Services. http://aws.amazon.com/fr/s3/pricing/

  22. CPLEX Optimizer. http://www-01.ibm.com/software/commerce/optimization/cplex-optimizer/

  23. Weatherspoon, H., Kubiatowicz, J.D.: Erasure coding vs. replication: a quantitative comparison. In: Druschel, P., Kaashoek, M.F., Rowstron, A. (eds.) IPTPS 2002. LNCS, vol. 2429, pp. 328–337. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  24. Korte, B., Vygen, J.: Combinatorial Optimization: Theory and Algorithms. Springer, Heidelberg (2001)

    MATH  Google Scholar 

  25. Grotschel, M., Lovasz, L., Shrijver, A.: Geometric Algorithms and Combinatorial Optimization. Springer, Heidelberg (1985)

    Google Scholar 

  26. Kang, S., Veeravalli, B., Aung, K.M.M.: ESPRESSO: an encryption as a service for cloud storage systems. In: Sperotto, A., Doyen, G., Latré, S., Charalambides, M., Stiller, B. (eds.) AIMS 2014. LNCS, vol. 8508, pp. 15–28. Springer, Heidelberg (2014)

    Google Scholar 

  27. NIST: Announcing the Advanced Encryption Standard (AES) (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Technological Research Institute, SystemX, 8, Avenue de la Vauve, 91120, Palaiseau, France

    Makhlouf Hadji

Authors
  1. Makhlouf Hadji
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Makhlouf Hadji .

Editor information

Editors and Affiliations

  1. Dublin City University, Dublin 9, Ireland

    Markus Helfert

  2. Universitat Autònoma de Barcelona, Bellaterra, Spain

    Víctor Méndez Muñoz

  3. Dell, ROUND ROCK, USA

    Donald Ferguson

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Hadji, M. (2016). Scalable and Cost-Efficient Algorithms for Reliable and Distributed Cloud Storage. In: Helfert, M., Méndez Muñoz, V., Ferguson, D. (eds) Cloud Computing and Services Science. CLOSER 2015. Communications in Computer and Information Science, vol 581. Springer, Cham. https://doi.org/10.1007/978-3-319-29582-4_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-29582-4_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-29581-7

  • Online ISBN: 978-3-319-29582-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation