Abstract
Cloud distributed system has undergone substantial changes in the past few years, to aim for a more reliable and cost-effective operation. In this paper, we would be focusing on automation of distributed persistent storage system that is a major problem as we are shifting toward containerization. Various systems have been developed that support management of distributed storage. However, these systems fail to manage and are easily scalable in case of failure. In this paper, a smart distributed storage automation system (DSAS) has been proposed that is capable to perform healthy fault detection and fix in a distributed persistent storage system using Kubernetes architecture for distributed system and Ceph Architecture for managing distributed storage. We would be using their existing functionality and extend it using Kubernetes operator. Moreover, provides easy portability, self-reliability, self-scalability, and robustness.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wu H (2008) Research on the data storage and access model in distributed computing environment. In: Third international conference on convergence and hybrid information technology, Busan, Nov 2008
Merkel D (2014) Docker: lightweight linux containers for consistent development and deployment. Int J Linux J 239:2014
Sinnott RO, Voorsluys W (2016) A scalable cloud-based system for data-intensive spatial analysis. Int J Softw Tools Technol Transf 18(6):587–605
Armbrust M, Fox A, Griffith R, Joseph AD, Katz R, Konwinski A, Lee G, Patterson D, Rabkin A, Stoica I, Zaharia M (2010) A view of cloud computing. Commun ACM 53(4):50–58
Annual Container adoption Survey [Online]. Available https://portworx.com/2017-container-adoption-survey/
Burns B, Grant B, Oppenheimer D, Brewer E, Wilkes J (2016) Borg, Omega, and Kubernetes. ACM Queue 14:70–93
Google Cloud Platform, Container engine [Online]. Available https://cloud.google.com/container-engine/. Accessed on 25 Feb 2016
Kubernetes [Online]. Available https://kubernetes.io/
Kubernetes Architecture [Online]. Available https://x-team.com/blog/introduction-kubernetes-architecture/
Weil SA, Brandt SA, Miller EL, Maltzhan C (2006) A scalable, high-performance distributed file system. In: 7th Conference on Operating Systems Design and Implementation (OSDI’06), Nov 2006
Weil SA, Brandt SA, Miller EL (2006) CRUSH: controlled, scalable, decentralized placement of replicated data. In: Proceedings of SC’06, Nov 2006
Weil SA, Leung AW, Brandt SA (2007) RADOS: a fast, scalable, and reliable storage service for petabyte-scale storage clusters, petascale data storage workshop SC07, Nov 2007
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Sharma, A., Yadav, S., Gupta, N., Dhall, S., Rastogi, S. (2020). Proposed Model for Distributed Storage Automation System Using Kubernetes Operators. In: Jain, V., Chaudhary, G., Taplamacioglu, M., Agarwal, M. (eds) Advances in Data Sciences, Security and Applications. Lecture Notes in Electrical Engineering, vol 612. Springer, Singapore. https://doi.org/10.1007/978-981-15-0372-6_27
Download citation
DOI: https://doi.org/10.1007/978-981-15-0372-6_27
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-0371-9
Online ISBN: 978-981-15-0372-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)