Abstract
Distributed file storage provides reliable access to data through redundancy spread on distributed nodes. Various application scenarios emerge, such as include data centers, storage in wireless networks and peer-to-peer storage systems. Storing data by using code, such as an erasure code, calls for less redundancy compared with simple replication in terms of reliability. Nevertheless, since data fragments are periodically replaced when some nodes fail, a key acute question is how to generate encoded data fragments in a distributed way when transferring as little data as possible over the network. For a coded system, a new node to repair from a node failure is to download subsets of data from some surviving nodes, reconstructs some lost coded blocks by using the downloaded fragments, and stores them at the new node. This procedure is not optimal. In this paper, we introduce blockchain to protect distributed data in terms of node failure and etc. We show that blockchain can significantly improve the integrity and credibility in distributed file storage systems. Furthermore, we harvest theory discovery of blockchain in distributed file storage system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Rhea, S., et al.: Maintenance-free global data storage. IEEE Internet Comput. 5, 40–49 (2001)
Bhagwan, R., Tati, K., Cheng, Y.-C., Savage, S., Voelker, G.M.: Total recall: system support for automated availability management. In: NSDI (2004)
Dabek, F., Li, J., Sit, E., Robertson, J., Kaashoek, M., Morris, R.: Designing a DHT for low latency and high throughput (2004)
Dimakis, A.G., Prabhakaran, V., Ramchandran, K.: Decentralized erasure codes for distributed networked storage. IEEE Trans. Inf. Theory 52(6), 2809–2816 (2006)
Kamra, A., Feldman, J., Misra, V., Rubenstein, D.: Growth codes: maximizing sensor network data persistence. In: ACM SIGCOMM (2006)
Rhea, S., Eaton, P., Geels, D., Weatherspoon, H., Zhao, B., Kubiatowicz, J.: Pond: the OceanStore prototype. In: Proceedings of USENIX File and Storage Technologies (FAST) (2003)
Weatherspoon, H., Kubiatowicz, J.D.: Erasure coding vs. replication: a quantitiative comparison. In: Proceedings of IPTPS (2002)
Gkantsidis, C., Rodriguez, P.: Cooperative security for network coding file distribution. In: IEEE INFOCOM (2006)
Ho, T., Leong, B., Koetter, R., Meard, M., Effros, M., Karger, D.: Byzantine modification detection in multicast networks using randomized network coding. In: ISIT (2004)
Jaggi, S., Langberg, M., Katti, S., Ho, T., Katabi, D., Meard, M.: Resilient network coding in the presence of Byzantine adversaries. In: IEEE INFOCOM (2007)
Krohn, M.N., Freedman, M.J., Mazieres, D.: On-the-fly verification of rateless erasure codes for efficient content distribution. In: Proceedings of the IEEE Symposium on Security and Privacy, Berkeley, CA, USA, 9–12 May 2004, pp. 226–240 (2004)
Bolosky, W.J., Douceur, J.R., Ely, D., Theimer, M.: Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs. In: Proceedings of SIGMETRICS (2000)
Dabek, F., Kaashoek, F., Karger, D., Morris, R., Stoica, I.: Wide-area cooperative storage with CFS. In: Proceedings of ACM SOSP (2001)
Rowstron, A., Druschel, P.: Storage management and caching in past, a large-scale, persistent peer-to-peer storage utility. In: Proceedings of ACM SOSP (2001)
Weatherspoon, H., Chun, B.-G., So, C.W., Kubiatowicz, J.: Long-term data maintenance in wide-area storage systems: a quantitative approach, Technical report, UC Berkeley, UCB/CSD-05-1404, July 2005
Blake, C., Rodrigues, R.: High availability, scalable storage, dynamic peer networks: pick two. In: Proceedings of HOTOS (2003)
Chun, B.-G., et al.: Efficient replica maintenance for distributed storage systems. In: NSDI (2006)
Tati, K., Voelker, G.M.: On object maintenance in peer-to-peer systems. In: Proceedings of IPTPS (2006)
Godfrey, P.B., Shenker, S., Stoica, I.: Minimizing churn in distributed systems. In: Proceedings of ACM SIGCOMM (2006)
Swan, M.: Blockchain: Blueprint for a New Economy. O’Reilly Media Inc., Newton (2015)
Bitcoin, N.S.: A peer-to-peer electronic cash system. Consulted 1(2012), 28 (2008)
Kondor, D., Pósfai, M., Csabai, I., Vattay, G.: Do the rich get richer? An empirical analysis of the Bitcoin transaction network. PloS One 9(2), e86197 (2014). https://doi.org/10.1371/journal.pone.0086197. PMID: 24505257
Maymounkov, P., Mazières, D.: Kademlia: a peer-to-peer information system based on the XOR metric. In: Druschel, P., Kaashoek, F., Rowstron, A. (eds.) IPTPS 2002. LNCS, vol. 2429, pp. 53–65. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-45748-8_5
Vickrey, W.: Counterspeculation, auctions, and competitive sealed tenders. J. Finance 16, 8–37 (1961)
Wood, G.: Ethereum: a secure decentralized transaction ledger. http://gavwood.com/paper.pdf
Ben-Sasson, E., et al.: Zerocash: decentralized anonymous payments from Bitcoin. In: S&P (2014)
Nakamoto, S.: Bitcoin: a peer-to-peer electronic cash system. Consulted 1(2012), 28 (2008)
Cleve, R.: Limits on the security of coin flips when half the processors are faulty. In: STOC (1986)
Asharov, G., Beimel, A., Makriyannis, N., Omri, E.: Complete characterization of fairness in secure two-party computation of boolean functions. In: Dodis, Y., Nielsen, J.B. (eds.) TCC 2015. LNCS, vol. 9014, pp. 199–228. Springer, Heidelberg (2015). https://doi.org/10.1007/978-3-662-46494-6_10
Bentov, I., Kumaresan, R.: How to use bitcoin to design fair protocols. In: Garay, J.A., Gennaro, R. (eds.) CRYPTO 2014. LNCS, vol. 8617, pp. 421–439. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-662-44381-1_24
Kumaresan, R., Bentov, I.: How to use bitcoin to incentivize correct computations. In: CCS (2014)
Acknowledgments
This work is supported by the Open Research Fund of Key Laboratory of Network Crime Investigation of Hunan Provincial Colleges under granted No. 2017W-LZC005, and the Science and Technology Projects of Hunan Province of China under granted No. 2017SK1040.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Ning, Z., Li, L., Liang, W., Zhao, Y., Fu, Q., Chen, H. (2020). A Novel Exploration for Blockchain in Distributed File Storage. In: Zheng, Z., Dai, HN., Tang, M., Chen, X. (eds) Blockchain and Trustworthy Systems. BlockSys 2019. Communications in Computer and Information Science, vol 1156. Springer, Singapore. https://doi.org/10.1007/978-981-15-2777-7_60
Download citation
DOI: https://doi.org/10.1007/978-981-15-2777-7_60
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-2776-0
Online ISBN: 978-981-15-2777-7
eBook Packages: Computer ScienceComputer Science (R0)