Abstract
The MooseFS (MFS) distributed file system doesn’t have a prefetching operation for reading large files. It has affected the performance of reading files. Aiming at this problem, we improve the performance of sequential reading process for MFS. We present a prefetching mechanism: when the client sends the sequential data reading request to the chunkserver, MFS activates the prefetching mechanism. MFS improves the amount of transferred data for each time from the original 128 KB to 4 MB, and uses the timestamp to empty the cache. The experimental results show that for large file reading operation, the improved MFS (MFS-prefetch) shortens the operating time and response time, and improves the throughput of MFS.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. In: SOSP ‘03 Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles, vol. 37, Issue 5, pp. 29–43, Dec 2003
Yu, J., Wu, W., Li, H.: DMooseFS: design and implementation of distributed files system with distributed metadata server. In: 2012 IEEE Asia Pacific Cloud Computing Congress (APCloudCC)
Installing MooseFS Step by Step Tutorial. http://www.moosefs.org/
Yang, J., Jiang, F., Li, L.: Optimal design of file system on embedded system. Comput. Technol. Its Appl. 12, 141–144 (2007)
http://www.51testing.com/?uid-88979-action-spacelist-type-blog-itemtypeid-5864
Rajaraman, A., Ullman, J.D.: Mining of Massive Datasets. Cambridge University Press, Cambridge (2011)
Acknowledgement
This research was supported by National Science and Technology Major Project 2012ZX03002001.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shi, X., Ji, Y., Xie, H., Lu, Y. (2014). A Prefetching Mechanism Based on MooseFS. In: Yuan, Y., Wu, X., Lu, Y. (eds) Trustworthy Computing and Services. ISCTCS 2013. Communications in Computer and Information Science, vol 426. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-43908-1_19
Download citation
DOI: https://doi.org/10.1007/978-3-662-43908-1_19
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-43907-4
Online ISBN: 978-3-662-43908-1
eBook Packages: Computer ScienceComputer Science (R0)