Skip to main content
SpringerLink
Log in

A Prefetching Mechanism Based on MooseFS

  • Conference paper
  • First Online:
Trustworthy Computing and Services (ISCTCS 2013)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 426))

Included in the following conference series:

Abstract

The MooseFS (MFS) distributed file system doesn’t have a prefetching operation for reading large files. It has affected the performance of reading files. Aiming at this problem, we improve the performance of sequential reading process for MFS. We present a prefetching mechanism: when the client sends the sequential data reading request to the chunkserver, MFS activates the prefetching mechanism. MFS improves the amount of transferred data for each time from the original 128 KB to 4 MB, and uses the timestamp to empty the cache. The experimental results show that for large file reading operation, the improved MFS (MFS-prefetch) shortens the operating time and response time, and improves the throughput of MFS.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. http://www.csdn.net/article/a/2011-05-19/298203

  2. Ghemawat, S., Gobioff, H., Leung, S.T.: The Google file system. In: SOSP ‘03 Proceedings of the Nineteenth ACM Symposium on Operating Systems Principles, vol. 37, Issue 5, pp. 29–43, Dec 2003

    Google Scholar 

  3. Yu, J., Wu, W., Li, H.: DMooseFS: design and implementation of distributed files system with distributed metadata server. In: 2012 IEEE Asia Pacific Cloud Computing Congress (APCloudCC)

    Google Scholar 

  4. http://www.cnblogs.com/oubo/archive/2012/05/04/2482893.html

  5. Installing MooseFS Step by Step Tutorial. http://www.moosefs.org/

  6. Yang, J., Jiang, F., Li, L.: Optimal design of file system on embedded system. Comput. Technol. Its Appl. 12, 141–144 (2007)

    Google Scholar 

  7. http://www.51testing.com/?uid-88979-action-spacelist-type-blog-itemtypeid-5864

  8. Rajaraman, A., Ullman, J.D.: Mining of Massive Datasets. Cambridge University Press, Cambridge (2011)

    Google Scholar 

Download references

Acknowledgement

This research was supported by National Science and Technology Major Project 2012ZX03002001.

Author information

Authors and Affiliations

  1. Qihoo 360 Technology CO. Ltd., Beijing, 100025, China

    Xiaohong Shi

  2. School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing, China

    Ying Ji, Hui Xie & Yueming Lu

  3. Key Laboratory of Trustworthy Distributed Computing and Service (BUPT), Ministry of Education, Beijing, China

    Ying Ji, Hui Xie & Yueming Lu

Authors
  1. Xiaohong Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ying Ji
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hui Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yueming Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ying Ji .

Editor information

Editors and Affiliations

  1. Beijing University of Posts and Telecommunications, Beijing, China

    Yuyu Yuan

  2. Beijing University of Posts and Telecommunications, Beijing, China

    Xu Wu

  3. Beijing University of Posts and Telecommunications, Beijing, China

    Yueming Lu

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Shi, X., Ji, Y., Xie, H., Lu, Y. (2014). A Prefetching Mechanism Based on MooseFS. In: Yuan, Y., Wu, X., Lu, Y. (eds) Trustworthy Computing and Services. ISCTCS 2013. Communications in Computer and Information Science, vol 426. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-43908-1_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-43908-1_19

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-43907-4

  • Online ISBN: 978-3-662-43908-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation