Abstract
Recently, there have been many efforts to get high performance in cluster computing with inexpensive PCs connected through high-speed networks. Some of them were to provide high bandwidth and parallelism in file service using a distributed file system. Other researches for distributed file systems include the cooperative cache that reduces servers’ load and improves overall performance. The cooperative cache shares file caches among clients so that a client can request a file to another client, not to the server, through inter-client message passing. In various distributed file systems, PVFS (Parallel Virtual File System) provides high performance with parallel I/O in Linux widely used in cluster computing. However, PVFS doesn’t support any file cache facility. This paper describes the design and implementation of the cooperative cache for PVFS (Coopc-PVFS). We show the efficiency of Coopc-PVFS in comparison to original PVFS. As a result, the response time of Coopc-PVFS is shorter than or similar to that of original PVFS.
Chapter PDF
Similar content being viewed by others
References
Carns, P.H., Ligon III, W.B., Ross, R.B., Thakur, R.: PVFS: A Parallel File System For Linux Clusters. In: Proceedings of the 4th Annual Linux Showcase and Conference, Atlanta, GA, October 2000, pp. 317–327 (2000)
Ross, R.B.: Providing Parallel I/O on Linux Clusters. In: Second Annual Linux Storage Management Workshop, Miami, FL (October 2000)
Vilayannur, M., Kandemir, M., Sivasubramaniam, A.: Kernel-Level Caching for Optimizing I/O by Exploiting Inter-Application Data Sharing. In: IEEE International Conference on Cluster Computing (CLUSTER 2002) (September 2002)
Dahlin, M., Wang, R., Anderson, T., Patterson, D.: Cooperative Caching: Using remote client memory to improve file system performance. In: Proceedings of the First USENIX Symposium on Operating Systems Design and Implementation, USENIX Assoc., Berkeley, CA, pp. 267–280 (1994)
Feeley, M.J., Morgan, W.E., Pighin, F.H., Karlin, A.R., Levy, H.M.: Implementing global memory management in a workstation cluster. In: Proceedings of the 15th symposium on Operating System Principles(SOSP), pp. 201–212. ACM Press, New york (1995)
Sarkar, P., Hartman, J.: Efficient cooperative caching using hints. In: Proceedings of the second USENIX symposium on Operating systems design and implementation, Seattle, Washington, United States, October 29-November 01, pp. 35–46 (1996)
Linux Kernel Threads in Device Drivers, http://www.scs.ch/~frey/linux/kernelthreads.html
Can cluster, http://camars.kaist.ac.kr/~nrl
Wong, P., Van der Wijngaart, R.F.: NAS Parallel Benchmark I/O Version 2.4, NAS Technical Report NAS-03-002, NASA Ames Research Center, Moffett Field, CA 94035-1000
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hwang, IC. et al. (2004). Design and Implementation of the Cooperative Cache for PVFS. In: Bubak, M., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds) Computational Science - ICCS 2004. ICCS 2004. Lecture Notes in Computer Science, vol 3036. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24685-5_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-24685-5_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22114-2
Online ISBN: 978-3-540-24685-5
eBook Packages: Springer Book Archive