Abstract
pCFS is a highly available parallel, symmetrical (where nodes perform both compute and I/O work) cluster file system that we have designed to run in medium-sized clusters. In this paper, using exactly the same hardware and Linux version across all nodes we compare pCFS with two distinct configurations of PVFS: one using internal disks, and therefore not able to provide any tolerance against disk and/or I/O node failures, and another where PVFS I/O servers access LUNs in a disk array and thus provide high availability (in the following named HA-PVFS). We start by measuring I/O bandwidth and CPU consumption of PVFS and HA-PVFS setups; then, the same set of tests is performed with pCFS. We conclude that, when using the same hardware, pCFS compares very favourably with HA-PVFS, offering the same or higher I/O bandwidths at a much lower CPU consumption.
Chapter PDF
References
Carns, P., et al.: PVFS: A Parallel File System for Linux Clusters. In: Proceedings of the 4th Annual Linux Showcase and Conference, pp. 317–327 (2000)
Braam, P.: The Lustre storage architecture. Technical Report, Cluster File Systems, Inc. (2003), http://www.lustre.org
Soltis, S.: The Design and Implementation of a Distributed File System based on Shared Network Storage. PhD thesis, University of Minnesota Graduate School (1997)
Fasheh, M.: OCFS2: The Oracle Clustered File System, Version 2. In: Proceedings of the Linux Symposium (2006)
Schmuk, F., Haskin, R.: GPFS: A Shared-Disk File System for Large Computing Clusters. In: Proceedings of the Conference on File and Storage Technologies (FAST 2002), pp. 231–244 (2002)
Lopes, P., Medeiros, P.: pCFS: A Parallel Cluster File System. In: Proceedings of the International Conference ParCO 2005, pp. 515–522 (2005)
Lopes, P., Medeiros, P.: Cooperative Caching in the pCFS parallel Cluster File System. In: Proceedings of the 15th IEEE International Symposium on High Performance Distributed Computing (2006)
Lopes, P., Medeiros, P.: Enhancing write performance of a shared-disk cluster filesystem through a fine-grained locking strategy. In: Proceedings of the Second International Workshop on High Performance I/O Systems and Data Intensive Computing (HiperIO 2008), Co-located with the IEEE International Conference on Cluster Computing 2008 (2008)
Anderson, T., et al.: Serverless Network File Systems. ACM Transactions on Computer Systems 14(1) (1996)
Capps, D., et al.: Iozone Filesystem Benchmark, http://www.iozone.org
Netperf, http://www.netperf.org
Kronenberg, N., et al.: VAXclusters: A Closely-Coupled Distributed System. ACM Transactions on Computer Systems 4(2), 130–146 (1986)
The Transparent Inter-Process Communication (TIPC), http://tipc.sourceforge.net
Morin, C., et al.: Towards an efficient single system image cluster operating system. Journal of Future Generation Computer Systems 20(4), 505–521 (2004)
Lopes, P.: A Shared-Disk Parallel Cluster File System. PhD Thesis, Department of Informatics, Faculty of Science and Technology, Universidade Nova de Lisboa (2009)
Thakur, R., et al.: Users Guide for ROMIO: A High-Performance, Portable MPI-IO Implementation. Technical Memorandum No. 234, Mathematics and Computer Science Division, Argonne National Laboratory (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lopes, P.A., Medeiros, P.D. (2010). pCFS vs. PVFS: Comparing a Highly-Available Symmetrical Parallel Cluster File System with an Asymmetrical Parallel File System. In: D’Ambra, P., Guarracino, M., Talia, D. (eds) Euro-Par 2010 - Parallel Processing. Euro-Par 2010. Lecture Notes in Computer Science, vol 6271. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15277-1_13
Download citation
DOI: https://doi.org/10.1007/978-3-642-15277-1_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15276-4
Online ISBN: 978-3-642-15277-1
eBook Packages: Computer ScienceComputer Science (R0)