Abstract
Parallel file systems employ data declustering to increase I/O throughput. As a result, a single read or write operation can generate concurrent data accesses on multiple storage devices. Unless a concurrency control mechanism is employed, familiar file access semantics are likely to be violated. This paper details the transaction-based concurrency control mechanism implemented in the PIOUS parallel file system. Performance results are presented demonstrating that sequential consistency semantics can be provided without loss of system scalability.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Philip Bernstein, Vassos Hadzilacos, and Nathan Goodman. Concurrency Control and Recovery in Database Systems, Addison-Wesley Publishing Company, 1987.
Peter F. Corbett and Dror G. Feitelson. Design and implementation of the Vesta parallel file system. In Proceedings of the Scalable High-Performance Computing Conference, pages 63–70,1994.
Thomas W. Crockett. File concepts for parallel I/O. In Proceedings of Super-computing’89, pages 574–579,1989.
Juan Miguel del Rosario and Alok Choudhary. High performance I/O for parallel computers: Problems and prospects. IEEE Computer, 27(3):59–68, March 1994.
James C. French, Terrence W. Pratt, and Mriganka Das. Performance measurement of a parallel input/output system for the Intel iPSC/2 hypercube. In Proceedings of the 1991 ACM Sigmetrics Conference on Measurement and Modeling of Computer Systems, pages 178–187,1991.
G. A. Geist and V. S. Sunderam. Network-based concurrent computing on the PVM system. Concurrency: Practice and Experience, 4(4): 293–311, June 1992.
David Kotz. Disk-directed I/O for MIMD multiprocessors. Technical Report PCS-TR94–226, Dept. of Computer Science, Dartmouth College, July 1994. Revised November 8,1994.
David Kotz and Nils Nieuwejaar. Dynamic file-access characteristics of a production parallel scientific workload. In Proceedings of Supercomputing’94, pages 640–649, November 1994.
Leslie Lamport. How to make a multiprocessor computer that correctly executes multiprocess programs. IEEE Transactions on Computers, C-28(9): 690–691, September 1979.
Steven A. Moyer and V. S. Sunderam. A parallel I/O system for high-performance distributed computing. In Proceedings of the IFIP WG10.3 Working Conference on Programming Environments for Massively Parallel Distributed Systems, 1994.
Steven A. Moyer and V. S. Sunderam. PIOUS: a scalable parallel I/O system for distributed computing environments. In Proceedings of the Scalable High-Performance Computing Conference, pages 71–78,1994.
Steven A. Moyer and V. S. Sunderam. PIOUS for PVM: User’s Guide and Reference Manual - Version 1, 1995. Software and documentation available via the PIOUS home page at http://www.mathcs.emory.edu/pious.html.
Paul Pierce. A concurrent file system for a highly parallel mass storage system. In Fourth Conference on Hypercube Concurrent Computers and Applications, pages 155–160,1989.
Kenneth Salem and Hector Garcia-Molina. Disk striping. In IEEE 1986 Conference on Data Engineering, pages 336–342,1986.
V. S. Sunderam. PVM: A framework for parallel distributed computing. Concurrency: Practice and Experience, 2(4): 315–339, December 1990.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1996 Kluwer Academic Publishers
About this chapter
Cite this chapter
Moyer, S.A., Sunderam, V.S. (1996). Scalable Concurrency Control for Parallel File Systems. In: Jain, R., Werth, J., Browne, J.C. (eds) Input/Output in Parallel and Distributed Computer Systems. The Kluwer International Series in Engineering and Computer Science, vol 362. Springer, Boston, MA. https://doi.org/10.1007/978-1-4613-1401-1_10
Download citation
DOI: https://doi.org/10.1007/978-1-4613-1401-1_10
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4612-8607-3
Online ISBN: 978-1-4613-1401-1
eBook Packages: Springer Book Archive