Skip to main content
SpringerLink
Log in
Book cover

Input/Output in Parallel and Distributed Computer Systems pp 225–243Cite as

Scalable Concurrency Control for Parallel File Systems

  • Chapter

Part of the book series: The Kluwer International Series in Engineering and Computer Science ((SECS,volume 362))

Abstract

Parallel file systems employ data declustering to increase I/O throughput. As a result, a single read or write operation can generate concurrent data accesses on multiple storage devices. Unless a concurrency control mechanism is employed, familiar file access semantics are likely to be violated. This paper details the transaction-based concurrency control mechanism implemented in the PIOUS parallel file system. Performance results are presented demonstrating that sequential consistency semantics can be provided without loss of system scalability.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Philip Bernstein, Vassos Hadzilacos, and Nathan Goodman. Concurrency Control and Recovery in Database Systems, Addison-Wesley Publishing Company, 1987.

    Google Scholar 

  2. Peter F. Corbett and Dror G. Feitelson. Design and implementation of the Vesta parallel file system. In Proceedings of the Scalable High-Performance Computing Conference, pages 63–70,1994.

    Chapter  Google Scholar 

  3. Thomas W. Crockett. File concepts for parallel I/O. In Proceedings of Super-computing’89, pages 574–579,1989.

    Google Scholar 

  4. Juan Miguel del Rosario and Alok Choudhary. High performance I/O for parallel computers: Problems and prospects. IEEE Computer, 27(3):59–68, March 1994.

    Google Scholar 

  5. James C. French, Terrence W. Pratt, and Mriganka Das. Performance measurement of a parallel input/output system for the Intel iPSC/2 hypercube. In Proceedings of the 1991 ACM Sigmetrics Conference on Measurement and Modeling of Computer Systems, pages 178–187,1991.

    Google Scholar 

  6. G. A. Geist and V. S. Sunderam. Network-based concurrent computing on the PVM system. Concurrency: Practice and Experience, 4(4): 293–311, June 1992.

    Article  Google Scholar 

  7. David Kotz. Disk-directed I/O for MIMD multiprocessors. Technical Report PCS-TR94–226, Dept. of Computer Science, Dartmouth College, July 1994. Revised November 8,1994.

    Google Scholar 

  8. David Kotz and Nils Nieuwejaar. Dynamic file-access characteristics of a production parallel scientific workload. In Proceedings of Supercomputing’94, pages 640–649, November 1994.

    Google Scholar 

  9. Leslie Lamport. How to make a multiprocessor computer that correctly executes multiprocess programs. IEEE Transactions on Computers, C-28(9): 690–691, September 1979.

    Article  Google Scholar 

  10. Steven A. Moyer and V. S. Sunderam. A parallel I/O system for high-performance distributed computing. In Proceedings of the IFIP WG10.3 Working Conference on Programming Environments for Massively Parallel Distributed Systems, 1994.

    Google Scholar 

  11. Steven A. Moyer and V. S. Sunderam. PIOUS: a scalable parallel I/O system for distributed computing environments. In Proceedings of the Scalable High-Performance Computing Conference, pages 71–78,1994.

    Chapter  Google Scholar 

  12. Steven A. Moyer and V. S. Sunderam. PIOUS for PVM: User’s Guide and Reference Manual - Version 1, 1995. Software and documentation available via the PIOUS home page at http://www.mathcs.emory.edu/pious.html.

    Google Scholar 

  13. Paul Pierce. A concurrent file system for a highly parallel mass storage system. In Fourth Conference on Hypercube Concurrent Computers and Applications, pages 155–160,1989.

    Google Scholar 

  14. Kenneth Salem and Hector Garcia-Molina. Disk striping. In IEEE 1986 Conference on Data Engineering, pages 336–342,1986.

    Google Scholar 

  15. V. S. Sunderam. PVM: A framework for parallel distributed computing. Concurrency: Practice and Experience, 2(4): 315–339, December 1990.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Transarc Corporation, 707 Grant Street, Pittsburgh, PA, 15219, USA

    Steven A. Moyer

  2. Department of Mathematics and Computer Science, Emory University, Atlanta, GA, 30322, USA

    V. S. Sunderam

Authors
  1. Steven A. Moyer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. V. S. Sunderam
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Bell Communications Research, Morristown, New Jersey, USA

    Ravi Jain

  2. University of Texas at Austin, Austin, Texas, USA

    John Werth  & James C. Browne  & 

Rights and permissions

Reprints and permissions

Copyright information

© 1996 Kluwer Academic Publishers

About this chapter

Cite this chapter

Moyer, S.A., Sunderam, V.S. (1996). Scalable Concurrency Control for Parallel File Systems. In: Jain, R., Werth, J., Browne, J.C. (eds) Input/Output in Parallel and Distributed Computer Systems. The Kluwer International Series in Engineering and Computer Science, vol 362. Springer, Boston, MA. https://doi.org/10.1007/978-1-4613-1401-1_10

Download citation

  • DOI: https://doi.org/10.1007/978-1-4613-1401-1_10

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4612-8607-3

  • Online ISBN: 978-1-4613-1401-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation