Recent Advances in Parallel Virtual Machine and Message Passing Interface

Volume 3241 of the series Lecture Notes in Computer Science pp 87-96

The Impact of File Systems on MPI-IO Scalability

  • Rob LathamAffiliated withLancaster UniversityArgonne National Laboratory
  • , Rob RossAffiliated withLancaster UniversityArgonne National Laboratory
  • , Rajeev ThakurAffiliated withLancaster UniversityArgonne National Laboratory

* Final gross prices may vary according to local VAT.

Get Access


As the number of nodes in cluster systems continues to grow, leveraging scalable algorithms in all aspects of such systems becomes key to maintaining performance. While scalable algorithms have been applied successfully in some areas of parallel I/O, many operations are still performed in an uncoordinated manner. In this work we consider, in three file system scenarios, the possibilities for applying scalable algorithms to the many operations that make up the MPI-IO interface. From this evaluation we extract a set of file system characteristics that aid in developing scalable MPI-IO implementations.