Chapter

Recent Advances in Parallel Virtual Machine and Message Passing Interface

Volume 5759 of the series Lecture Notes in Computer Science pp 164-173

Multiple-Level MPI File Write-Back and Prefetching for Blue Gene Systems

  • Javier García BlasAffiliated withLancaster UniversityUniversity Carlos III
  • , Florin IsailăAffiliated withLancaster UniversityUniversity Carlos III
  • , J. CarreteroAffiliated withLancaster UniversityUniversity Carlos III
  • , Robert LathamAffiliated withLancaster UniversityArgonne National Laboratory
  • , Robert RossAffiliated withLancaster UniversityArgonne National Laboratory

* Final gross prices may vary according to local VAT.

Get Access

Abstract

This paper presents the design and implementation of an asynchronous data-staging strategy for file accesses based on ROMIO, the most popular MPI-IO distribution, and ZeptoOS, an open source operating system solution for Blue Gene systems. We describe and evaluate a two-level file write-back implementation and a one-level prefetching solution. The experimental results demonstrate that both solutions achieve high performance through a high degree of overlap between computation, communication, and file I/O.

Keywords

MPI-IO Parallel I/O Parallel File Systems Supercomputers