Multiple-Level MPI File Write-Back and Prefetching for Blue Gene Systems

  • Javier García Blas
  • Florin Isailă
  • J. Carretero
  • Robert Latham
  • Robert Ross
Conference paper

DOI: 10.1007/978-3-642-03770-2_23

Volume 5759 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Blas J.G., Isailă F., Carretero J., Latham R., Ross R. (2009) Multiple-Level MPI File Write-Back and Prefetching for Blue Gene Systems. In: Ropo M., Westerholm J., Dongarra J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2009. Lecture Notes in Computer Science, vol 5759. Springer, Berlin, Heidelberg

Abstract

This paper presents the design and implementation of an asynchronous data-staging strategy for file accesses based on ROMIO, the most popular MPI-IO distribution, and ZeptoOS, an open source operating system solution for Blue Gene systems. We describe and evaluate a two-level file write-back implementation and a one-level prefetching solution. The experimental results demonstrate that both solutions achieve high performance through a high degree of overlap between computation, communication, and file I/O.

Keywords

MPI-IO Parallel I/O Parallel File Systems Supercomputers 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Javier García Blas
    • 1
  • Florin Isailă
    • 1
  • J. Carretero
    • 1
  • Robert Latham
    • 2
  • Robert Ross
    • 2
  1. 1.University Carlos IIISpain
  2. 2.Argonne National Laboratory