Cluster Computing

, Volume 17, Issue 1, pp 1–18

Optimizing I/O forwarding techniques for extreme-scale event tracing

  • Thomas Ilsche
  • Joseph Schuchart
  • Jason Cope
  • Dries Kimpe
  • Terry Jones
  • Andreas Knüpfer
  • Kamil Iskra
  • Robert Ross
  • Wolfgang E. Nagel
  • Stephen Poole
Article

DOI: 10.1007/s10586-013-0272-9

Cite this article as:
Ilsche, T., Schuchart, J., Cope, J. et al. Cluster Comput (2014) 17: 1. doi:10.1007/s10586-013-0272-9

Abstract

Programming development tools are a vital component for understanding the behavior of parallel applications. Event tracing is a principal ingredient to these tools, but new and serious challenges place event tracing at risk on extreme-scale machines. As the quantity of captured events increases with concurrency, the additional data can overload the parallel file system and perturb the application being observed. In this work we present a solution for event tracing on extreme-scale machines. We enhance an I/O forwarding software layer to aggregate and reorganize log data prior to writing to the storage system, significantly reducing the burden on the underlying file system. Furthermore, we introduce a sophisticated write buffering capability to limit the impact. To validate the approach, we employ the Vampir tracing toolset using these new capabilities. Our results demonstrate that the approach increases the maximum traced application size by a factor of 5× to more than 200,000 processes.

Keywords

Event tracingI/O forwardingAtomic append

Copyright information

© Springer Science + Business Media New York (outside the USA) 2013

Authors and Affiliations

  • Thomas Ilsche
    • 1
  • Joseph Schuchart
    • 3
  • Jason Cope
    • 2
  • Dries Kimpe
    • 2
  • Terry Jones
    • 3
  • Andreas Knüpfer
    • 1
  • Kamil Iskra
    • 2
  • Robert Ross
    • 2
  • Wolfgang E. Nagel
    • 1
  • Stephen Poole
    • 3
  1. 1.Technische Universität Dresden (ZIH)DresdenGermany
  2. 2.Argonne National LaboratoryArgonneUSA
  3. 3.Oak Ridge National LaboratoryOak RidgeUSA