A Profiling Approach for the Management of Writing in Irregular Applications

  • M. B. Ibáñez
  • F. García
  • J. Carretero
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4331)


Parallel file systems often work guided by APIs which provide hints to access storage in a coordinated manner. Nevertheless, the current APIs do not offer the expressiveness necessary to specify I/O operations conveniently in irregular applications. We characterize the state of irregular applications that precedes the performance degradation of the parallel file system and we propose a schedule based on profile information.


Access Pattern Critical Interval Critical Substance Standard Deviation Time Data Access Pattern 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Carns, P.H., Ligon III, W.B., Ross, R.B., Thakur, R.: PVFS: A Parallel File System for Linux Clusters. In: 4th Annual Linux Showcase and Conference, pp. 317–327 (2000)Google Scholar
  2. 2.
    Centro de Supercomputación y Visualización de Madrid (CeSViMa):
  3. 3.
    Ching, A., Choudgary, A., Liao, W.: Noncontiguous I/O through PVFS. In: Proceedings of the IEEE International Conference on Cluster Computing, pp. 405–414 (2002)Google Scholar
  4. 4.
    IBM.: IBM General Parallel File System High Performance Cluster File System,
  5. 5.
    The MPI Forum: MPI-2: Extensions to the Message-Passing Interface (1997)Google Scholar
  6. 6.
    Prost, J.-P., Treumann, R., Blackmore, R., Hartman, C., Hedges, R., Jia, B., Koniges, A., White, A.: Towards a High-Performance Implementation of MPI-IO on Top of GPFS. In: Bode, A., Ludwig, T., Karl, W.C., Wismüller, R. (eds.) Euro-Par 2000. LNCS, vol. 1900, pp. 1253–1262. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  7. 7.
    Purakayastha, A., Ellis, C.S., Kotz, D.: ENWRICH: A Compute-Processor Write Caching Scheme for Parallel File Systems. In: The Fourth Workshop on Input/Output in Parallel and Distributed Systems (IOPADS), pp. 55–68 (1996)Google Scholar
  8. 8.
    Schmuck, F., Haskin, R.: GPFS: A Shared-Disk File System for Large Computing Clusters. In: FAST 2002 Conference on File and Storage Technologies, pp. 231–244 (2002)Google Scholar
  9. 9.
    Thakur, R., Lusk, E., Gropp, W.: I/O in Parallel Applications: The Weakest Link. The International Journal of High Performance Computing Applications 12(4), 389–395 (1998)CrossRefGoogle Scholar
  10. 10.
    Thakur, R., Gropp, W., Lusk, E.: Data Sieving and Collective I/O in ROMIO. In: Proc. of the 7th Symposium on the Frontiers of Massively Parallel Computation, pp. 182–189 (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • M. B. Ibáñez
    • 1
  • F. García
    • 1
  • J. Carretero
    • 1
  1. 1.Departamento de InformáticaUniversidad Carlos III de MadridLeganés (Madrid)Spain

Personalised recommendations