Skip to main content

Analysis of the MPI-IO Optimization Levels with the PIOViz Jumpshot Enhancement

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 4757))

Abstract

With MPI-IO we see various alternatives for programming file I/O. The overall program performance depends on many different factors. A new trace analysis environment provides deeper insight into the client/server behavior and visualizes events of both process types. We investigate the influence of making independent vs. collective calls together with access to contiguous and non-contiguous data regions in our MPI-IO program. Combined client and server traces exhibit reasons for observed I/O performance.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. APART (Homepage), http://www.kfa-juelich.de/apart/

  2. Gropp, W., Lusk, E., Thakur, R.: Using MPI-2 — Advanced Features of the Message-Passing Interface. The MIT Press, Cambridge (1999)

    Book  Google Scholar 

  3. Intel Trace Analyzer & Collector (Home page), http://www.intel.com/cd/software/products/asmo-na/eng/cluster/tanalyzer/

  4. Vampir (Home page), http://www.vampir.eu/

  5. Krempel, S.: Tracing Connections Between MPI Calls and Resulting PVFS2 Disk Operations, Bachelor’s Thesis, Ruprecht-Karls-Universität Heidelberg, Germany (2006)

    Google Scholar 

  6. Kunkel, J., Ludwig, T.: Performance Evaluation of the PVFS2 Architecture. In: Proceedings of the PDP, Naples, Italy (2007)

    Google Scholar 

  7. Ludwig, T., et al.: Tracing the MPI-IO Calls’ Disk Accesses. In: European PVM/MPI User’s Group Meeting, Bonn, Germany, pp. 322–330. Springer, Berlin (2006)

    Google Scholar 

  8. Ludwig, T.: Research Trends in High Performance Parallel Input/Output for Cluster Environments. In: Proceedings of the 4th International Scientific and Practical Conference on Programming UkrPROG’2004, National Academy of Sciences of Ukraine, Kiev, Ukraine pp. 274–281 (2004)

    Google Scholar 

  9. Miller, B.P., et al.: The Paradyn Parallel Performance Measurement Tool. IEEE Computer. Special issue on performance evaluation tools for parallel and distributed computer systems 28(11), 37–46 (1995)

    Google Scholar 

  10. MPICH2 home page (Home page). http://www-unix.mcs.anl.gov/mpi/mpich2/index.htm

  11. Panse, F.: Extended Tracing Capabilities and Optimization of the PVFS2 Event Logging Management, Diploma Thesis, Ruprecht-Karls-Universität Heidelberg, Germany (2006)

    Google Scholar 

  12. Paradyn Parallel Performance Tools (Home page), http://www.paradyn.org/index.html

  13. Performance Visualization for Parallel Programs (Home page), http://www-unix.mcs.anl.gov/perfvis/

  14. Shende, S., Malony, A.: The Tau Parallel Performance System. International Journal of High Performance Computing Applications 20, 287–311 (2006)

    Article  Google Scholar 

  15. TAU – Tuning and Analysis Utilities (Home page), http://www.cs.uoregon.edu/research/tau/

  16. Thakur, R., Lusk, E., Gropp, W.: Users Guide for ROMIO: A High-Performance, Portable MPI-IO Implementation. Technical Memorandum ANL/MCS-TM-234, Mathematics and Computer Science Division, Argonne National Laboratory, Revised (July 1998)

    Google Scholar 

  17. The Parallel Virtual File System – Version 2 (Home page), http://www.pvfs.org/pvfs2/

  18. The PVFS2 Development Team: PVFS2 Internal Documentation included in the source code package (2006)

    Google Scholar 

  19. Withanage, D.: Performance Visualization for the PVFS2 Environment, Bachelor’s Thesis, Ruprecht-Karls-Universität Heidelberg, Germany (November 2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Franck Cappello Thomas Herault Jack Dongarra

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ludwig, T., Krempel, S., Kuhn, M., Kunkel, J., Lohse, C. (2007). Analysis of the MPI-IO Optimization Levels with the PIOViz Jumpshot Enhancement. In: Cappello, F., Herault, T., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2007. Lecture Notes in Computer Science, vol 4757. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75416-9_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-75416-9_32

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-75415-2

  • Online ISBN: 978-3-540-75416-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics