Automatic Memory Optimizations for Improving MPI Derived Datatype Performance

  • Surendra Byna
  • Xian-He Sun
  • Rajeev Thakur
  • William Gropp
Conference paper

DOI: 10.1007/11846802_36

Part of the Lecture Notes in Computer Science book series (LNCS, volume 4192)
Cite this paper as:
Byna S., Sun XH., Thakur R., Gropp W. (2006) Automatic Memory Optimizations for Improving MPI Derived Datatype Performance. In: Mohr B., Träff J.L., Worringen J., Dongarra J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2006. Lecture Notes in Computer Science, vol 4192. Springer, Berlin, Heidelberg

Abstract

MPI derived datatypes allow users to describe noncontiguous memory layout and communicate noncontiguous data with a single communication function. This powerful feature enables an MPI implementation to optimize the transfer of noncontiguous data. In practice, however, many implementations of MPI derived datatypes perform poorly, which makes application developers avoid using this feature. In this paper, we present a technique to automatically select templates that are optimized for memory performance based on the access pattern of derived datatypes. We implement this mechanism in the MPICH2 source code. The performance of our implementation is compared to well-written manual packing/unpacking routines and original MPICH2 implementation. We show that performance for various derived datatypes is significantly improved and comparable to that of optimized manual routines.

Keywords

MPI derived datatypes MPI performance optimization 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Surendra Byna
    • 1
  • Xian-He Sun
    • 1
  • Rajeev Thakur
    • 2
  • William Gropp
    • 2
  1. 1.Department of Computer ScienceIllinois Institute of TechnologyChicagoUSA
  2. 2.Math. and Computer Science DivisionArgonne National LaboratoryArgonneUSA

Personalised recommendations