Implementing Fast and Reusable Datatype Processing

  • Robert Ross
  • Neill Miller
  • William D. Gropp
Conference paper

DOI: 10.1007/978-3-540-39924-7_55

Part of the Lecture Notes in Computer Science book series (LNCS, volume 2840)
Cite this paper as:
Ross R., Miller N., Gropp W.D. (2003) Implementing Fast and Reusable Datatype Processing. In: Dongarra J., Laforenza D., Orlando S. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2003. Lecture Notes in Computer Science, vol 2840. Springer, Berlin, Heidelberg

Abstract

Methods for describing structured data are a key aid in application development. The MPI standard defines a system for creating “MPI types” at run time and using these types when passing messages, performing RMA operations, and accessing data in files. Similar capabilities are available in other middleware. Unfortunately many implementations perform poorly when processing these structured data types. This situation leads application developers to avoid these components entirely, instead performing any necessary data processing by hand.

In this paper we describe an internal representation of types and a system for processing this representation that helps maintain the highest possible performance during processing. The performance of this system, used in the MPICH2 implementation, is compared to well-written manual processing routines and other available MPI implementations. We show that performance for most tested types is comparable to manual processing. We identify additional opportunities for optimization and other software where this implementation can be leveraged.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Robert Ross
    • 1
  • Neill Miller
    • 1
  • William D. Gropp
    • 1
  1. 1.Argonne National LaboratoryMathematics and Computer Science DivisionArgonneUSA

Personalised recommendations