Noncollective Communicator Creation in MPI

  • James Dinan
  • Sriram Krishnamoorthy
  • Pavan Balaji
  • Jeff R. Hammond
  • Manojkumar Krishnan
  • Vinod Tipparaju
  • Abhinav Vishnu
Conference paper

DOI: 10.1007/978-3-642-24449-0_32

Part of the Lecture Notes in Computer Science book series (LNCS, volume 6960)
Cite this paper as:
Dinan J. et al. (2011) Noncollective Communicator Creation in MPI. In: Cotronis Y., Danalis A., Nikolopoulos D.S., Dongarra J. (eds) Recent Advances in the Message Passing Interface. EuroMPI 2011. Lecture Notes in Computer Science, vol 6960. Springer, Berlin, Heidelberg

Abstract

MPI communicators abstract communication operations across application modules, facilitating seamless composition of different libraries. In addition, communicators provide the ability to form groups of processes and establish multiple levels of parallelism. Traditionally, communicators have been collectively created in the context of the parent communicator. The recent thrust toward systems at petascale and beyond has brought forth new application use cases, including fault tolerance and load balancing, that highlight the ability to construct an MPI communicator in the context of its new process group as a key capability. However, it has long been believed that MPI is not capable of allowing the user to form a new communicator in this way. We present a new algorithm that allows the user to create such flexible process groups using only the functionality given in the current MPI standard. We explore performance implications of this technique and demonstrate its utility for load balancing in the context of a Markov chain Monte Carlo computation. In comparison with a traditional collective approach, noncollective communicator creation enables a 30% improvement in execution time through asynchronous load balancing.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • James Dinan
    • 1
  • Sriram Krishnamoorthy
    • 2
  • Pavan Balaji
    • 1
  • Jeff R. Hammond
    • 1
  • Manojkumar Krishnan
    • 2
  • Vinod Tipparaju
    • 3
  • Abhinav Vishnu
    • 2
  1. 1.Argonne National LaboratoryArgonneUSA
  2. 2.Pacific Northwest National LaboratoryRichlandUSA
  3. 3.Oak Ridge National LaboratoryOak RidgeUSA

Personalised recommendations