Reducing Synchronization Overhead Through Bundled Communication

  • James Dinan
  • Clement Cole
  • Gabriele Jost
  • Stan Smith
  • Keith Underwood
  • Robert W. Wisniewski
Conference paper

DOI: 10.1007/978-3-319-05215-1_12

Part of the Lecture Notes in Computer Science book series (LNCS, volume 8356)
Cite this paper as:
Dinan J., Cole C., Jost G., Smith S., Underwood K., Wisniewski R.W. (2014) Reducing Synchronization Overhead Through Bundled Communication. In: Poole S., Hernandez O., Shamis P. (eds) OpenSHMEM and Related Technologies. Experiences, Implementations, and Tools. OpenSHMEM 2014. Lecture Notes in Computer Science, vol 8356. Springer, Cham

Abstract

OpenSHMEM provides a one-sided communication interface that allows for asynchronous, one-sided communication operations on data stored in a partitioned global address space. While communication in this model is efficient, synchronizations must currently be achieved through collective barriers or one-sided updates of sentinel locations in the global address space. These synchronization mechanisms can over-synchronize, or require additional communication operations, respectively, leading to high overheads. We propose a SHMEM extension that utilizes capabilities present in most high performance interconnects (e.g. communication events) to bundle synchronization information together with communication operations. Using this approach, we improve ping-pong latency for small messages by a factor of two, and demonstrate significant improvement to synchronization-heavy communication patterns, including all-to-all and pipelined parallel stencil communication.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • James Dinan
    • 1
  • Clement Cole
    • 1
  • Gabriele Jost
    • 1
  • Stan Smith
    • 1
  • Keith Underwood
    • 1
  • Robert W. Wisniewski
    • 1
  1. 1.Intel Corp.USA

Personalised recommendations