Reducing Synchronization Overhead Through Bundled Communication
- James DinanAffiliated withLancaster UniversityIntel Corp.
- , Clement ColeAffiliated withLancaster UniversityIntel Corp.
- , Gabriele JostAffiliated withLancaster UniversityIntel Corp.
- , Stan SmithAffiliated withLancaster UniversityIntel Corp.
- , Keith UnderwoodAffiliated withLancaster UniversityIntel Corp.
- , Robert W. WisniewskiAffiliated withLancaster UniversityIntel Corp.
OpenSHMEM provides a one-sided communication interface that allows for asynchronous, one-sided communication operations on data stored in a partitioned global address space. While communication in this model is efficient, synchronizations must currently be achieved through collective barriers or one-sided updates of sentinel locations in the global address space. These synchronization mechanisms can over-synchronize, or require additional communication operations, respectively, leading to high overheads. We propose a SHMEM extension that utilizes capabilities present in most high performance interconnects (e.g. communication events) to bundle synchronization information together with communication operations. Using this approach, we improve ping-pong latency for small messages by a factor of two, and demonstrate significant improvement to synchronization-heavy communication patterns, including all-to-all and pipelined parallel stencil communication.
- Reducing Synchronization Overhead Through Bundled Communication
- Book Title
- OpenSHMEM and Related Technologies. Experiences, Implementations, and Tools
- Book Subtitle
- First Workshop, OpenSHMEM 2014, Annapolis, MD, USA, March 4-6, 2014. Proceedings
- pp 163-177
- Print ISBN
- Online ISBN
- Series Title
- Lecture Notes in Computer Science
- Series Volume
- Series ISSN
- Springer International Publishing
- Copyright Holder
- Springer International Publishing Switzerland
- Additional Links
- Industry Sectors
- eBook Packages
To view the rest of this content please follow the download PDF link above.