Cluster Computing

, Volume 6, Issue 2, pp 115–124

One-Sided Communication on Clusters with Myrinet


    • Pacific Northwest National Laboratory
  • Edoardo Apra
    • Pacific Northwest National Laboratory
  • Jialin Ju
    • Tivoli Systems Inc
  • Vinod Tipparaju
    • Ohio State University

DOI: 10.1023/A:1022800521563

Cite this article as:
Nieplocha, J., Apra, E., Ju, J. et al. Cluster Computing (2003) 6: 115. doi:10.1023/A:1022800521563


This paper describes an efficient implementation of one-sided communication on top of the GM low-level message-passing library for clusters with Myrinet. This approach is compatible with shared memory, exploits pipelining, nonblocking communication, and overlapping memory registration with memory copy to maximize the transfer rate. The paper addresses critical design issues faced on the commodity clusters and then describes possible solutions for matching the low-level network protocol with user-level interfaces. The performance implications of the design decisions are presented and discussed in context of a standalone communication benchmark as well as two applications. Finally, the paper offers some indications on what additional features would be desirable in a communication library like GM to better support one-sided communication.

one-sided communicationremote memory operationsclustersMyrinet

Copyright information

© Kluwer Academic Publishers 2003