Cluster Computing

, Volume 6, Issue 2, pp 115-124

First online:

One-Sided Communication on Clusters with Myrinet

  • Jarek NieplochaAffiliated withPacific Northwest National Laboratory Email author 
  • , Edoardo ApraAffiliated withPacific Northwest National Laboratory
  • , Jialin JuAffiliated withTivoli Systems Inc
  • , Vinod TipparajuAffiliated withOhio State University

Rent the article at a discount

Rent now

* Final gross prices may vary according to local VAT.

Get Access


This paper describes an efficient implementation of one-sided communication on top of the GM low-level message-passing library for clusters with Myrinet. This approach is compatible with shared memory, exploits pipelining, nonblocking communication, and overlapping memory registration with memory copy to maximize the transfer rate. The paper addresses critical design issues faced on the commodity clusters and then describes possible solutions for matching the low-level network protocol with user-level interfaces. The performance implications of the design decisions are presented and discussed in context of a standalone communication benchmark as well as two applications. Finally, the paper offers some indications on what additional features would be desirable in a communication library like GM to better support one-sided communication.

one-sided communication remote memory operations clusters Myrinet