Abstract
Historically, MPI implementations have had to choose between eager messaging protocols that require buffering and rendezvous protocols that sacrifice overlap and strong independent progress in some scenarios. The typical choice is to use an eager protocol for short messages and switch to a rendezvous protocol for long messages. If overlap and progress are desired, some implementations offer the option of using a thread. We propose an approach that leverages triggered operations to implement a long message rendezvous protocol that provides strong progress guarantees. The results indicate that a triggered operation based rendezvous can achieve better overlap than a traditional rendezvous implementation and less wasted bandwidth than an eager long protocol.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Brightwell, R.: A Comparison of Three MPI Implementations for Red Storm. In: Di Martino, B., Kranzlmüller, D., Dongarra, J. (eds.) EuroPVM/MPI 2005. LNCS, vol. 3666, pp. 425–432. Springer, Heidelberg (2005)
Brightwell, R., Maccabe, A.B., Riesen, R.: Design, implementation, and performance of MPI on Portals 3.0. International Journal of High Performance Computing Applications 17(1), 7–20 (2003)
Brightwell, R., Underwood, K.D.: Evaluation of an eager protocol optimization for MPI. In: Dongarra, J., Laforenza, D., Orlando, S. (eds.) EuroPVM/MPI 2003. LNCS, vol. 2840, pp. 327–334. Springer, Heidelberg (2003)
Dickman, L., Lindahl, G., Olson, D., Rubin, J., Broughton, J.: PathScale InfiniPath: A First Look. In: Proceedings of the 13th Symposium on High Performance Interconnects (HOTI 2005) (August 2005)
Franke, H., Wu, C.E., Riviere, M., Pattnaik, P., Snir, M.: MPI programming environment for IBM SP1/SP2. In: Proceedings of the 15th International Conference on Distributed Computing Systems (1995)
Gropp, W., Lusk, E., Doss, N., Skjellum, A.: A high-performance, portable implementation of the MPI message passing interface standard. Parallel Computing 22(6), 789–828 (1996)
Hemmert, K.S., Barrett, B., Underwood, K.D.: Using triggered operations to offload collective communication operations. In: Keller, R., Gabriel, E., Resch, M., Dongarra, J. (eds.) EuroMPI 2010. LNCS, vol. 6305, pp. 249–256. Springer, Heidelberg (2010)
Kumar, R., Mamidala, A.R., Koop, M.J., Santhanaraman, G., Panda, D.K.: Lock-Free Asynchronous Rendezvous Design for MPI Point-to-Point Communication. In: Lastovetsky, A., Kechadi, T., Dongarra, J. (eds.) EuroPVM/MPI 2008. LNCS, vol. 5205, pp. 185–193. Springer, Heidelberg (2008)
Myricom, Inc.: Myrinet Express (MX): A high performance, low-level, message-passing interface for Myrinet (July 2003), http://www.myri.com/scs/MX/doc/mx.pdf
Petrini, F., chun Feng, W., Hoisie, A., Coll, S., Frachtenberg, E.: The Quadrics Network: High-Performance Clustering Technology. IEEE Micro 22(1), 46–57 (2002)
Rashti, M.J., Afsahi, A.: Improving Communication Progress and Overlap in MPI Rendezvous Protocol over RDMA-enabled Interconnects. In: Proceedings of the 22nd International Symposium on High Performance Computing Systems, pp. 95–101 (June 2008)
Rashti, M.J., Afsahi, A.: A speculative and adaptive MPI rendezvous protocol over RDMA-enabled interconnects. International Journal of Parallel Programming 37, 223–246 (2009)
Riesen, R.E., Pedretti, K.T., Brightwell, R., Barrett, B.W., Underwood, K.D., Hudson, T.B., Maccabe, A.B.: The Portals 4.0 message passing interface. Tech. Rep. SAND2008-2639, Sandia National Laboratories (April 2008)
Rodrigues, A.F., Hemmert, K.S., Barrett, B.W., Kersey, C., Oldfield, R., Weston, M., Risen, R., Cook, J., Rosenfeld, P., CooperBalls, E., Jacob, B.: The structural simulation toolkit. SIGMETRICS Perform. Eval. Rev. 38, 37–42 (2011), http://doi.acm.org/10.1145/1964218.1964225
Sur, S., Jin, H.W., Chai, L., Panda, D.K.: Rdma read based rendezvous protocol for mpi over infiniband: design alternatives and benefits. In: Proceedings of the eleventh ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP 2006, pp. 32–39. ACM, New York (2006), http://doi.acm.org/10.1145/1122971.1122978
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Barrett, B.W., Brightwell, R., Hemmert, K.S., Wheeler, K.B., Underwood, K.D. (2011). Using Triggered Operations to Offload Rendezvous Messages. In: Cotronis, Y., Danalis, A., Nikolopoulos, D.S., Dongarra, J. (eds) Recent Advances in the Message Passing Interface. EuroMPI 2011. Lecture Notes in Computer Science, vol 6960. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24449-0_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-24449-0_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24448-3
Online ISBN: 978-3-642-24449-0
eBook Packages: Computer ScienceComputer Science (R0)