Abstract
In the high performance computing arena, there exist several implementations of MPI-1 and MPI-2 for different networks. Some implementations allow the developer to work with multiple networks. However, most of them require the implementation of a new device, before they can be deployed on a new networking interconnect. The emerging uDAPL interface provides a network-independent interface to the native transport of different networks. Designing a portable MPI library with uDAPL might allow the user to move quickly from one networking technology to another. In this paper, we have designed the popular MVAPICH2 library to use uDAPL for communication operations. To the best of our knowledge, this is the first open-source MPI-2 compliant implementation over uDAPL. Evaluation with micro-benchmarks and applications on InfiniBand shows that the implementation with uDAPL performs comparably with that of MVAPICH2. Evaluation with micro-benchmarks on Myrinet and Gigabit Ethernet shows that the implementation with uDAPL delivers performance close to that of the underlying uDAPL library.
This research is supported in part by Department of Energy’s Grant #DE-FC02-01ER25506; National Science Foundation’s Grants #CCR-0204429, #CCR-0311542, #CNS-0403342; grants from Mellanox, Intel, and SUN MicroSystems; and equipment donations from Intel, Mellanox, Ammasso, AMD, Apple, and SUN.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ammasso, Inc.: The Ammasso 1100 High Performance Ethernet Adapter User Guide (February 2005), http://www.ammasso.com/amso1100_usersguide.pdf
Argonne National Laboratory. MPICH - A Portable Implementation of MPI, http://www-unix.mcs.anl.gov/mpi/mpich
Bailey, D.H., Barszcz, E., Dagum, L., Simon, H.D.: NAS Parallel Benchmark Results. Technical Report 94-006, RNR (1994)
DAT Collaborative. uDAPL: User Direct Access Programming Library Version 1.2 (July 2004), http://www.datcollaborative.org/udapl.html
Infiniband Trade Association, http://www.infinibandta.org/
Liu, J., Jiang, W., Wyckoff, P., Panda, D.K., Ashton, D., Buntinas, D., Gropp, W., Toonen, B.: Design and Implementation of MPICH2 over InfiniBand with RDMA Support. In: International Parallel and Distributed Processing Symposium (2004)
Message Passing Interface Forum. MPI-2: A Message Passing Interface Standard. High Performance Computing Applications, 12(1–2), 1–299 (1998)
MPICH-GM Software, www.myrinet.com/scs
Boden, N.J., Cohen, D., Felderman, R.E., Kulawik, A.E., Seitz, C.L., Seizovic, J., Su, W.: Myrinet - a gigabit per second local area network (February 1995)
Network-Based Computing Laboratory. MPI over InfiniBand Project, http://nowlab.cis.ohio-state.edu/projects/mpi-iba/index.html
Quadrics Ltd., http://www.quadrics.com
RDMA Consortium. RDMA Protocol Verb Specification (April 2003), http://www.rdmaconsortium.com/home
Marc Snir, S., Otto, S., Huss-Lederman, D., Walker, D., Dongarra, J.: MPI–The Complete Reference, 2nd edn. The MPI-1 Core, vol. 1. MIT Press, Cambridge (1998)
The ASCI Blue Benchmarks, http://www.llnl.gov/asci_benchmarks
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chai, L., Noronha, R., Gupta, P., Brown, G., Panda, D.K. (2005). Designing a Portable MPI-2 over Modern Interconnects Using uDAPL Interface. In: Di Martino, B., Kranzlmüller, D., Dongarra, J. (eds) Recent Advances in Parallel Virtual Machine and Message Passing Interface. EuroPVM/MPI 2005. Lecture Notes in Computer Science, vol 3666. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11557265_28
Download citation
DOI: https://doi.org/10.1007/11557265_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29009-4
Online ISBN: 978-3-540-31943-6
eBook Packages: Computer ScienceComputer Science (R0)