ACPC 1999: Parallel Computation pp 510-521 | Cite as
High Performance Implementation of MPI for Myrinet
Conference paper
First Online:
Abstract
This paper presents a new implementation of MPI on a cluster of Linux-based, dual-processor PCs interconnected by a Myricom high speed network. A survey of existing software for this hardware configuration resulted in the non-availability of a fully functional, correct and complete MPI library exploiting the full hardware potential. Our library uses MPICH for the high level protocol and FM/HPVM for the basic communications layer. It allows multiple processes and multiple users on the same PC, and passes an extensive test suite, including all test programs from the MPICH distribution, for both C and Fortran. The presented benchmarks, both simple communication kernels and full applications, show good performance. The result is the first high-performance MPI interface which allows regular multi-user service for applications on our PC cluster.
Keywords
Workstation clusters Myrinet MPI FM HPVMPreview
Unable to display preview. Download preview PDF.
References
- 1.Beowulf Project at CESDIS, http://cesdis.gsfc.nasa.gov/linux/beowulf/beowulf.html.
- 2.Butenhof, D.R.: Programming with POSIX Threads. Addison-Wesley, 1997.Google Scholar
- 3.Chien, A., Pakin, S., Lauria, M., Buchanan, M., Hane K., Giannini, L., Prusakova, J.: High Performance Virtual Machines (HPVM): Clusters with Supercomputing APIs and Performance. Eighth SIAM Conference on Parallel Processing for Scientic Computing (PP97). March, 1997.Google Scholar
- 4.Dubnicki, C., Bilas, A., Li, K., Philbin, J.: Design and Implementation of Virtual Memory-Mapped Communication on Myrinet. NECI Technical Report. October, 1996.Google Scholar
- 5.Edler, J., Gottlieb, A., Philbin, J.: The NECI LAMP: What, Why, and How. Heterogeneous Computing and Multi-Disciplinary Applications: Proceedings of the eighth NEC Research Symposium.Google Scholar
- 6.GigaBit Ethernet with Linux, http://cesdis.gsfc.nasa.gov/linux/drivers/yellow_n.html.
- 7.Gropp, W., Lusk, E.: A High-Performance, Portable Implementation of the MPI Message Passing Interface Standard. http://www.mcs.anl.gov/mpi/mpicharticle/paper.html.
- 8.Gropp, W., Lusk, E.: MPICH Working Note: The implementation of the second generation MPICH ADI. ANL.Google Scholar
- 9.Gustavson, D.: The scalable coherent interface and related standards projects. IEEE Micro, 12(1), February, 1992.Google Scholar
- 10.Hempel, R., Ritzdorf, H.: The GMD communications subroutine library for grid-oriented problems. Arbeitspapiere der GMD Nr. 589, St. Augustin, 1991.Google Scholar
- 11.Henley G., Doss, N., McMahon, T., Skjellum, A.: BDM: A Multiprotocol Myrinet Control Program and Host Application Programmer Interface. Technical Report, Mississippi State University. May, 1997.Google Scholar
- 12.Koike, N.: NEC Cenju-3: A Microprocessor-Based Parallel Computer. Proceedings of IPPS. April, 1994.Google Scholar
- 13.Lauria, M., Pakin, S., Chien, A.: Efficient Layering for High Speed Communication: Fast Messages 2.x. Proceedings of the 7th High Performance Distributed Computing (HPDC7) conference. Chicago Illinois, July, 1998.Google Scholar
- 14.Leroy, X.: The LinuxThreads library. http://pauillac.inria.fr/~xleroy/linuxthreads/
- 15.Linden, J., Lonsdale, G., Ritzdorf, H., Shüller, A.: Scalability aspects of parallel multigrid. FGCS, 10 (1994).Google Scholar
- 16.Message Passing Interface Forum: MPI: A Message-Passing Interface Standard. June, 1995.Google Scholar
- 17.Message Passing Interface Forum: MPI-2: Extensions to the Message-Passing Interface. July, 1997.Google Scholar
- 18.Myrinet Documentation. http://www.myri.com/scs/documentation.
- 19.Pakin, S., Buchanan, M., Connelly, K., Lavery, A., Koenig, G., Giannini, L., Prusakova, J., Herman, G., Chien, A.: HPVM 1.0 User Documentation. August, 1997.Google Scholar
- 20.Philbin, J., Li, K.: Rationale and Requirements for Low Cost Scalable Servers and Parallel Processors. NECI Technical Note. March, 1995.Google Scholar
- 21.Prylli, L., Tourancheau, B.: BIP: a new protocol designed for high performance networking on Myrinet. Workshop PC-NOW, IPPS/SPDP98. Orlando, USA, 1998.Google Scholar
- 22.Ritzdorf, H., Hempel, R.: CLIC-The Communications Library for Industrial Codes Development at GMD-SCAI. http://www.gmd.de/SCAI/num/clic/clic.html.
- 23.Ritzdorf, H., Schüller, A., Steckel, B., Stüben, K.: LiSS-An environment for the parallel multigrid solution of partial differential equations on general 2D domains. Parallel Computing, 20 (1994).Google Scholar
- 24.Snir, M., Otto, S.W., Huss-Lederman, S., Walker, D.W., Dongarra, J.: MPI: The Complete Reference. MIT Press, 1996.Google Scholar
- 25.Thakur, R., Lusk, E., Gropp, W.: Users Guide for ROMIO: A High-Performance, Portable MPI-IO Implementation. ANL Technical Memorandum No. 234, October, 1997.Google Scholar
- 26.Warren, M.S., Becker, D.J., Goda, M.P., Salmon, J.K., Sterling, T.: Parallel Supercomputing with Commodity Components. Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA’97), 1997.Google Scholar
Copyright information
© Springer-Verlag Berlin Heidelberg 1999