Realization of an HPF Interface to ScaLAPACK with Redistributions
The High Performance Fortran (HPF) programming language provides the data parallel programming paradigm for high performance architectures with different hierarchies of memory. HPF programs are much easier to write and to read than conventional message passing programs.
Unfortunately, the data parallel programming paradigm is not sufficient for all kind of applications and message passing programs are more efficient in some cases. Therefore it is desirable to have an interface from HPF to existing parallel libraries based on the efficient message passing paradigm.
In this paper we describe the realization of such an interface to ScaLAPACK, a library of high performance linear algebra routines based on message passing. The interface is realized in such a way that it applies redistribution routines from the HPF runtime system to its arguments if ScaLAPACK does not support a certain HPF distribution or if it can increase the performance.
In fact, the high level specification and the powerful functionality of HPF will simplify the use of a parallel library dramatically and make its use much more convenient.
Unable to display preview. Download preview PDF.
- 1.T. Brandes and F. Zimmermann. ADAPTOR — A Transformation Tool for HPF Programs. In K.M. Decker and R.M. Rehmann, editors, Programming Environments for Massively Parallel Distributed Systems, pages 91–96. Birkhäuser Verlag, April 1994.Google Scholar
- 2.J. Choi, J. Demmel, I. Dhillon, J. Dongarra, A. Ostrouchov, S. Petitet, K. Stanley, D. Walker, and R.C. Whaley. ScaLAPACK: A Portable Linear Algebra Library for Distributed Memory Computers — Design Issues and Performance. Technical Report LAPACK Working Note 95, Department of Computer Science, University of Tennessee, 1995.Google Scholar
- 3.J. Dongarra, L. Prylli, and B. Tourancheau. Array Redistribution in ScaLAPACK using PVM. In J. Dongarra, M. Gengler, B. Tourancheau, and X. Vigouroux, editors, EuroPVM'95: Second European PVM Users' G1roup Meeting, Lyon, France, pages 271–276. Hèrmes, Paris, September 1995.Google Scholar
- 4.D. Greco and G. Cabitza. HPParLib++: A run time system for HPF. Technical Report CRS4-PARCOMP-95/1, Centre for Advanced Studies, Research and Development in Sardinia, Cagliary, Italy, February 1995.Google Scholar
- 5.High Perforamnce Fortran Forum. High Performance Fortran Language Specification. Version 1.1, Department of Computer Science, Rice University, November 1994.Google Scholar
- 6.Message Passing Interface Forum. Document for a Standard Message-Passing Interface. Draft Version February 1994 1.0, University of Tennessee, Knoxville, February 1994.Google Scholar
- 7.Y. Murakami. High Performance Fortran Interface for ScaLAPACK. Extended Abstract, SIPAR Workshop on Parallel and Distributed Systems, Biel-Bienne, Switzerland, CSCS, Manno, Switzerland, 1995.Google Scholar
- 8.V. Sunderam. PVM: a Framework for Parallel Distributed Computing. Concurrency: Practice and Experience, 3(10), December 1990.Google Scholar