Static scheduling of parallel programs for message passing architectures

  • Apostolos Gerasoulis
  • Tao Yang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 634)


We discuss the static scheduling and code generation problem for message passing architectures. Using ideas from successful manually written programs for message passing architectures we have developed several new automatic algorithms for scheduling and code generation. These algorithms have been implemented in a preliminary software system named PYRROS. The purpose of this paper is to provide a justification of our approach and choice of algorithms.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    M. Cosnard, M. Marrakchi, Y. Robert, and D. Trystram, Parallel Gaussian Elimination on an MIMD Computer, Parallel Computing, vol. 6, pp. 275–296, 1988.Google Scholar
  2. 2.
    J. J. Dongarra, and D.C. Sorensen, SCHEDULE: Tools for Developing and Analyzing Parallel Fortran Programs, in D.B. Gannon, L.H. Jamieson and R.J. Douglass, editors, The Characteristics of Parallel Algorithms, pp 363–394. The MIT Press, Cambridge, Massachusetts, 1987.Google Scholar
  3. 3.
    T.H. Dunigan, Performance of the INTEL iPSC/860 and nCUBE 6400 Hypercube, ORNL/TM-11790, Oak Ridge National Laboratory, Oak Ridge, TN, Nov. 1991.Google Scholar
  4. 4.
    H. El-Rewini and T.G. Lewis, Scheduling Parallel Program Tasks onto Arbitrary Target Machines, J. of Parallel and Distributed Computing 9, 138–153(1990).Google Scholar
  5. 5.
    A. Gerasoulis and T. Yang, On the Granularity and Clustering of Directed Acyclic Task Graphs, TR-153, Dept. of Computer Science, Rutgers Univ., 1990.Google Scholar
  6. 6.
    A. Gerasoulis and T. Yang, A Comparison of Clustering Heuristics for Scheduling DAGs on Multiprocessors, To appear in J. of Parallel and Distributed Computing, Dec. 1992.Google Scholar
  7. 7.
    S. Hiranandani, K. Kennedy and C.W. Tseng, Compiler Optimizations for Fortran D on MIMD Distributed-Memory Machines, Proc. of Supercomputing '91, IEEE, pp86–100.Google Scholar
  8. 8.
    N. Karmarkar, A New Parallel Architecture for Sparse Matrix Computation Based on Finite Project Geometries, Proc. of Supercomputing '91, IEEE, pp358–369.Google Scholar
  9. 9.
    C. Koelbel, P. Mehrotra, Supporting Shared Data Structures on Distributed Memory Architectures, Ppopp 1990, pp 177–186.Google Scholar
  10. 10.
    S.J. Kim and J.C Browne, A General Approach to Mapping of Parallel Computation upon Multiprocessor Architectures, Int'l Conf. on Parallel Processing, vol 3, pp. 1–8, 1988.Google Scholar
  11. 11.
    C. D. Polychronopoulos, M.B. Girkar, M. R.Haghighat, C.L. Lee, B.P. Leung, and D.A. Schouten, The Structure of Parafrase-2: an Advanced Parallelizing Compiler for C and Fortran, in D. Gelernter, A. Nicolau and D. Padua (Eds.), Languages and Compilers for Parallel Computing, 1990.Google Scholar
  12. 12.
    Y. Saad, Gaussian Elimination on Hypercubes, Parallel Algorithms and Architectures, Cosnard, M. et al. Eds., Elsevier Science Publishers, North-Holland, 1986.Google Scholar
  13. 13.
    V. Sarkar, Partitioning and Scheduling Parallel Programs for Execution on Multiprocessors, The MIT Press, 1989.Google Scholar
  14. 14.
    V. Sarkar, Determining Average Program Execution Times and their Variance, SIGPLAN 1989, pp298–312.Google Scholar
  15. 15.
    Min-You Wu and D. Gajski, A Programming Aid for Hypercube Architectures, The Journal of Supercomputing, vol. 2, pp. 349–372, 1988.Google Scholar
  16. 16.
    T. Yang and A. Gerasoulis, A Fast Scheduling Algorithm for DAGs on an Unbounded Number of Processors, Proc. of Supercomputing '91, IEEE, pp 633–642, Nov. 1991.Google Scholar
  17. 17.
    T. Yang and A. Gerasoulis, PYRROS: Static Task Scheduling and Code Generation for Message-Passing Multiprocessors, Proc. of 6th ACM International Conference on Supercomputing, Washington D.C., July, 1992.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1992

Authors and Affiliations

  • Apostolos Gerasoulis
    • 1
  • Tao Yang
    • 1
  1. 1.Department of Computer ScienceRutgers UniversityNew BrunswickUSA

Personalised recommendations