Solving alignment using elementary linear algebra

  • David Bau
  • Induprakas Kodukula
  • Vladimir Kotlyar
  • Keshav Pingali
  • Paul Stodghill
Getting Your Ducks in a Row: Alignment and Distribution
Part of the Lecture Notes in Computer Science book series (LNCS, volume 892)


Data and computation alignment is an important part of compiling sequential programs to architectures with non-uniform memory access times. In this paper, we show that elementary matrix methods can be used to determine communication-free alignment of code and data. We also solve the problem of replicating read-only data to eliminate communication. Our matrix-based approach leads to algorithms which are simpler and faster than existing algorithms for the alignment problem.


Null Space Array Element Alignment Problem Virtual Processor Equational Constraint 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [AL93]
    Jennifer M. Anderson and Monica S. Lam. Global optimizations for parallelism and locality on scalable parallel machines. ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI), pages 112–125, June 1993.Google Scholar
  2. [Ban93]
    U. Banerjee. Loop transformations for restructuring compilers. Kluwer Publishing, 1993.Google Scholar
  3. [CGS93]
    Siddartha Chatterjee, John Gilbert, and Robert Schreiber. The alignment-distribution graph. In U. Banerjee, D. Gelernter, A. Nicolau, and D. Padua, editors, Languages and Compilers for Parallel Computing. Sixth International Workshop., number 768 in LNCS. Springer-Verlag, 1993.Google Scholar
  4. [GGST92]
    Siddartha Chatterjee, John Gilbert, Robert Schreiber, and Shang-Hua Teng. Optimal evaluation of array expressions on massively parallel machines. Technical Report CSL-92-11, XEROX PARC, December 1992.Google Scholar
  5. [Edm67]
    Jack Edmonds. Systems of distinct representatives and linear algebra. Journal of research of national bureau of standards (Sect. B), 71(4):241–245, 1967.Google Scholar
  6. [Fea92]
    Paul Feautrier. Toward automatic distribution. Technical Report 92.95, IBP/MASI, December 1992.Google Scholar
  7. [GVL89]
    Gene H. Golub and Charles F. Van Loan. Matrix Computations. The John Hopkins University Press, second edition, 1989.Google Scholar
  8. [HS91]
    C.-H. Huang and P. Sadayappan. Communication-free hyperplane partitioning of nested loops. In U. Banerjee, D. Gelernter, A. Nicolau, and D. Padua, editors, Languages and Compilers for Parallel Computing. Fourth International Workshop. Santa Clara, CA., number 589 in LNCS, pages 186–200. Springer-Verlag, August 1991.Google Scholar
  9. [KLD92]
    Kathleen Knobe, Joan D. Lucas, and William J. Dally. Dynamic alignment on distributed memory systems. In Proceedings of the Third Workshop on Compilers for Parallel Computers, July 1992.Google Scholar
  10. [KN90]
    Kathleen Knobe and Venkataraman Natarajan. Data optimization: minimizing residual interprocessor motion on SIMD machines. In Proceedings of the 3rd Symposium on the Frontiers of Massively Parallel Computation — Frontiers '90, pages 416–423, October 1990.Google Scholar
  11. [LC89]
    Jingke Li and Marina Chen. Index domain alignment: minimizing cost of cross-referencing between distributed arrays. Technical Report YALEU/DCS/TR-725, Department of Computer Science, Yale University, September 1989.Google Scholar
  12. [LP92]
    W. Li and K. Pingali. Access normalization: loop restructuring for NUMA compilers. In Proceedings of the 5th International Conference on Architectural Support for Programming Languages and Operating Systems, October 1992.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1995

Authors and Affiliations

  • David Bau
    • 1
  • Induprakas Kodukula
    • 1
  • Vladimir Kotlyar
    • 1
  • Keshav Pingali
    • 1
  • Paul Stodghill
    • 1
  1. 1.Cornell UniversityUSA

Personalised recommendations