Skip to main content
SpringerLink
Log in

Matrix Computations on Shared-Memory Multiprocessors

  • Conference paper
Advanced Computing Concepts and Techniques in Control Engineering

Part of the book series: NATO ASI Series ((NATO ASI F,volume 47))

  • 71 Accesses

Abstract

The main driving force for higher supercomputer performance is the fact that some important applications in engineering and science currently consume excessive amounts of time or are infeasible to attempt at all on available vector processors. To describe physical phenomena, one must resort to simulation of complex models on the computer. The closer the model is to a physical phenomenon, the more extensive are the required computational resources. Important uses of parallel processors are in the simulation of gauge theory and elementary particle physics, multidimensional semiconductor devices, electronic circuits, weather circulation, and oil reservoirs, as well as studies in chemical quantum dynamics and molecular scattering, seismic imaging and dynamic structural analysis.

This work was supported in part by the National Selence Foundation under Grants No. US NSF DCRS.-lOllO and US NSF DCRS5-09970, the US Department 01 EnerlY under Grant No. US DOE DE-FG02-85ER2500l, the AIr Force Office 01 Scientific Research under Grant No. AFOSR-85-0211, and the IBM Donation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. M. Berry and A. Sameh, Multiprocessor Schemes for Solving Block Tridiagonal Systems, CSRD Report, CSRD University of Illinois at Urbana-Champaign, 1987

    Google Scholar 

  2. M. Berry and A. Sameh, Multiprocessor Algorithms for the Singular Value Decomposition, CSRD Report, CSRD University of Illinois at Urbana-Champaign, 1987.

    Google Scholar 

  3. M. Berry, K. Gallivan, W. Harrod, W. Jalby, S. Lo, U. Meier, B. Phillipe and A. Sameh, Parallel Numerical Algorithms on the CEDAR System, In: CONP AR 86, Lecture Notes in Computer Science, W. Handler et. al., Eds., Springer-Verlag, Aachen, F .R. Germany, 1986.

    Google Scholar 

  4. C. Bischof, A Pipelined Block QR Algorithm for a Ring of Vector Processors, To appear in the Proc. Third SIAM Conf. on Par. Proc. for Sci. Comp., Los Angeles, December 1987.

    Google Scholar 

  5. B. Buzbee, G. Golub and C. Nielson, On Direct Methods for Solving Poisson’s Equation, SIAM J. Numer. Analysis 7, pp. 627-656, 1970.

    Article  MathSciNet  MATH  Google Scholar 

  6. O. Buneman, A Compact Non-iterative Poisson Solver, Report 294, Stanford University Institute for Plasma Research, Stanford, California, 1969.

    Google Scholar 

  7. B. Buzbee, A Fast Poisson solver Amenable to Parallel Computation, IEEE Trans. Comput. C-22, pp. 793-796, 1973.

    Article  MATH  Google Scholar 

  8. D. Calahan, Block-Oriented, Local-Memory-Based Linear Equation Solution on the CRAY-2: Uniprocessor Algorithms, Proceedings of ICPP 1986, IEEE Computer Society Press, Washington D.C., August 1986.

    Google Scholar 

  9. P. Concus, G. Golub and G. Meurant, Block Preconditioning for the Conjugate Gradient Method, SIAM J. Sci. Stat. Comput., Vol. 6, 1985, pp. 220-252.

    Article  MathSciNet  MATH  Google Scholar 

  10. J. Cuppen, A Divide and Conquer Method for the Symmetric Tridiagonal Eigenproblem, Numer. Math., Vol. 36, 1981, pp. 177-195.

    Article  MathSciNet  MATH  Google Scholar 

  11. J. Dongarra, J. Du Croz, I. Duff and S. Hammarling, A Proposal for a Set of Level 9 Basic Linear Algebra Subprograms, Technical Memo No. 88, MCS Division, Argonne National Laboratory, Argonne, Illinois, 1987.

    Google Scholar 

  12. J. Dongarra, J. Bunch, C. Moler and G. W. Stewart, Linpack User’s Guide, SIAM, 1979.

    Google Scholar 

  13. J. Dongarra and D. Sorensen, A Fully Parallel Algorithm for the Symmetric Eigenvalue Problem, SIAM J. Sci. Stat. Comput., Vol. 8, 1987, pp. s139-s154.

    Article  MathSciNet  Google Scholar 

  14. J. Dongarra, A. Sameh and D. Sorensen, Implementation of Some Concurrent Algorithms for Matrix Factorization, Mathematics and Computer Science Division Report, Argonne National Laboratory, Argonne, Illinois, 1984.

    Google Scholar 

  15. J. Ericksen, Iterative and Direct Methods for Solving Poisson’s Equation and Their Adaptability to Illiac IV, CAC Document No. 60, University of Illinois at Urbana-Champaign, December 1972.

    Google Scholar 

  16. G. Forsythe, M. Malcolm and C. Moler, Computer Methods for Mathematical Computations, Prentice-Hall, 1977.

    Google Scholar 

  17. D. Gannon and W. Jalby, The Influence of Memory Hierarchy on Algorithm Organization: Programming FFTs on a Vector Multiprocessor. in The Characteristics of Parallel Algorithms, L. Jamieson, D. Gannon and R. Douglass, Eds., MIT Press, Cambridge, 1987.

    Google Scholar 

  18. K. Gallivan, W. Jalby and U. Meier, The Use of BLASS in Linear Algebra on a Parallel Processor with a Hierarchical Memory, SIAM J. Sci. Stat. Comput., Vol. 8, No.6, November 1987.

    Google Scholar 

  19. S. Gallopoulos and Y. Saad, A Parallel Block Cyclic Reduction Algorithm for the Fast solution of Elliptoc Equations, CSRD Report, CSRD University of minois at UrbanaChampaign, 1987.

    Google Scholar 

  20. K. Gallivan, W. Jalby, U. Meier and A. Sameh, The Impact of Hierarchical Memory Systems on Linear Algebra Algorithm Design, CSRD Report, CSRD University of Illinois at Urbana-Champaign, 1987. To appear in Inter. Jour. of Supercomputing Applications, Spring, 1988.

    Google Scholar 

  21. G. Golub and C. Reinsch, Singular Value Decomposition and Least Squares Solutions, Numer. Math., Vol. 14, 1970, pp. 403-420.

    Article  MathSciNet  MATH  Google Scholar 

  22. G. Golub and C. Van Loan, Matrix Computations, The Johns Hopkins University Press, 1983.

    Google Scholar 

  23. W. Harrod, Programming with the BLAS, in The Characteristics of Parallel Algorithms, L. Jamieson, D. Gannon and R. Douglass, Eds., MIT Press, Cambridge, 1987

    Google Scholar 

  24. R. Hockney, A Fast direct solution of Poisson’s Equation Using Fourier Analysis, JACM 12, pp. 95-113, 1965.

    Article  MathSciNet  MATH  Google Scholar 

  25. R. Hockney, The Potential Calculation and Some Applications, in Methods of Computational Physics, Alder, Fernback and Rotenberg, Eds., Vol. 9, pp. 135-211, Academic Press, 1970.

    Google Scholar 

  26. R. Hockney, Optimizing the FACR(I) Poisson Solver on Parallel Computers, Proc. ICPP 1982, IEEE Computer society Press, 1982.

    Google Scholar 

  27. J. W. Hong and H. T. Kung, I/O Complexity: The Red-Blue Pebble Game, Proc. of the 13th Ann. Symp. on Theory of Computing, October 1981, pp. 326-333.

    Google Scholar 

  28. W. Jalby, U. Meier and A. Sameh, The Behavior of Conjugate Based Algorithms on a Multi-vector Processor with Memory Hierarchy, CSRD Report, CSRD University of Illinois at Urbana-Champaign, 1987.

    Google Scholar 

  29. C. Kamath and A. Sameh, A Projection Method for Solving Nonsymmetric Linear Systems on Multiprocessors, CSRD Report, CSRD University of Illinois at UrbanaChampaign, 1986.

    Google Scholar 

  30. T. Kailath, A. Vieira and M. Morf, Inversion of Toeplitz Operators, Innovations and Orthogonal Polynomials, SIAM Review 20, pp. 106-119, 1978.

    Article  MathSciNet  MATH  Google Scholar 

  31. D. Kuck, E. Davidson, D. Lawrie and A. Sameh, Parallel Supercomputing Today and the Cedar Approach, Science, Vol. 231, 1986, pp. 967-974.

    Article  Google Scholar 

  32. D. Lawrie and A. Sameh, The Computations and Communication Complexity of a Parallel Banded System Solver, ACM TOMS, Vol. 10, 1984, pp. 185-195.

    Article  MathSciNet  MATH  Google Scholar 

  33. S. Lo, B. Philippe and A. Sameh, A Multiprocessor Algorithm for the Symmetric Tridiagonal Eigenvalue Problem, SIAM J. Sci. Stat. Comput., Vol. 8, 1987, pp. s155-s165.

    Article  MathSciNet  Google Scholar 

  34. G. Meurant, The Block Preconditioned Conjugate Gradient Method on Vector Computers, BIT, Vol. 24, 1984, pp. 623-633.

    Article  MathSciNet  MATH  Google Scholar 

  35. M. Pease, An Adaption of the Fast Fourier Transform for Parallel Processing, JACM 15, pp. 252-264, 1968.

    Article  MATH  Google Scholar 

  36. G. Peters and J. Wilkinson, On the Stability of Gauss-Jordan Elimination with Pivoting, CACM 18, pp. 20-24, January 1975.

    Article  MathSciNet  MATH  Google Scholar 

  37. Y. Saad, Practical Use of Polynomial Preconditioning for the Conjugate GradientMethod, SIAM J. Sci. Stat. Comput., Vol. 6, 1985, pp. 865-881.

    Article  MathSciNet  MATH  Google Scholar 

  38. Y. Saad, On the Design of Parallel Numerical Methods in Message Passing and Shared-Memory Environments, Proc. Inter. Seminar on Scientific Supercomputers, Paris, France, February 1987.

    Google Scholar 

  39. A. Sameh, S. Chen and D. Kuck, Parallel Poisson and Biharmonic Solvers, Computing 17, pp. 219-230, 1976.

    Google Scholar 

  40. A. Sameh and D. Kuck, On Stable Parallel Linear System Solvers, JACM 25 (1978) pp. 81-91.

    Google Scholar 

  41. A. Sameh, Purdue Workshop on Algorithmically-Specialized Computer Organizations, Academic Press, New York, 1982.

    Google Scholar 

  42. A. Sameh, On Two Numerical Algorithms for Multiprocessors, in High Speed Computing, J. S. Kowalik, Ed., Series F: Computer and Systems Sciences, Vol. 7, 1984.

    Google Scholar 

  43. A. Sameh, On Some Parallel Algorithms on a Ring of Processors, Computer Physics Communications, Vol. 37, 1985, pp. 159-166.

    Article  MathSciNet  Google Scholar 

  44. R. Schreiber and B. Parlett, Block Reflectors: Theory and Computation, Dept. Comp. Sci. Tech. Report 87-11, Rensselaer Polytechnic Institute, Troy, New York, March 1987.

    Google Scholar 

  45. G. W. Stewart, Introduction to Matrix: Computation., Academic Press, New York, 1973.

    Google Scholar 

  46. H. Stone, Parallel Processing with the Perfect Shuffle; IEEE Trans. Comput. C-20, pp. 153-161, 1971.

    Google Scholar 

  47. P. Swarztrauber, The Methods of Cyclic Reduction, Fourier Analysis and the FACR Algorithm for the Discrete Solution of Poisson’s Equation on a Rectangle, SIAM Review 19, pp. 490-501, 1977.

    Google Scholar 

  48. R. Sweet, A Parallel and Vector Variant 0/ the Cyclic Reduction Algorithm, to appear in SIAM J. Sci. Stat. Comput.

    Google Scholar 

  49. C. Temperton, Direct Methods for the Solution of the Discrete Poisson Equation: some Comparisons, J. Comput. Phys. 31, pp. 1-20, 1979.

    Google Scholar 

  50. C. Temperton, On the FACR(I) Algorithm for the Discrete Poisson Equation, J. Comput. Phys. 34, pp. 314-329, 1980.

    Google Scholar 

  51. H. van der Vorst, A Vectorizable Variant of Some ICCG Methods, SIAM J. Sci. Stat. Comput., Vol. 3, 1982, pp. 350-356.

    Article  MATH  Google Scholar 

  52. J. Wilkinson, The Algebraic Eigenvalue Problem, Oxford, 1965.

    Google Scholar 

  53. J. Wilkinson and C. Reinsch, Handbook for Automatic Computation, Vol. 2, Linear Algebra, Springer-Verlag, 1971.

    Google Scholar 

  54. P.C. Yew, Architecture of the CEDAR Parallel Supercomputer, CSRD Report, CSRD University of Illinois at Urbana-Champaign, 1986.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Center for Supercomputing Research and Development and Department of Computer Science, University of Illinois, 61801, Urbana, Illinois, USA

    K. A. Gallivan & A. H. Sameh

Authors
  1. K. A. Gallivan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. A. H. Sameh
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computing, Plymouth Polytechnic, Drake Circus, Plymouth, Devon, PL4 8AA, UK

    Michael J. Denham

  2. Department of Electrical and Computer Engineering, University of California, Santa Barbara, CA, 93106, USA

    Alan J. Laub

Rights and permissions

Reprints and permissions

Copyright information

© 1988 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gallivan, K.A., Sameh, A.H. (1988). Matrix Computations on Shared-Memory Multiprocessors. In: Denham, M.J., Laub, A.J. (eds) Advanced Computing Concepts and Techniques in Control Engineering. NATO ASI Series, vol 47. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-83548-3_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-83548-3_11

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-83550-6

  • Online ISBN: 978-3-642-83548-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation