Encyclopedia of Parallel Computing

2011 Edition
| Editors: David Padua


  • Eric Polizzi
Reference work entry
DOI: https://doi.org/10.1007/978-0-387-09766-4_88


SPIKE is a polyalgorithm that uses many different strategies for solving large banded linear systems in parallel. Existing parallel algorithms and software using direct methods for banded matrices are mostly based on LU factorizations. In contrast, SPIKE uses a novel decomposition method (i.e., DS factorization) to balance communication overhead with arithmetic cost to achieve better scalability than other methods. The SPIKE algorithm is similar to a domain decomposition technique that allows performing independent calculations on each subdomain or partition of the linear system, while the interface problem leads to a reduced linear system of much smaller size than that of the original one. Direct, iterative, or approximate schemes can then be used to handle the reduced system in a different way depending on the characteristics of the linear system and the parallel computing platform.



Many science and engineering applications, particularly those...

This is a preview of subscription content, log in to check access


  1. 1.
    Cleary A, Dongarra J (1997) Implementation in ScaLAPACK of divide and conquer algorithms for banded and tridiagonal linear systems. University of Tennessee Computer Science Technical Report, UT-CS-97-358Google Scholar
  2. 2.
    Blackford LS, Choi J, Cleary A, Dazevedo E, Demmel J, Dhillon I, et al (1997) ScaLAPACK users guide. Society for Industrial and Appl. Math, PhiladelphiaMATHGoogle Scholar
  3. 3.
    Sameh A (1977) Numerical parallel algorithms: a survey. In: Kuck D, Lawrie D, Sameh A (eds) High speed computer and algorithm organization. Academic, New York, pp 207–228Google Scholar
  4. 4.
    Sameh A, Kuck D (1978) On stable parallel linear system solvers. J ACM 25:81–91MATHMathSciNetGoogle Scholar
  5. 5.
    Sameh A (1983) On two numerical algorithms for multiprocessors. In: Proceedings of NATO adv res workshop on high-speed comp. Series F: computer and systems sciences, vol 7. Springer, Berlin, pp 311–328Google Scholar
  6. 6.
    Lawrie D, Sameh A (1984) The computation and communication complexity of a parallel banded system solver. ACM Trans Math Software 10(2):185–195MATHMathSciNetGoogle Scholar
  7. 7.
    Dongarra J, Sameh A (1984) On some parallel banded system solvers. Parallel Comput 1:223–235Google Scholar
  8. 8.
    Berry M, Sameh A (1988) Multiprocessor schemes for solving block tridiagonal linear systems. Int J Supercomput Appl 2(3): 37–57Google Scholar
  9. 9.
    Sameh A, Sarin V (1999) Hybrid parallel linear solvers. Int J Comput Fluid Dyn 12:213–223MATHMathSciNetGoogle Scholar
  10. 10.
    Polizzi E, Sameh A (2006) A parallel hybrid banded system solver: the SPIKE algorithm. Parallel Comput 32(2):177–194MathSciNetGoogle Scholar
  11. 11.
    Polizzi E, Sameh A (2007) SPIKE: A parallel environment for solving banded linear systems. Comput Fluids 36:113–120MATHMathSciNetGoogle Scholar
  12. 12.
    Golub G, Sameh V, Sarin V (2001) A parallel balance scheme for banded linear systems. Numer Linear Algebr Appl 8(5):297–316MATHMathSciNetGoogle Scholar
  13. 13.
    Demko S, Moss WF, Smith PW (1984) Decay rates for inverses of band matrices. Math Comput 43(168):491–499MATHMathSciNetGoogle Scholar
  14. 14.
    Mikkelsen CCK, Manguoglu M (2008) Analysis of the truncated spike algorithm. SIAM J Matrix Anal Appl 30(4):1500–1519MATHMathSciNetGoogle Scholar
  15. 15.
    Anderson E, Bai Z, Bischof C, Blackford S, Demmel J, Dongarra J, et al (1999) LAPACK users guide, 3rd edn. Society for Industrial and Appl. Math, PhiladelphiaGoogle Scholar
  16. 16.
    Schenk O, Grtner K (2004) Solving unsymmetric sparse systems of linear equations with PARDISO. J Future Gener Comput Syst 20(3):475–487Google Scholar
  17. 17.
    A distributed memory version of the SPIKE package can be obtained from http://software.intel.com/en-us/articles/intel-adaptive-spike-based-solver/
  18. 18.
    Manguoglu M, Sameh A, Schenk O (2009) PSPIKE: a parallel hybrid sparse linear system solver. Lecture notes in computer science, vol 5704. Springer, Berlin, pp 797–808Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  • Eric Polizzi
    • 1
  1. 1.Department of Electrical and Computer EngineeringUniversity of MassachusettsAmherstUSA