Skip to main content

Hybrid Sparse Linear Solutions with Substituted Factorization

  • Conference paper
  • First Online:
High Performance Computing for Computational Science -- VECPAR 2014 (VECPAR 2014)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 8969))

Abstract

We develop a computationally less expensive alternative to the direct solution of a large sparse symmetric positive definite system arising from the numerical solution of elliptic partial differential equation models. Our method, substituted factorization , replaces the computationally expensive factorization of certain dense submatrices that arise in the course of direct solution with sparse Cholesky factorization with one or more solutions of triangular systems using substitution. These substitutions fit into the tree-structure commonly used by parallel sparse Cholesky, and reduce the initial factorization cost at the expense of a slight increase cost in solving for a right-hand side vector. Our analysis shows that substituted factorization reduces the number of floating-point operations for the model \(k \times k\) 5-point finite-difference problem by \(10\,\%\) and empirical tests show execution time reduction on average of \(24.4\,\%\). On a test suite of three-dimensional problems we observe execution time reduction as high as \(51.7\,\%\) and \(43.1\,\%\) on average.

J.D. Booth—This work was completed while attending The Pennsylvania State University.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Heroux, M., Raghavan, P., Simon, H.: Parallel Processing for Scientific Computing. SIAM, Philadelphia (2006)

    Book  MATH  Google Scholar 

  2. George, A., Liu, J.: Computer Solution of Large Sparse Positive Definite Systems. Prentice-Hall, Englewood Cliffs, NJ, USA (1981)

    MATH  Google Scholar 

  3. Golub, G.H., Van Loan, C.F.: Matrix computations, 3rd edn. Johns Hopkins University Press, Baltimore, MD, USA (1996)

    MATH  Google Scholar 

  4. Gupta, A., Kumar, V.: A scalable parallel algorithm for sparse cholesky factorization. In: Proceedings of Supercomputing 1994, pp. 793–802 (1994)

    Google Scholar 

  5. Saad, Y.: Iterative Methods for Sparse Linear Systems, 2nd edn. Society for Industrial and Applied Mathematics, Philadelphia, PA, USA (2003)

    Book  MATH  Google Scholar 

  6. Booth, J.D., Chatterjee, A., Raghavan, P., Frasca, M.: A multilevel cholesky conjugate gradients hybrid solver for linear systems with multiple right-hand sides. Procedia Comput. Sci. 4, 2307–2316 (2011)

    Article  Google Scholar 

  7. Gaidamour, J., Henon, P.: A parallel direct/iterative solver based on a schur complement approach. In: 11th IEEE International Conference on Computational Science and Engineering, CSE 2008, pp. 98–105 (2008)

    Google Scholar 

  8. Bern, M., Gilbert, J., Hendrickson, B., Nguyen, N., Toledo, S.: Support-graph preconditioners. SIAM J. Matrix Anal. and Appl. 27(4), 930–951 (2006)

    Article  MATH  MathSciNet  Google Scholar 

  9. Mansfield, L.: On the conjugate gradient solution of the schur complement system obtained from domain decomposition. SIAM J. Numer. Anal. 27(6), 1612–1620 (1990)

    Article  MATH  MathSciNet  Google Scholar 

  10. George, A.: Nested dissection of a regular finite element mesh. SIAM J. Numer. Anal. 2, 24–45 (1973)

    Google Scholar 

  11. Heath, M.T., Raghavan, P.: A cartesian parallel nested dissection algorithm. SIAM J. Matrix Anal. Appl. 16(1), 235–253 (1995). doi:10.1137/S0895479892238270

    Article  MATH  MathSciNet  Google Scholar 

  12. Raghavan, P.: DSCPACK. Technical Report CSE-02-004, Penn State (2002)

    Google Scholar 

  13. Gupta, A., Joshi, M.: WSMP: A high-performance shared- and distributed-memory parallel sparse linear equation solver (2001)

    Google Scholar 

  14. Goto, K., van de Geijn, R.A.: High-performance implementation of the level-3 BLAS. ACM Trans. Math. Softw. 35(1), 16:1–16:11 (2008)

    Article  Google Scholar 

  15. Balay, S., Brown, J., Buschelman, K., Eijkhout, V., Gropp, W.D., Kaushik, D., Knepley, M.G., McInnes, L.C., Smith, B.F., Zhang, H.: PETSc users manual. Technical Report ANL-95/11 - Revision 3.4, Argonne National Laboratory (2013)

    Google Scholar 

Download references

Acknowledgment

We would like to thank Anshul Gupta for all his assistance with WSMP that made our experiments possible. Additionally, we acknowledge the support of NSF grants CCF-0830679, CCF-1319448, CNS-1017882.

Sandia National Laboratories is a multi-program laboratory managed and operated by Sandia Corporation, a wholly owned subsidiary of Lockheed Martin Corporation, for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-AC04-94AL85000.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Joshua Dennis Booth .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Booth, J.D., Raghavan, P. (2015). Hybrid Sparse Linear Solutions with Substituted Factorization. In: Daydé, M., Marques, O., Nakajima, K. (eds) High Performance Computing for Computational Science -- VECPAR 2014. VECPAR 2014. Lecture Notes in Computer Science(), vol 8969. Springer, Cham. https://doi.org/10.1007/978-3-319-17353-5_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-17353-5_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-17352-8

  • Online ISBN: 978-3-319-17353-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics