Numerical Algorithms

, Volume 59, Issue 1, pp 1–27 | Cite as

Novel modifications of parallel Jacobi algorithms

  • Sanja SingerEmail author
  • Saša Singer
  • Vedran Novaković
  • Aleksandar Ušćumlić
  • Vedran Dunjko
Original Paper


We describe two main classes of one-sided trigonometric and hyperbolic Jacobi-type algorithms for computing eigenvalues and eigenvectors of Hermitian matrices. These types of algorithms exhibit significant advantages over many other eigenvalue algorithms. If the matrices permit, both types of algorithms compute the eigenvalues and eigenvectors with high relative accuracy. We present novel parallelization techniques for both trigonometric and hyperbolic classes of algorithms, as well as some new ideas on how pivoting in each cycle of the algorithm can improve the speed of the parallel one-sided algorithms. These parallelization approaches are applicable to both distributed-memory and shared-memory machines. The numerical testing performed indicates that the hyperbolic algorithms may be superior to the trigonometric ones, although, in theory, the latter seem more natural.


Hermitian matrices Eigenvalues Jacobi algorithm Parallelization 

Mathematics Subject Classifications (2010)

65F15 65Y05 65Y20 68W10 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ashcraft, C., Grimes, R.G., Lewis, J.G.: Accurate symmetric indefinite linear equation solvers. SIAM J. Matrix Anal. Appl. 20(2), 513–561 (1999)CrossRefMathSciNetGoogle Scholar
  2. 2.
    Bunch, J.R.: Analysis of the diagonal pivoting method. SIAM J. Numer. Anal. 8(4), 656–680 (1971)CrossRefMathSciNetGoogle Scholar
  3. 3.
    Bunch, J.R.: Partial pivoting strategies for symmetric matrices. SIAM J. Numer. Anal. 11(3), 521–528 (1974)CrossRefzbMATHMathSciNetGoogle Scholar
  4. 4.
    Bunch, J.R., Kaufman, L.C.: Some stable methods for calculating inertia and solving symmetric linear systems. Math. Comput. 31(137), 163–179 (1977)CrossRefzbMATHMathSciNetGoogle Scholar
  5. 5.
    Bunch, J.R., Kaufman, L.C., Parlett, B.N.: Decomposition of a symmetric matrix. Numer. Math. 27(1), 95–109 (1976)CrossRefzbMATHMathSciNetGoogle Scholar
  6. 6.
    Bunch, J.R., Parlett, B.N.: Direct methods for solving symmetric indefinite systems of linear equations. SIAM J. Numer. Anal. 8(4), 639–655 (1971)CrossRefMathSciNetGoogle Scholar
  7. 7.
    Demmel, J.W., Veselić, K.: Jacobi’s method is more accurate than QR. SIAM J. Matrix Anal. Appl. 13(4), 1204–1245 (1992)CrossRefzbMATHMathSciNetGoogle Scholar
  8. 8.
    Dopico, F.M., Koev, P., Molera, J.M.: Implicit standard Jacobi gives high relative accuracy. Numer. Math. 113, 519–553 (2009)CrossRefzbMATHMathSciNetGoogle Scholar
  9. 9.
    Drmač, Z., Veselić, K.: New fast and accurate Jacobi SVD algorithm. II. SIAM J. Matrix Anal. Appl. 29(4), 1343–1362 (2008)CrossRefzbMATHGoogle Scholar
  10. 10.
    Hari, V.: On sharp quadratic convergence bounds for the serial Jacobi methods. Numer. Math. 60(1), 375–406 (1991)CrossRefzbMATHMathSciNetGoogle Scholar
  11. 11.
    Hari, V.: Quadratic convergence of a special quasi-cyclic Jacobi method. Ann. Univ. Ferrara Sez. VII Sci. Mat. 53(2), 255–269 (2007)CrossRefzbMATHMathSciNetGoogle Scholar
  12. 12.
    Hari, V., Singer, S., Singer, S.: Block-oriented J–Jacobi methods for Hermitian matrices. Linear Algebra Appl. 433(8–10), 1491–1512 (2010)CrossRefzbMATHMathSciNetGoogle Scholar
  13. 13.
    Hari, V., Singer, S., Singer, S.: Full block J-Jacobi method for Hermitian matrices. Dept. of Mathematics, Univ. of Zagreb (2010, submitted for publication)Google Scholar
  14. 14.
    Higham, N.J.: Accuracy and Stability of Numerical Algorithms, 2nd edn. SIAM, Philadelphia (2002)CrossRefzbMATHGoogle Scholar
  15. 15.
    Luk, F.T., Park, H.: A proof of convergence for two parallel Jacobi SVD algorithms. IEEE Trans. Comput. C38(6), 806–811 (1989)CrossRefMathSciNetGoogle Scholar
  16. 16.
    Rhee, N.H., Hari, V.: On the global and cubic convergence of a quasi-cyclic Jacobi method. Numer. Math. 66(1), 97–122 (1993)CrossRefzbMATHMathSciNetGoogle Scholar
  17. 17.
    de Rijk, P.P.M.: A one–sided Jacobi algorithm for computing the singular value decomposition on a vector computer. SIAM J. Sci. Statist. Comput. 10(2), 359–371 (1989)CrossRefzbMATHMathSciNetGoogle Scholar
  18. 18.
    Singer, S.: Indefinite QR factorization. BIT 46(1), 141–161 (2006)CrossRefzbMATHMathSciNetGoogle Scholar
  19. 19.
    Singer, S., Singer, S., Hari, V., Bokulić, K., Davidović, D., Jurešić, M., Ušćumlić, A.: Advances in speedup of the indefinite one-sided block Jacobi method. In: Simos, T.E., Psihoyios, G., Tsitouras, C. (eds.) AIP Conf. Proc. – Volume 936 Numerical Analysis and Applied Mathematics, pp. 519–522. AIP, Melville, New York (2007)Google Scholar
  20. 20.
    Singer, S., Singer, S., Novaković, V., Davidović, D., Bokulić, K., Ušćumlić, A.: Three-level parallel J-Jacobi algorithms for Hermitian matrices. Technical report, University of Zagreb (2010). arXiv:1008.4166v1 [cs.NA]
  21. 21.
    Slapničar, I.: Componentwise analysis of direct factorization of real symmetric and Hermitian matrices. Linear Algebra Appl. 272, 227–275 (1998)CrossRefzbMATHMathSciNetGoogle Scholar
  22. 22.
    Slapničar, I.: Highly accurate symmetric eigenvalue decomposition and hyperbolic SVD. Linear Algebra Appl. 358, 387–424 (2003)CrossRefzbMATHMathSciNetGoogle Scholar
  23. 23.
    van der Sluis, A.: Condition numbers and equilibration of matrices. Numer. Math. 14(1), 14–23 (1969)CrossRefzbMATHMathSciNetGoogle Scholar
  24. 24.
    Veselić, K.: A Jacobi eigenreduction algorithm for definite matrix pairs. Numer. Math. 64(1), 241–269 (1993)CrossRefzbMATHMathSciNetGoogle Scholar
  25. 25.
    Veselić, K., Hari, V.: A note on a one–sided Jacobi algorithm. Numer. Math. 56(6), 627–633 (1989)CrossRefzbMATHMathSciNetGoogle Scholar
  26. 26.
    Zha, H.: A note on the existence of the hyperbolic singular value decomposition. Linear Algebra Appl. 240, 199–205 (1996)CrossRefzbMATHMathSciNetGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC. 2011

Authors and Affiliations

  • Sanja Singer
    • 1
    Email author
  • Saša Singer
    • 2
  • Vedran Novaković
    • 1
  • Aleksandar Ušćumlić
    • 3
  • Vedran Dunjko
    • 4
  1. 1.Faculty of Mechanical Engineering and Naval ArchitectureUniversity of ZagrebZagrebCroatia
  2. 2.Faculty of Science, Department of MathematicsUniversity of ZagrebZagrebCroatia
  3. 3.MSV sustavi d.o.o.SamoborCroatia
  4. 4.School of EPS – Physics Department, David Brewster BuildingHeriot-Watt UniversityEdinburghUK

Personalised recommendations