Abstract
We provide the proof of the asymptotic quadratic convergence of the classical serial block-Jacobi EVD algorithm for Hermitian matrices with well-separated eigenvalues (including the multiple ones) as well as clusters of eigenvalues. At each iteration step, two off-diagonal blocks with the largest Frobenius norm are eliminated which is an extension of the original Jacobi approach to the block case. Numerical experiments illustrate and confirm the developed theory.
Similar content being viewed by others
References
Bečka, M., Okša, G., Vajteršic, M.: Dynamic ordering for a parallel block-Jacobi SVD algorithm. Parallel Comput. 28, 243–262 (2002)
Davis, C., Kahan, W.: The rotation of eigenvectors by a perturbation: III. SIAM J. Numer. Anal. 7, 1–46 (1970)
Demmel, J.W., Veselić, K.: Jacobi’s method is more accurate than QR. SIAM J. Math. Anal. Appl. 13, 1204–1245 (1992)
Dopico, F.M., Molera, J.M., Moro, J.: An orthogonal high relative accuracy algorithm for symmetric eigenproblem. SIAM J. Math. Anal. Appl. 25, 301–351 (2003)
Drmač, Z., Veselić, K.: New fast and accurate Jacobi SVD algorithm: I. SIAM J. Matrix Anal. Appl. 29, 1322–1342 (2007)
Drmač, Z., Veselić, K.: New fast and accurate Jacobi SVD algorithm: II. SIAM J. Matrix Anal. Appl. 29, 1343–1362 (2007)
Drmač, Z.: A global convergence proof for cyclic Jacobi methods with block rotations. SIAM J. Matrix Anal. Appl. 31, 1329–1350 (2010)
Golub, G.H., Van Loan, C.F.: Matrix Computations, 4th edn. Johns Hopkins UP, Baltimore (2013)
Hari, V.: On sharp quadratic convergence bounds for the serial Jacobi methods. Numer. Math. 60, 375–406 (1991)
Hari, V.: Convergence to diagonal form of block Jacobi-type methods. Numer. Math. (2014). doi:10.1007/s00211-014-0647-8
Hoffman, A.J., Wielandt, H.W.: The variation of the spectrum of a normal matrix. Duke Math. J. 20, 37–39 (1953)
Kudo, S., Yamamoto, Y., Bečka, M., Vajteršic, M.: Performance of the parallel one-sided block-Jacobi SVD algorithm on a modern distributed-memory parallel computer. LNCS 9573, 594–604 (2016)
Luk, F., Park, H.: On parallel Jacobi orderings. SIAM J. Sci. Stat. Comput. 10, 18–26 (1989)
Matejaš, J., Hari, V.: Accuracy of the Kogbetliantz method for the scaled diagonally dominant triangular matrices. Appl. Math. Comput. 217, 3726–3746 (2010)
Mathias, R.: Accurate eigensystem computations by Jacobi methods. SIAM J. Math. Anal. Appl. 16, 977–1003 (1995)
Parlett, B.N.: The Symmetric Eigenvalue Problem. SIAM, Philadelphia (1987)
Sameh, A.H.: On Jacobi and Jacobi-like algorithms for parallel computer. Math. Comput. 25, 579–590 (1971)
Schönhage, A.: Zur Konvergenz des Jacobi-Verfahrens. Numer. Math. 3, 374–380 (1961)
Schönhage, A.: Zur quadratischen Konvergenz des Jacobi-Verfahrens. Numer. Math. 6, 410–412 (1964)
Singer, S., Singer, S., Novaković, V., Davidović, D., Bokulić, K., Ušćumlić, A.: Three-level parallel J-Jacobi algorithms for Hermitian matrices. Appl. Math. Comput. 218, 5704–5725 (2012)
Sugihara, M., Murota, K.: Mathematics of Numerical Linear Algebra. Iwanami-Shoten, Tokyo (2009). (in Japanese)
Yamamoto, Y., Lan, Z., Kudo, S.: Convergence analysis of the parallel classical block Jacobi method for the symmetric eigenvalue problem. JSIAM Lett. 6, 57–60 (2014)
Acknowledgements
We are grateful for valuable recommendations to prof. Hans-Joachim Bungartz and prof. Vjeran Hari who read the first draft of this paper. We also thank both anonymous referees for their comments and suggestions that improved the paper’s quality.
Author information
Authors and Affiliations
Corresponding author
Additional information
Gabriel Okša and Marián Vajteršic were supported by the VEGA Grant no. 2/0026/14. Yusaku Yamamoto was supported in part by the Ministry of Education, Science, Sports and Culture, Grant-in-Aid for Scientific Research (Nos. 26286087, 15H02708, 15H02709), Core Research for Evolutional Science and Technology (CREST) Program ”Highly Productive, High Performance Application Frameworks for Post Petascale Computing” of Japan Science and Technology Agency (JST).
Rights and permissions
About this article
Cite this article
Okša, G., Yamamoto, Y. & Vajteršic, M. Asymptotic quadratic convergence of the serial block-Jacobi EVD algorithm for Hermitian matrices. Numer. Math. 136, 1071–1095 (2017). https://doi.org/10.1007/s00211-016-0863-5
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00211-016-0863-5