Abstract
For a general third-order tensor \({{\mathcal {A}}}\in {\mathbb {R}}^{n\times n\times n}\) the paper studies two closely related problems, an SVD-like tensor decomposition and an (approximate) tensor diagonalization. We develop a Jacobi-type algorithm that works on \(2\times 2\times 2\) subtensors and, in each iteration, maximizes the sum of squares of its diagonal entries. We show how the rotation angles are calculated and prove convergence of the algorithm. Different initializations of the algorithm are discussed, as well as the special cases of symmetric and antisymmetric tensors. The algorithm can be generalized to work on higher-order tensors.
Similar content being viewed by others
References
Kovač, E.B.: Finding the closest normal structured matrix. Linear Algebra Appl. 617, 49–77 (2021)
Kovač, E.B., Kressner, D.: Structure-preserving low multilinear rank approximation of antisymmetric tensors. SIAM J. Matrix Anal. Appl. 38(3), 967–983 (2017)
Comon, P.: Tensor diagonalization, a useful tool in signal processing. IFAC Proc. Vol. 27(8), 77–82 (1994)
Comon, P., Jutten, C. (eds.): Handbook of Blind Source Separation. Academic Press, Oxford (2010)
De Lathauwer, L., De Moor, B., Vandewalle, J.: A multilinear singular value decomposition. SIAM J. Matrix Anal. Appl. 21(4), 1253–1278 (2000)
De Lathauwer, L., De Moor, B., Vandewalle, J.: Independent component analysis and (simultaneous) third-order tensor diagonalization. IEEE Trans. Signal Process. 49, 2262–2271 (2001)
Grasedyck, L.: Hierarchical singular value decomposition of tensors. SIAM J. Matrix Anal. Appl. 31(4), 2029–2054 (2010)
Hackbusch, W.: Tensor Spaces and Numerical Tensor Calculus. Springer Series in Computational Mathematics 42 (2012)
Ishteva, M., Absil, P.-A., Van Dooren, P.: Jacobi algorithm for the best low multilinear rank approximation of symmetric tensors. SIAM J. Matrix Anal. Appl. 34(2), 651–672 (2013)
Kolda, T.G., Bader, B.W.: Tensor decompositions and applications. SIAM Rev. 51(3), 455–500 (2009)
Landsberg, J.M.: Tensors: Geometry and Applications. American Mathematical Society, New York (2011)
Li, J., Usevich, K., Comon, P.: On approximate diagonalization of third order symmetric tensors by orthogonal transformations. Linear Algebra Appl. 576(1), 324–351 (2019)
Li, J., Usevich, K., Comon, P.: Globally convergent Jacobi-type algorithms for simultaneous orthogonal symmetric tensor diagonalization. SIAM J. Matrix Anal. Appl. 39(1), 1–22 (2018)
Moravitz Martin, C.D., Van Loan, C.F.: A Jacobi-type method for computing orthogonal tensor decompositions. SIAM J. Matrix Anal. Appl. 30(3), 1219–11232 (2008)
Usevich, K., Li, J., Comon, P.: Approximate matrix and tensor diagonalization by unitary transformations: convergence of Jacobi-type algorithms. SIAM J. Optim. 30(4), 2998–3028 (2020)
Vannieuwenhoven, N., Vandebril, R., Meerbergen, K.: A new truncation strategy for the higher-order singular value decomposition. SIAM J. Sci. Comput. 34(2), A1027–A1052 (2012)
Acknowledgements
This work has been supported in part by Croatian Science Foundation under the project UIP-2019-04-5200. The author is grateful to the anonymous referees for their detailed comments that improved the paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Begović Kovač, E. Convergence of a Jacobi-type method for the approximate orthogonal tensor diagonalization. Calcolo 60, 3 (2023). https://doi.org/10.1007/s10092-022-00498-x
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10092-022-00498-x