Synchronized Recovery Method for Multi-Rank Symmetric Tensor Decomposition
Symmetric tensor decomposition is of great importance in applications. In this paper, we design a synchronized multi-rank symmetric Tensor Decomposition alternating minimization method. In this algorithm, we start from a careful initialization for the non-convex symmetric tensor decomposition and then perform an alternating minimization algorithm. Our contributions are as follows: (1) Our method is synchronized and there is no need for a greedy algorithm to get the multi-rank tensor decomposition . (2) Initialization is an important part in our proposed method. With a careful initialization, our proposed algorithm can converge to the global minimizer of the non-convex objective function. (3) The designed alternating minimization algorithm can give a highly accurate result. In numerical results, our proposed algorithm is much better than the simple gradient descent method from the same initialization. Moreover, our results show that with eigenvectors of random projection as initialization, we can quickly get the global solution by using simple alternating minimization algorithm, though finding the global minimum of this non-convex minimization problem is NP-hard .
- 3.J. Brachat, P. Comon, B. Mourrain, E. Tsigaridas, Symmetric tensor decomposition, in Signal Processing Conference, 2009 17th European (IEEE, New York, 2009), pp. 525–529Google Scholar
- 11.J. Deng, H. Liu, K. Batselier, Y.-K. Kwok, N. Wong, STORM: a nonlinear model order reduction method via symmetric tensor decomposition, in 2016 21st Asia and South Pacific Design Automation Conference (ASP-DAC) (IEEE, New York, 2016), pp. 557–562Google Scholar
- 17.T.G. Kolda, Symmetric orthogonal tensor decomposition is trivial (2015). arXiv preprint arXiv:1503.01375Google Scholar
- 22.L.-H. Lim, Singular values and eigenvalues of tensors: a variational approach (2006). arXiv preprint math/0607648Google Scholar
- 28.L.I. Smith, A tutorial on principal components analysis. Cornell University, USA, 51:52 (2002)Google Scholar