Abstract
Estimating the missing data from an incomplete measurement or observation plays an important role in the area of big data analytic, especially for some streaming data analysis such as video streaming recovery, traffic data analysis and network engineering. In this paper, by making full use of the potential spatio-temporal smoothness and inherent correlation properties in real-world tensor data, we present a low-rank Tensor Train (TT) factorization method for solving the 3-way streaming low-rank tensor completion problems. Extensive numerical experiments on color images, network traffic data and gray scale videos show that our model outperforms many existing state-of-the-art approaches in terms of achieving higher recovery accuracy.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Acar E., Dunlavy D.M., Kolda T.G., Mørup M., Scalable tensor factorizations for incomplete data. Chemometrics Intell. Lab. Syst., 2011, 106(1): 41–56
Attouch H., Bolte J., Redont P., Soubeyran A., Proximal alternating minimization and projection methods for nonconvex problems: An approach based on the Kurdyka-Lojasiewicz inequality. Math. Oper. Res., 2010, 35(2): 438–457
Attouch H., Bolte J., Svaiter B.F., Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods. Math. Program., 2013, 137(1–2), Ser. A: 91–129
Bolte J., Daniilidis A., Lewis A., The Lojasiewicz inequality for nonsmooth subanalytic functions with applications to subgradient dynamical systems. SIAM J. Optim., 2006, 17(4): 1205–1223
Bolte J., Daniilidis A., Lewis A., Shiota M., Clarke subgradients of stratifiable functions. SIAM J. Optim., 2007, 18(2): 556–572
Cai J.F., Candes E.J., Shen Z.W., A singular value thresholding algorithm for matrix completion. SIAM J. Optim., 2010, 20(4): 1956–1982
Candes E.J., Recht B., Exact matrix completion via convex optimization. Found. Comput. Math., 2009, 9(6): 717–772
Chen Y.N., Zhang X.Z., Qi L.Q., Xu Y.W., A Barzilai-Borwein gradient algorithm for spatio-temporal internet traffic data completion via tensor triple decomposition. J. Sci. Comput., 2021, 88(3): Paper No. 65, 24 pp.
Ko C.Y., Batselier K., Daniel L., Yu W.J., Wong N., Fast and accurate tensor completion with total variation regularized tensor trains. IEEE Trans. Image Process., 2020, 29: 6918–6931
Kolda T.G., Bader B.W., Tensor decompositions and applications. SIAM Rev., 2009, 51(3): 455–500
Lin X.L., Ng M.K., Zhao X.L., Tensor factorization with total variation and Tikhonov regularization for low-rank tensor completion in imaging data. J. Math. Imaging Vision, 2020, 62(6–7): 900–918
Majumdar A., Matrix Completion via Thresholding (Ver. 1.0.0.0), MATLAB Central File Exchange. 2010, https://www.mathworks.com/matlabcentral/fileexchange/26395-matrix-completion-via-thresholding
Mardani M., Mateos G., Giannakis G.B., Imputation of streaming low-rank tensor data. In: 2014 IEEE 8th Sensor Array Multichannel Signal Process. Workshop (SAM), Piscataway, NJ: IEEE, 2014, 433–436
Oseledets I.V., Tensor-train decomposition. SIAM J. Sci. Comput., 2011, 33(5): 22952317
Qi L.Q., Chen Y.N., Bakshi M., Zhang X.Z., Triple decomposition and tensor recovery of third order tensors. SIAM J. Matrix Anal. Appl., 2021, 42(1): 299–329
Roughan M., Zhang Y., Willinger W., Qiu L.L., Spatio-temporal compressive sensing and Internet traffic matrices (extended version). IEEE Trans. Netw., 2011, 20(3): 662–676
Semerci O., Hao N., Kilmer M.E., Miller E.L., Tensor-based formulation and nuclear norm regularization for multienergy computed tomography. IEEE Trans. Image Process., 2014, 23(4): 1678–1693
Tan H.C., Feng G.D., Feng J.S., Wang W.H., Zhang Y.-J., Li F., A tensor-based method for missing traffic data completion. Transp. Res. Part C: Emerging Technol., 2013, 28: 15–27
Wen Z.W., Yin W.T., Zhang Y., Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm. Math. Program. Comput., 2012, 4(4): 333–361
Xie K., Wang L.L., Wang X., Xie G.G., Wen J.G., Zhang G.X., Cao J.N., Zhang D.F., Accurate recovery of Internet traffic data: A sequential tensor completion approach. IEEE/ACM Trans. Netw., 2018, 26(2): 793–806
Xu Y.Y., Hao R.R., Yin W.T., Sun Z.X., Parallel matrix factorization for low-rank tensor completion. Inverse Probl. Imaging, 2015, 9(2): 601–624
Zhang Y., Roughan M., Willinger W., Qiu L., Spatio-temporal compressive sensing and Internet traffic matrices. Computer Commun. Rev., 2009, 39(4): 267–278
Zhang Z.M., Ely G., Aeron S., Hao N., Kilmer M., Novel methods for multilinear data completion and de-noising based on tensor-SVD. In: 2014 IEEE Conf. Comput. Vis. Pattern Recognit., Piscataway, NJ: IEEE, 2014, 3842–3849
Zhou H.B., Zhang D.F., Xie K., Chen Y.X., Spatio-temporal tensor completion for imputing missing internet traffic data. In: 2015 IEEE 34th Int. Perform. Comput. Commun. Conf. (IPCCC), Piscataway, NJ: IEEE, 2016, 7 pages
Zhou P., Lu C.Y., Lin Z.C., Zhang C., Tensor factorization for low-rank tensor completion. IEEE Trans. Image Process., 2018, 27(3): 1152–1163
Acknowledgements
G. H. Yu and C. Ling were supported in part by National Natural Science Foundation of China (Nos. 12071104 and 11971138) and Natural Science Foundation of Zhejiang Province (Nos. LD19A010002 and LY19A010019).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest The authors declare no conflict of interest.
Rights and permissions
About this article
Cite this article
Yu, G., Wan, S., Ling, C. et al. Tensor Train Factorization with Spatio-temporal Smoothness for Streaming Low-rank Tensor Completion. Front. Math (2024). https://doi.org/10.1007/s11464-021-0443-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11464-021-0443-6