Skip to main content
Log in

Parallel matrix factorization-based collaborative sparsity and smooth prior for estimating missing values in multidimensional data

  • Short Paper
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

Parallel matrix factorization has recently emerged as a powerful tool for low-rank tensor recovery problems. However, using only the low-rank property is often not sufficient for recovering valuable details in images. Generally, incorporating additional prior knowledge shows significant improvement in the recovered results. Therefore, smooth matrix factorization has been introduced for tensor completion in which the smoothness of its spectral factor over the third mode has been recently considered. However, these models may not efficiently characterize the smoothness of the target tensor. Thus, in this work, we are interested in boosting the piecewise smoothness by using the third-mode smoothness of the underlying tensor combined with spectral sparsity of the third factor of the factorization. Therefore, we propose in this paper a parallel matrix factorization-based sparsity constraint with a smoothness prior to the third mode of the target tensor. We develop a multi-block proximal alternating minimization algorithm for solving the proposed model. Theoretically, we show that the generated sequence globally converges to a critical point. The superiority of our model over other tensor completion methods in terms of several evaluation metrics is reported via extensive experiments conducted on real data such as videos, hyperspectral images, and MRI data.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Notes

  1. https://brainweb.bic.mni.mcgill.ca/brainweb/selection_normal.html.

  2. http://lesun.weebly.com/hyperspectral-data-set.html.

References

  1. Banouar O, Mohaoui S, Raghay S (2018) Collaborating filtering using unsupervised learning for image reconstruction from missing data. EURASIP J Adv Signal Process 2018(1):1–12

    Article  Google Scholar 

  2. Beck A, Teboulle M (2009) A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J Imag Sci 2(1):183–202

    Article  MathSciNet  Google Scholar 

  3. Bengua JA, Phien HN, Tuan HD, Do MN (2017) Efficient tensor completion for color image and video recovery: Low-rank tensor train. IEEE Trans Image Process 26(5):2466–2479

    Article  MathSciNet  Google Scholar 

  4. Bolte J, Daniilidis A, Lewis A (2007) The łojasiewicz inequality for nonsmooth subanalytic functions with applications to subgradient dynamical systems. SIAM J Optim 17(4):1205–1223

    Article  Google Scholar 

  5. Bredies K, Lorenz DA (2008) Linear convergence of iterative soft-thresholding. J Fourier Anal Appl 14(5–6):813–837

    Article  MathSciNet  Google Scholar 

  6. Candes EJ, Recht B (2008) Exact low-rank matrix completion via convex optimization. In: 2008 46th annual allerton conference on communication, control, and computing, IEEE, pp 806–812

  7. Carroll JD, Pruzansky S, Kruskal JB (1980) Candelinc: a general approach to multidimensional analysis of many-way arrays with linear constraints on parameters. Psychometrika 45(1):3–24

    Article  MathSciNet  Google Scholar 

  8. Combettes PL, Wajs VR (2005) Signal recovery by proximal forward-backward splitting. Multiscale Model Simul 4(4):1168–1200

    Article  MathSciNet  Google Scholar 

  9. Grippo L, Sciandrone M (2000) On the convergence of the block nonlinear gauss-seidel method under convex constraints. Oper Res Lett 26(3):127–136

    Article  MathSciNet  Google Scholar 

  10. He J, Zheng X, Gao P, Zhou Y (2022) Low-rank tensor completion based on tensor train rank with partially overlapped sub-blocks. Signal Process 190:108339

    Article  Google Scholar 

  11. Hu Y, Zhang D, Ye J, Li X, He X (2012) Fast and accurate matrix completion via truncated nuclear norm regularization. IEEE Trans Pattern Anal Mach Intell 35(9):2117–2130

    Article  Google Scholar 

  12. Iordache M-D, Bioucas-Dias JM, Plaza A (2012) Total variation spatial regularization for sparse hyperspectral unmixing. IEEE Trans Geosci Remote Sens 50(11):4484–4502

    Article  Google Scholar 

  13. Ji T-Y, Huang T-Z, Zhao X-L, Ma T-H, Liu G (2016) Tensor completion using total variation and low-rank matrix factorization. Inf Sci 326:243–257

    Article  MathSciNet  Google Scholar 

  14. Jiang T-X, Huang T-Z, Zhao X-L, Deng L-J (2020) Multi-dimensional imaging data recovery via minimizing the partial sum of tubal nuclear norm. J Comput Appl Math 372:112680

    Article  MathSciNet  Google Scholar 

  15. Jiang T-X, Huang T-Z, Zhao X-L, Ji T-Y, Deng L-J (2018) Matrix factorization for low-rank tensor completion using framelet prior. Inf Sci 436:403–417

    Article  MathSciNet  Google Scholar 

  16. Jiang T-X, Ng MK, Zhao X-L, Huang T-Z (2020) Framelet representation of tensor nuclear norm for third-order tensor completion. IEEE Trans Image Process 29:7233–7244

    Article  MathSciNet  Google Scholar 

  17. Kilmer ME, Braman K, Hao N, Hoover RC (2013) Third-order tensors as operators on matrices: A theoretical and computational framework with applications in imaging. SIAM J Matrix Anal Appl 34(1):148–172

    Article  MathSciNet  Google Scholar 

  18. Kilmer ME, Martin CD (2011) Factorization strategies for third-order tensors. Linear Algebra Appl 435(3):641–658

    Article  MathSciNet  Google Scholar 

  19. Liu J, Musialski P, Wonka P, Ye J (2012) Tensor completion for estimating missing values in visual data. IEEE Trans Pattern Anal Mach Intell 35(1):208–220

    Article  Google Scholar 

  20. Liu Y, Shang F (2013) An efficient matrix factorization method for tensor completion. IEEE Signal Process Lett 20(4):307–310

    Article  Google Scholar 

  21. Ma S, Goldfarb D, Chen L (2011) Fixed point and bregman iterative methods for matrix rank minimization. Math Program 128(1):321–353

    Article  MathSciNet  Google Scholar 

  22. Mohaoui S, Hakim A, Raghay S (2021) Tensor completion via bilevel minimization with fixed-point constraint to estimate missing elements in noisy data. Adv Comput Math 47(1):1–27

    Article  MathSciNet  Google Scholar 

  23. Mohaoui S, Hakim A, Raghay S (2022) Smooth tensor robust principal component analysis with application to color image recovery. Digit Signal Process, p 103390

  24. Nesterov Y (2013) Gradient methods for minimizing composite functions. Math Program 140(1):125–161

    Article  MathSciNet  Google Scholar 

  25. Nesterov YE (1983) A method for solving the convex programming problem with convergence rate o (1/k\(^{2}\)). Dokl akad nauk Sssr 269:543–547

    MathSciNet  Google Scholar 

  26. Oseledets IV (2011) Tensor-train decomposition. SIAM J Sci Comput 33(5):2295–2317

    Article  MathSciNet  Google Scholar 

  27. Qian Y, Jia S, Zhou J, Robles-Kelly A (2011) Hyperspectral unmixing via \( l_ 1/2 \) sparsity-constrained nonnegative matrix factorization. IEEE Trans Geosci Remote Sens 49(11):4282–4297

    Article  Google Scholar 

  28. Sargent R, Sebastian D (1973) On the convergence of sequential minimization algorithms. J Optim Theory Appl 12(6):567–575

    Article  MathSciNet  Google Scholar 

  29. Semerci O, Hao N, Kilmer ME, Miller EL (2014) Tensor-based formulation and nuclear norm regularization for multienergy computed tomography. IEEE Trans Image Process 23(4):1678–1693

    Article  MathSciNet  Google Scholar 

  30. Tan H, Cheng B, Wang W, Zhang Y-J, Ran B (2014) Tensor completion via a multi-linear low-n-rank factorization model. Neurocomputing 133:161–169

    Article  Google Scholar 

  31. Tucker LR (1966) Some mathematical notes on three-mode factor analysis. Psychometrika 31(3):279–311

    Article  MathSciNet  Google Scholar 

  32. Warga J (1963) Minimizing certain convex functions. J Soc Ind Appl Math 11(3):588–593

    Article  MathSciNet  Google Scholar 

  33. Wen Z, Yin W, Zhang Y (2012) Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm. Math Program Comput 4(4):333–361

    Article  MathSciNet  Google Scholar 

  34. Xu Y, Hao R, Yin W, Su Z (2013) Parallel matrix factorization for low-rank tensor completion. arXiv preprint arXiv:1312.1254

  35. Xu Y, Yin W (2013) A block coordinate descent method for regularized multiconvex optimization with applications to nonnegative tensor factorization and completion. SIAM J Imag Sci 6(3):1758–1789

    Article  MathSciNet  Google Scholar 

  36. Xue S, Qiu W, Liu F, Jin X (2018) Low-rank tensor completion by truncated nuclear norm regularization. In: 2018 24th international conference on pattern recognition (ICPR), IEEE, pp 2600–2605

  37. Zhang Z, Ely G, Aeron S, Hao N, Kilmer M (2014) Novel methods for multilinear data completion and de-noising based on tensor-svd. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3842–3849

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Souad Mohaoui.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mohaoui, S., Hakim, A. & Raghay, S. Parallel matrix factorization-based collaborative sparsity and smooth prior for estimating missing values in multidimensional data. Pattern Anal Applic 25, 963–980 (2022). https://doi.org/10.1007/s10044-022-01082-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-022-01082-3

Keywords

Navigation