Graph-Regularized NMF with Prior Knowledge for Image Inpainting

  • Li LiuEmail author
  • Fei Shang
  • Siqi Chen
  • Yumei Wang
  • Xue Wang
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 834)


The image inpainting problem can be converted to the matrix completion. A classical matrix completion method is based on matrix factorization. The product of two low-rank matrices fills in the missing regions. In this paper, we propose a novel matrix factorization framework to recover the images. Before decomposing the original matrix, approximation matrix as the prior knowledge is constructed to estimate the values of missing pixels. The estimation of the missing pixels can be obtained through resampling from the surface fitting the 3D projection points of the available pixels. To keep the latent geometrical structure between adjacent pixels, we modify the graph-regularized which allows the edge weights negative to decompose the approximation matrix. Experimental results of image inpainting demonstrate the effectiveness of the proposed method compared with the representative methods in quantities.


Graph-regularized NMF Image inpainting Hole filling Approximation matrix 



This work was supported by the National Natural Science Foundation of China (61702310 and 61772322).


  1. 1.
    Lu, N., Miao, H.: Structure constrained nonnegative matrix factorization for pattern clustering and classification. Neurocomputing 171(C), 400–411 (2016)CrossRefGoogle Scholar
  2. 2.
    Yang, Z., Oja, E.: Quadratic nonnegative matrix factorization. Pattern Recogn. 45(4), 1500–1510 (2012)CrossRefGoogle Scholar
  3. 3.
    Witten, D.M., Tibshirani, R., Hastie, T.: A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis. Biostatistics 10(3), 5–15 (2009)CrossRefGoogle Scholar
  4. 4.
    Li, S.Z., Hou, X., Zhang, H., Cheng, Q.: Learning spatially localized parts-based representation. Comput. Vis. Pattern Recogn. 1, 1–207 (2001)Google Scholar
  5. 5.
    Shen, B., Si, L., Ji, R., Liu, B.: Robust nonnegative matrix factorization via l1 norm regularization. In: IEEE International Conference on Image Processing, pp. 1204–2311 (2012)Google Scholar
  6. 6.
    Yuan, Z., Oja, E.: Projective nonnegative matrix factorization for image compression and feature extraction. In: Proceedings of 14th Scandinavian Conference on Image Analysis (SCIA), Springer, pp. 333–342 (2005)Google Scholar
  7. 7.
    Chen, Y., Zhang, J., Cai, D., Liu, W., He, X.: Nonnegative local coordinate factorization for image representation. IEEE Trans. Image Process. 22(3), 969–979 (2013)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Cai, D., He, X., Han, J., Huang, T.S.: Graph regularized nonnegative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1548–1560 (2011)CrossRefGoogle Scholar
  9. 9.
    Luo, P., Peng, J.Y., Guan, Z.Y., Fan, J.P.: Dual regularized multi-view non-negative matrix factorization for clustering. Neurocomputing 294(24), 1–11 (2017)Google Scholar
  10. 10.
    Wang, J.Y., Bensmail, H., Gao, X.: Multiple graph regularized nonnegative matrix factorization. Pattern Recogn. 46(10), 2840–2847 (2013)CrossRefGoogle Scholar
  11. 11.
    Guan, N., Tao, D., Luo, Z., Yuan, B.: Manifold regularized discriminative nonnegative matrix factorization with fast gradient descent. IEEE Trans. Image Process. 20(7), 2030–2048 (2011)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Wu, W.H., Kwong, S., Zhou, Y., Jia, Y.H., Gao, W.: Nonnegative matrix factorization with mixed hypergraph regularization for community detection. Inf. Sci. 435, 263–281 (2018)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Huang, S., Wang, H.X.: Improved hypergraph regularized Nonnegative Matrix Factorization with sparse representation. Pattern Recogn. Lett. 102, 8–14 (2018)CrossRefGoogle Scholar
  14. 14.
    Mashallah, M.F., Pourabd, M.: Moving least square for systems of integral equations. Appl. Math. Comput. 270, 879–889 (2015)MathSciNetzbMATHGoogle Scholar
  15. 15.
    Mehrabi, H., Voosoghi, B.: Recursive moving least squares. Eng. Anal. Bound. Elem. 58, 119–128 (2015)MathSciNetCrossRefGoogle Scholar
  16. 16.
    Telea, A.: An image inpainting technique based on the fast marching method. J. Gr. Tools. 9(1), 23–34 (2004)CrossRefGoogle Scholar
  17. 17.
    Criminisi, A., Perez, P., Toyama, K.: Region filling and object removal by exemplar-based image inpainting. Image Press. 13(9), 1200–1212 (2004)CrossRefGoogle Scholar
  18. 18.
    Guillemot, C., Meur, O.: Image inpainting: overview and recent advances. Signal Process. Mag. 31(1), 127–144 (2013)CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  • Li Liu
    • 1
    Email author
  • Fei Shang
    • 1
  • Siqi Chen
    • 1
  • Yumei Wang
    • 1
  • Xue Wang
    • 1
  1. 1.School of Information Science and EngineeringShandong Normal UniveristyJinanChina

Personalised recommendations