Journal of Mathematical Imaging and Vision

, Volume 51, Issue 1, pp 145–160 | Cite as

A Partial Splitting Augmented Lagrangian Method for Low Patch-Rank Image Decomposition

  • Deren HanEmail author
  • Weiwei Kong
  • Wenxing Zhang


Following the recent work Schaeffer and Osher (SIAM J Imaging Sci 6:226–262, 2013), the low patch-rank interpretation for the oscillating patterns of an image validates the application of matrix-rank optimization to image decomposition. Therein, the problem was mathematically modeled as a separable convex programming with three-block (a total variation semi-norm for regularizing the cartoon, a low-rank constraint for extracting the texture, and a data fidelity term for approximating the target image), and was algorithmically handled by the split Bregman method with inner Gauss-Seidel sweep loops. In this paper, we develop an alternating direction method of multipliers (ADMM) based prediction–correction method for solving the low patch-rank model with all resulting subproblems admitting closed-form solutions. As a surrogate of the direct extension of ADMM, which was recently proved to be not necessarily convergent, the new method is globally convergent under some mild conditions. Numerical simulations are conducted, which demonstrate the promising performance of the new method.


Convex programming Alternating direction method of multipliers Image decomposition Low-rank 



We would like to thank the referees for their constructive suggestions. The first author is supported by the National Natural Science Foundation of China (NFSC) Grants 11071122, 11171159, and 20103207110002 from MOE of China. The third author is supported by NFSC Grant 11301055.


  1. 1.
    Adams, R.: Sobolev Spaces. Pure and applied Mathematics. Academic Press Inc, Amsterdam (1975)Google Scholar
  2. 2.
    Aubert, G., Aujol, J.: Modeling very oscillating signals: application to image processing. Appl. Math. Optim. 51, 163–182 (2005)CrossRefzbMATHMathSciNetGoogle Scholar
  3. 3.
    Aujol, J., Aubert, G., Blanc-Férau, L., Chambolle, A.: Image decomposition into a bounded variation component and an oscillating component. J. Math. Imaging Vis. 22, 71–88 (2005)CrossRefGoogle Scholar
  4. 4.
    Aujol, J., Chambolle, A.: Dual norms and image decomposition models. Int. J. Comput. Vis. 63, 85–104 (2005)CrossRefGoogle Scholar
  5. 5.
    Aujol, J., Gilboa, G., Chan, T., Osher, S.: Structure–texture image decomposition-modeling, algorithms, and parameter selection. Int. J. Comput. Vis. 67, 111–136 (2006)CrossRefzbMATHGoogle Scholar
  6. 6.
    Bauschke, H., Combettes, P.: Convex Analysis and Monotone Operator Theory in Hilbert Spaces. Springer Press, New York (2011)CrossRefzbMATHGoogle Scholar
  7. 7.
    Bertalmio, M., Vese, L., Sapiro, G., Osher, S.: Simultaneous structure and texture image inpainting. IEEE Trans. Image Process. 12, 882–889 (2003)CrossRefGoogle Scholar
  8. 8.
    Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3, 1–122 (2010)CrossRefzbMATHGoogle Scholar
  9. 9.
    Buades, A., Coll, B., Morel, J.: On image denoising methods. Multiscale Model. Simul. 4, 490–530 (2005)CrossRefzbMATHMathSciNetGoogle Scholar
  10. 10.
    Buades, A., Coll, B., Morel, J.: Neighborhood filters and PDE’s. Numer. Math. 105, 1–34 (2006)CrossRefzbMATHMathSciNetGoogle Scholar
  11. 11.
    Cai, J., Chan, R., Shen, Z.: Simultaneous cartoon and texture inpainting. Inverse Prob. Imaging 4, 379–395 (2010)CrossRefzbMATHMathSciNetGoogle Scholar
  12. 12.
    Candès, E., Li, X., Ma, Y., Wright, J.: Robust principal component analysis?. J. ACM. 58. doi: 10.1145/1970392.1970395
  13. 13.
    Chambolle, A.: An algorithm for total variation minimization and applications. J. Math. Imaging Vis. 20, 89–97 (2004)CrossRefMathSciNetGoogle Scholar
  14. 14.
    Chen, C., He, B., Ye, Y., Yuan, X.: The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent. manuscript, Sept. 30 (2013)Google Scholar
  15. 15.
    Chen, G., Teboulle, M.: A proximal-based decomposition method for convex minimization problems. Math. Program. 64, 81–101 (1994)CrossRefzbMATHMathSciNetGoogle Scholar
  16. 16.
    Daubechies, I., Teschke, G.: Variational image restoration by means of wavelets: simultaneous decomposition, deblurring and denoising. Appl. Comput. Harmon. Anal. 19, 1–16 (2005)CrossRefzbMATHMathSciNetGoogle Scholar
  17. 17.
    Douglas, J., Rachford, H.: On the numerical solution of the heat conduction problem in two and three space variables. Trans. Am. Math. Soc. 82, 421–439 (1956)CrossRefzbMATHMathSciNetGoogle Scholar
  18. 18.
    Facchinei, F., Pang, J.: Finite-Dimensional Variational Inequalities and Complementarity Problems. Vols I and II. Springer, Berlin (2003)Google Scholar
  19. 19.
    Fadili, M., Starck, J., Bobin, J., Moudden, Y.: Image decomposition and separation using sparse representations: an overview. Proc. IEEE 98, 983–994 (2010)CrossRefGoogle Scholar
  20. 20.
    Fehrenbach, J., Weiss, P., Lorenzo, C.: Variational algorithms to remove stationary noise: applications to microscopy imaging. IEEE Trans. Image Process. 21, 4420–4430 (2012)CrossRefMathSciNetGoogle Scholar
  21. 21.
    Gabay, D.: Applications of the method of multipliers to variational inequalities. In: Fortin, M., Glowinski, R. (eds.) Augmented Lagrange Methods: Applications to the Solution of Boundary-Valued Problems, pp. 299–331. North-Holland, Amsterdam (1983)CrossRefGoogle Scholar
  22. 22.
    Gabay, D., Mercier, B.: A dual algorithm for the solution of nonlinear variational problems via finite-element approximations. Comput. Math. Appl. 2, 17–40 (1976)CrossRefzbMATHGoogle Scholar
  23. 23.
    Glowinski, R., Marrocco, A.: Approximation par éléments finis d’ordre un et résolution par pénalisation-dualité d’une classe de problèmes non linéaires, R.A.I.R.O., R2, 41–76 (1975).Google Scholar
  24. 24.
    Goldstein, T., Osher, S.: The split Bregman method for \(L1\)-regularized problems. SIAM J. Imaging Sci. 2, 3–23 (2009)CrossRefMathSciNetGoogle Scholar
  25. 25.
    Golub, G., Heath, M., Wahba, G.: Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics 21, 215–223 (1979)CrossRefzbMATHMathSciNetGoogle Scholar
  26. 26.
    Han, D., Yuan, X.: A note on the alternating direction method of multipliers. J. Optim. Theory Appl. 155, 227–238 (2012)CrossRefzbMATHMathSciNetGoogle Scholar
  27. 27.
    Han, D., Yuan, X., Zhang, W., Cai, X.: An ADM-based splitting methods for separable convex programming. Comput. Optim. Appl. 54, 343–369 (2013)CrossRefzbMATHMathSciNetGoogle Scholar
  28. 28.
    Hansen, P., Nagy, J., O’Leary, D.: Deblurring Images: Matrices, Spectra, and Filtering. SIAM, Philadelphia (2006)CrossRefGoogle Scholar
  29. 29.
    He, B., Tao, M., Xu, M., Yuan, X.: Alternating direction based contraction method for generally separable linearly constrained convex programming problems. Optimization 62, 573–596 (2013)CrossRefzbMATHMathSciNetGoogle Scholar
  30. 30.
    Hong, M., Luo, Z.: On the linear convergence of the alternating direction method of multipliers, arXiv:1208.3922v3 (2013).
  31. 31.
    Jung, M., Resmerita, E., Vese, L.: Dual norm based iterative methods for image restoration. J. Math. Imaging Vis. 44, 128–149 (2012)CrossRefzbMATHMathSciNetGoogle Scholar
  32. 32.
    Kim, Y., Vese, L.: Image recovery using functions of bounded variation and Sobolev spaces of negative differentiability. Inverse Prob. Imaging 3, 43–68 (2009)CrossRefzbMATHMathSciNetGoogle Scholar
  33. 33.
    Le, T., Vese, L.: Image decomposition using total variation and \(\text{ div }(BMO)^*\). Multiscale Model Simul. 4, 390–423 (2005)CrossRefzbMATHMathSciNetGoogle Scholar
  34. 34.
    Levine, S.: An adaptive variational model for image decomposition. In Energy Minimization Methods in Computer Vision and Pattern Recognition. Springer, New York, 382–397 (2005)Google Scholar
  35. 35.
    Li, T., Yan, S., Mei, T., Hua, X., Kweon, I.: Image decomposition with multilabel context: algorithms and applications. IEEE Trans. Image Process. 20, 2301–2314 (2011)CrossRefMathSciNetGoogle Scholar
  36. 36.
    MacKenzie, W.: Atlas of Igneous Rocks and Their Textures. Wiley, New York (1982)Google Scholar
  37. 37.
    Maure, P., Aujol, J., Peyré, G.: Locally parallel texture modeling. SIAM J. Imaging Sci. 4, 413–447 (2011)CrossRefMathSciNetGoogle Scholar
  38. 38.
    Meyer, Y.: Oscillating patterns in image processing and nonlinear evolution equations. 22, University Lecture Series, AMS (2002).Google Scholar
  39. 39.
    Mirmehda, M., Xie, X., Suri, S.: Handbook of Texture Analysis. Imperial College Press, London (2008)CrossRefGoogle Scholar
  40. 40.
    Ng, M., Yuan, X., Zhang, W.: A coupled variational image decomposition and restoration model for blurred cartoon-plus-texture images with missing pixels. IEEE Trans. Image Process. 22, 2233–2246 (2013)CrossRefMathSciNetGoogle Scholar
  41. 41.
    Osher, S., Sole, A., Vese, L.: Image decomposition and restoration using total variation minimization and the \(H^{-1}\) norm. Multiscale Model. Simul. 1, 349–370 (2003)CrossRefzbMATHMathSciNetGoogle Scholar
  42. 42.
    Rudin, L., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D. 60, 259–268 (1992)CrossRefzbMATHGoogle Scholar
  43. 43.
    Schaeffer, H., Osher, S.: A low patch-rank interpretation of texture. SIAM J. Imaging Sci. 6, 226–262 (2013)CrossRefzbMATHMathSciNetGoogle Scholar
  44. 44.
    Starck, J., Elad, M., Donoho, D.: Image decomposition via the combination of sparse representations and a variational approach. IEEE Trans. Image Process. 14, 1570–1582 (2005)CrossRefzbMATHMathSciNetGoogle Scholar
  45. 45.
    Tao, M., Yuan, X.: Recovering low-rank and sparse components of matrices from incomplete and noisy observations. SIAM J. Optim. 21, 57–81 (2011)CrossRefzbMATHMathSciNetGoogle Scholar
  46. 46.
    Vese, L., Osher, S.: Modeling textures with total variation minimization and oscillating patterns in image processing. J. Sci. Comput. 19, 553–572 (2002)CrossRefMathSciNetGoogle Scholar
  47. 47.
    Voort, R.: Applied Metallography. New York, (1986).Google Scholar
  48. 48.
    Wright, J., Ganesh, A., Rao, S., Ma, Y.: Robust principal component analysis: exact recovery of corrupted low-rank matrices via convex optimization. Adv. Neural Inf. Process. Syst. 22, 2080–2088 (2009)Google Scholar
  49. 49.
    Yin, W., Goldfarb, D., Osher, S.: A comparison of three total variation based texture extraction models. J. Vis. Commun. Image R. 18, 240–252 (2007)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  1. 1.School of Mathematical SciencesNanjing Normal UniversityNanjing China
  2. 2.School of Mathematical SciencesUniversity of Electronic Science and Technology of ChinaChengdu China

Personalised recommendations