An accelerated augmented Lagrangian method for linearly constrained convex programming with the rate of convergence O(1/k 2)

  • Yi-fen Ke
  • Chang-feng Ma


In this paper, we propose and analyze an accelerated augmented Lagrangian method (denoted by AALM) for solving the linearly constrained convex programming. We show that the convergence rate of AALM is O(1/k 2) while the convergence rate of the classical augmented Lagrangian method (ALM) is O(1/k). Numerical experiments on the linearly constrained l 1l 2 minimization problem are presented to demonstrate the effectiveness of AALM.


augmented Lagrangian method linearly constrained convex programming accelerated technique 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.



The authors would like to express their great thankfulness to the referees for the comments and constructive suggestions, which are valuable in improving the quality of this manuscript.


  1. [1]
    S H Chan, R Khoshabeh, K B Gibson, P E Gill, T Q Nguyen. An augmented Lagrangian method for total variation video restoration, IEEE Trans Image Process, 2011, 20(11): 3097–3111.MathSciNetCrossRefGoogle Scholar
  2. [2]
    Z-M Chen, J Zou. An augmented Lagrangian method for identifying discontinuous parameters in elliptic systems, SIAM J Control Optim, 1999, 37(3): 892–910.MathSciNetCrossRefMATHGoogle Scholar
  3. [3]
    B-S He, X-M Yuan. On the acceleration of augmented Lagrangian method for linearly constrained optimization, 2010, FILE/2010/10/2760.pdfGoogle Scholar
  4. [4]
    J H Heegaard, A Curnier. An augmented Lagrangian method for discrete large-slip contact problems, Internat J Numer Methods Engrg, 1993, 36(4): 569–593.MathSciNetCrossRefMATHGoogle Scholar
  5. [5]
    M R Hestenes. Multiplier and gradient methods, J Optim Theory Appl, 1969, 4(5): 303–320.MathSciNetCrossRefMATHGoogle Scholar
  6. [6]
    U Hiriart, B Jean, C Lemarechal. Convex Analysis and Minimization Algorithms I: Fundamentals, Springer, New York, 1996.MATHGoogle Scholar
  7. [7]
    B Huang, S-Q Ma, D Goldfarb. Accelerated linearized Bregman method, J Sci Comput, 2013, 54(2-3): 428–453.MathSciNetCrossRefMATHGoogle Scholar
  8. [8]
    K Ito, K Kunisch. The augmented Lagrangian method for parameter estimation in elliptic systems, SIAM J Control Optim, 1990, 28(1): 113–136.MathSciNetCrossRefMATHGoogle Scholar
  9. [9]
    K Ito, K Kunisch. The augmented Lagrangian method for equality and inequality constraints in Hilbert spaces, Math Program, 1990, 46(1-3): 341–360.MathSciNetCrossRefMATHGoogle Scholar
  10. [10]
    M Kang, S Yun, H Woo, M Kang. Accelerated Bregman method for linearly constrained 1-2 minimization, J Sci Comput, 2013, 56(3): 515–534.MathSciNetCrossRefMATHGoogle Scholar
  11. [11]
    Z-C Lin, M-M Chen, Y Ma. The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices, 2010, arXiv:1009.5055.Google Scholar
  12. [12]
    Y E Nesterov. A method for unconstrained convex minimization problem with the rate of convergence O(1/k2), Dokl AN SSSR, 1983, 269(3): 543–547.Google Scholar
  13. [13]
    J Nocedal, S J Wright. Numerical Optimization, Springer Verlag, 1999.CrossRefMATHGoogle Scholar
  14. [14]
    M J D Powell. A method for nonlinear constraints in minimization problems, In: Optimization, Academic Press, New York, 1969, 283–298.Google Scholar
  15. [15]
    C-L Wu, J-Y Zhang, X-C Tai. Augmented lagrangian method for total variation restoration with non-quadratic fidelity, Inverse Probl Imaging, 2011, 5(1): 237–261.MathSciNetCrossRefMATHGoogle Scholar

Copyright information

© Editorial Committee of Applied Mathematics-A Journal of Chinese Universities and Springer-Verlag Berlin Heidelberg 2017

Authors and Affiliations

  1. 1.School of Mathematics and Computer Science & FJKLMAAFujian Normal UniversityFuzhouChina

Personalised recommendations