Abstract
In this paper, augmented Lagrangian duality is considered for composite optimization problems, and first- and second-order conditions for the existence of augmented Lagrange multipliers are presented. The analysis is based on the reformulation of the augmented Lagrangian in terms of the Moreau envelope functions and the technique of epi-convergence via the calculation of second-order epi-derivatives of the augmented Lagrangian. It is also proved that the second-order conditions for optimization problems with abstract constraints given in a form of set inclusions, obtained by Shapiro and Sun, can be derived directly from our general results.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Hestenes, M.R.: Multiplier and gradient methods. J. Optim. Theory Appl. 4, 303–320 (1969)
Powell, M.J.D.: A method for Nonlinear Constraints in Minimization Problems, in Optimization. Academic Press, London (1969)
Buys, J.D.: Dual algorithms for constrained optimization problems. Ph.D. Thesis, University of Leiden, Leiden (1972)
Rockafellar, R.T.: Augmented Lagrange multiplier functions and duality in nonconvex programming. SIAM J. Control 12, 268–285 (1974)
Rockafellar, R.T.: Lagrange multipliers and optimality. SIAM Rev. 35, 183–238 (1993)
Bertsekas, D.P.: Constrained Optimization and Lagrangian Multiplier Methods. Academic Press, New York (1982)
Rockafellar, R.T., Wets, R.J.-B.: Variational Analysis. Springer, New York (1998)
Huang, X.X., Yang, X.Q.: A unified augmented Lagrangian approach to duality an exact penalization. Math. Oper. Res. 28, 533–552 (2003)
Rubinov, A.M., Huang, X.X., Yang, X.Q.: The zero duality gap property and lower semicontinuouity of the perturbation function. Math. Oper. Res. 27, 775–791 (2002)
Rubinov, A.M., Yang, X.Q.: Lagrange-Type Functions in Constrained Non-Convex Optimization. Kluwer Academic Publisher, Dordrecht (2003)
Shapiro, A., Sun, J.: Some properties of the augmented Lagrangian in cone constrained optimization. Math. Oper. Res. 29, 479–491 (2004)
Bonnans, J.F., Shapiro, A.: Perturbation Analysis of Optimization Problems. Springer, New York (2000)
Burke, J.V., Poliquin, R.A.: Optimality conditions for non-finite valued convex composite functions. Math. Program. 57, 103–120 (1992)
Rockafellar, R.T.: First- and second-order epi-differentiability in nonlinear programming. Trans. Am. Math. Soc. 307, 75–108 (1988)
Rockafellar, R.T.: Second-order optimality conditions in nonlinear programming obtained by way of epi-derivatives. Math. Oper. Res. 14, 462–484 (1989)
Bauschke, H.H., Combettes, P.L.: Convex Analysis and Monotone Operator Theory in Hilbert Spaces. CMS Books in Mathematics, Springer (2011)
Combettes, P.L., Wajs, V.R.: Signal recovery by proximal forward-backward splitting. Multiscale Model. Simul. 4, 1168–1200 (2005)
Rockafellar, R.T.: Generalized second derivatives of convex functions and saddle function. Trans. Am. Math. Soc. 322, 51–77 (1990)
Attouch, H., Wets, R.J.-B.: Epigraphical analysis. Ann. Inst. Henri Poincaré Anal. Non-Linéaire 6, 73–100 (1989)
Do, C.N.: Generalized second-order derivatives of convex function in reflexive Banach spaces. Trans. Am. Math. Soc. 334, 281–301 (1992)
Acknowledgments
Corresponding author, the research of the second author was partly supported by the National Natural Sciences Grant (No. 11371116)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kan, C., Song, W. Augmented Lagrangian Duality for Composite Optimization Problems. J Optim Theory Appl 165, 763–784 (2015). https://doi.org/10.1007/s10957-014-0640-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-014-0640-5