Abstract
We study the properties of the augmented Lagrangian function for nonlinear semidefinite programming. It is shown that, under a set of sufficient conditions, the augmented Lagrangian algorithm is locally convergent when the penalty parameter is larger than a certain threshold. An error estimate of the solution, depending on the penalty parameter, is also established.
Similar content being viewed by others
References
Rockafellar, R. T., Augmented Lagrange Multiplier Functions and Duality in Nonconvex Programming, SIAM Journal on Control and Optimization, Vol. 12, pp. 268–285, 1974.
Alizadeh, F., Interior-Point Methods in Semidefinite Programming with Application to Combinatorial Optimization, SIAM Journal on Optimization, Vol. 5, pp. 13–51, 1995.
Leibfritz, L., An LMI Based Algorithm for Designing Suboptimal Static H_2/H_∞ Feedback Controllers, SIAM Journal on Control and Optimization, Vol. 39, pp. 1711–1735, 2001.
Vandenberghe, L., and Boyd, S., Semidefinite Programming, SIAM Review, Vol. 38, pp. 49–95, 1996.
Wolkowicz, H., Saigal, R., and Vandenberghe, L., Handbook of Semidefinite Programming: Theory, Algorithms, and Applications, Kluwer Academic Publishers, Dordrecht, Holland, 2000.
Lewis, A. S., and Overton, M. L., Eigenvalue Optimization, Acta Numerica, Vol. 5, pp. 149–190, 1996.
Lewis, A. S., Nonsmooth Analysis of Eigenvalues, Mathematical Programming, Vol. 84, pp. 1–24, 1999.
Bonnans, J. F., and Shapiro, A., Perturbation Analysis of Optimization Problems, Springer Verlag, New York, NY, 2000.
Shapiro, A., First and Second-Order Analysis of Nonlinear Semidefinite Programs, Mathematical Programming, Vol. 77, pp. 301–320, 1997.
Forsgren, A., Optimality Conditions for Nonconvex Semidefinite Programming, Mathematical Programming, Vol. 88, pp. 105–128, 2000.
Sun, D., and Sun, J., Semismooth Matrix-Valued Functions, Mathematics of Operations Research, Vol. 27, pp. 150–169, 2002.
Chen, X., Qi, H., and Tseng, P., Analysis of Nonsmooth Symmetric Matrix Functions with Applications to Semidefinite Complementarity Problems, SIAM Journal on Optimization, Vol. 13, pp. 960–985, 2003.
Pang, J. S., Sun, D., and Sun, J., Semismooth Homeomorphisms and Strong Stability of Semidefinite and Lorentz Complementarity Problems, Mathematics of Operations Research, Vol. 28, pp. 39–63, 2003.
Shapiro, A., and Sun, J., Some Properties of the Augmented Lagrangian in Cone-Constrained Optimization, Mathematics of Operations Research, Vol. 29, pp. 479–491, 2004.
Chen, X., and Tseng, P., Non interior Continuation Methods for Solving Semidefinite Complementarity Problems, Mathematical Programming, Vol. 95, pp. 431–474, 2003.
Doljansky, M., and Teboulle, M., An Interior Proximal Algorithm and the Exponential Multiplier Method for Semidefinite Programming, SIAM Journal on Optimization, Vol. 9, pp. 1–13, 1999.
Zhang, L. W., and Liu, Y. J., Convergence Analysis of a Nonlinear Lagrange Algorithm for Nonlinear Programming with Inequality Constraints, Journal of Applied Mathematics and Computing, Vol. 13, pp. 1–10, 2003.
Sun, J., Sun, D., and Qi, L., A Squared Smoothing Newton Method for Nonsmooth Matrix Equations and Its Applications in Semidefinite Optimization Problems, SIAM Journal on Optimization, Vol. 14, pp. 783–806, 2004.
Zhang, L. W., and He, S. X., The Convergence of a Dual Algorithm for Nonlinear Programming, Korean Journal of Computational and Applied Mathematics, Vol. 7, pp. 478–506, 2000.
Horn, R. A., and Johnson, C. R., Topics in Matrix Analysis, Cambridge University Press, Cambridge, UK, 1991.
Lewis, A. S., Derivatives of Spectral Functions, Mathematics of Operations Research, Vol. 21, pp. 576–588, 1996.
Lewis, A. S., and Sendov, H. S., Twice Differentiable Spectral Functions, SIAM Journal on Matrix Analysis, Vol. 23, pp. 368–386, 2001.
Bertsekas, D. P., Optimization and Multiplier Methods, Academic Press, New York, NY, 1982.
Iusem, A., and Otero, R. G., Augmented Lagrangian Methods for Cone-Constrained Convex Optimization in Banach Spaces, Journal of Nonlinear and Convex Analysis, 2001 (submitted).
Author information
Authors and Affiliations
Additional information
Communicated by P. Tseng
The first author was partially supported by Singapore-MIT Alliance and by the National University of Singapore under Grants RP314000-028/042/057-112. The second author was partially supported by the Funds of the Ministry of Education of China for PhD Units under Grant 20020141013 and the National Natural Science Foundation of China under Grant 10471015.
Rights and permissions
About this article
Cite this article
Sun, J., Zhang, L.W. & Wu, Y. Properties of the Augmented Lagrangian in Nonlinear Semidefinite Optimization. J Optim Theory Appl 129, 437–456 (2006). https://doi.org/10.1007/s10957-006-9078-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-006-9078-8