Skip to main content
Log in

Properties of the Augmented Lagrangian in Nonlinear Semidefinite Optimization

  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

We study the properties of the augmented Lagrangian function for nonlinear semidefinite programming. It is shown that, under a set of sufficient conditions, the augmented Lagrangian algorithm is locally convergent when the penalty parameter is larger than a certain threshold. An error estimate of the solution, depending on the penalty parameter, is also established.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Rockafellar, R. T., Augmented Lagrange Multiplier Functions and Duality in Nonconvex Programming, SIAM Journal on Control and Optimization, Vol. 12, pp. 268–285, 1974.

    Article  MathSciNet  MATH  Google Scholar 

  2. Alizadeh, F., Interior-Point Methods in Semidefinite Programming with Application to Combinatorial Optimization, SIAM Journal on Optimization, Vol. 5, pp. 13–51, 1995.

    Article  MathSciNet  MATH  Google Scholar 

  3. Leibfritz, L., An LMI Based Algorithm for Designing Suboptimal Static H_2/H_∞ Feedback Controllers, SIAM Journal on Control and Optimization, Vol. 39, pp. 1711–1735, 2001.

    Article  MathSciNet  MATH  Google Scholar 

  4. Vandenberghe, L., and Boyd, S., Semidefinite Programming, SIAM Review, Vol. 38, pp. 49–95, 1996.

    Article  MathSciNet  MATH  Google Scholar 

  5. Wolkowicz, H., Saigal, R., and Vandenberghe, L., Handbook of Semidefinite Programming: Theory, Algorithms, and Applications, Kluwer Academic Publishers, Dordrecht, Holland, 2000.

    Google Scholar 

  6. Lewis, A. S., and Overton, M. L., Eigenvalue Optimization, Acta Numerica, Vol. 5, pp. 149–190, 1996.

    MathSciNet  Google Scholar 

  7. Lewis, A. S., Nonsmooth Analysis of Eigenvalues, Mathematical Programming, Vol. 84, pp. 1–24, 1999.

    MathSciNet  MATH  Google Scholar 

  8. Bonnans, J. F., and Shapiro, A., Perturbation Analysis of Optimization Problems, Springer Verlag, New York, NY, 2000.

    MATH  Google Scholar 

  9. Shapiro, A., First and Second-Order Analysis of Nonlinear Semidefinite Programs, Mathematical Programming, Vol. 77, pp. 301–320, 1997.

    Article  MathSciNet  Google Scholar 

  10. Forsgren, A., Optimality Conditions for Nonconvex Semidefinite Programming, Mathematical Programming, Vol. 88, pp. 105–128, 2000.

    Article  MathSciNet  MATH  Google Scholar 

  11. Sun, D., and Sun, J., Semismooth Matrix-Valued Functions, Mathematics of Operations Research, Vol. 27, pp. 150–169, 2002.

    Article  MathSciNet  MATH  Google Scholar 

  12. Chen, X., Qi, H., and Tseng, P., Analysis of Nonsmooth Symmetric Matrix Functions with Applications to Semidefinite Complementarity Problems, SIAM Journal on Optimization, Vol. 13, pp. 960–985, 2003.

    Article  MathSciNet  MATH  Google Scholar 

  13. Pang, J. S., Sun, D., and Sun, J., Semismooth Homeomorphisms and Strong Stability of Semidefinite and Lorentz Complementarity Problems, Mathematics of Operations Research, Vol. 28, pp. 39–63, 2003.

    Article  MathSciNet  MATH  Google Scholar 

  14. Shapiro, A., and Sun, J., Some Properties of the Augmented Lagrangian in Cone-Constrained Optimization, Mathematics of Operations Research, Vol. 29, pp. 479–491, 2004.

    Article  MathSciNet  MATH  Google Scholar 

  15. Chen, X., and Tseng, P., Non interior Continuation Methods for Solving Semidefinite Complementarity Problems, Mathematical Programming, Vol. 95, pp. 431–474, 2003.

    Article  MathSciNet  MATH  Google Scholar 

  16. Doljansky, M., and Teboulle, M., An Interior Proximal Algorithm and the Exponential Multiplier Method for Semidefinite Programming, SIAM Journal on Optimization, Vol. 9, pp. 1–13, 1999.

    Article  MathSciNet  Google Scholar 

  17. Zhang, L. W., and Liu, Y. J., Convergence Analysis of a Nonlinear Lagrange Algorithm for Nonlinear Programming with Inequality Constraints, Journal of Applied Mathematics and Computing, Vol. 13, pp. 1–10, 2003.

    Article  MathSciNet  MATH  Google Scholar 

  18. Sun, J., Sun, D., and Qi, L., A Squared Smoothing Newton Method for Nonsmooth Matrix Equations and Its Applications in Semidefinite Optimization Problems, SIAM Journal on Optimization, Vol. 14, pp. 783–806, 2004.

    Article  MathSciNet  MATH  Google Scholar 

  19. Zhang, L. W., and He, S. X., The Convergence of a Dual Algorithm for Nonlinear Programming, Korean Journal of Computational and Applied Mathematics, Vol. 7, pp. 478–506, 2000.

    MathSciNet  Google Scholar 

  20. Horn, R. A., and Johnson, C. R., Topics in Matrix Analysis, Cambridge University Press, Cambridge, UK, 1991.

    MATH  Google Scholar 

  21. Lewis, A. S., Derivatives of Spectral Functions, Mathematics of Operations Research, Vol. 21, pp. 576–588, 1996.

    Article  MathSciNet  MATH  Google Scholar 

  22. Lewis, A. S., and Sendov, H. S., Twice Differentiable Spectral Functions, SIAM Journal on Matrix Analysis, Vol. 23, pp. 368–386, 2001.

    Article  MathSciNet  MATH  Google Scholar 

  23. Bertsekas, D. P., Optimization and Multiplier Methods, Academic Press, New York, NY, 1982.

    MATH  Google Scholar 

  24. Iusem, A., and Otero, R. G., Augmented Lagrangian Methods for Cone-Constrained Convex Optimization in Banach Spaces, Journal of Nonlinear and Convex Analysis, 2001 (submitted).

Download references

Author information

Authors and Affiliations

Authors

Additional information

Communicated by P. Tseng

The first author was partially supported by Singapore-MIT Alliance and by the National University of Singapore under Grants RP314000-028/042/057-112. The second author was partially supported by the Funds of the Ministry of Education of China for PhD Units under Grant 20020141013 and the National Natural Science Foundation of China under Grant 10471015.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sun, J., Zhang, L.W. & Wu, Y. Properties of the Augmented Lagrangian in Nonlinear Semidefinite Optimization. J Optim Theory Appl 129, 437–456 (2006). https://doi.org/10.1007/s10957-006-9078-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10957-006-9078-8

Key Words

Navigation