Abstract
The purpose of this note is to provide some estimates relating to Newton-type methods of multipliers. These estimates can be used to infer that convergence in such methods can be achieved for an arbitrary choice of the initial multiplier vector by selecting the penalty parameter sufficiently large.
Similar content being viewed by others
References
Bertsekas, D. P.,Multiplier Methods: A Survey, Automatica, Vol. 12, pp. 133–145, 1976.
Bertsekas, D. P.,On Penalty and Multiplier Methods for Constrained Minimization, SIAM Journal on Control and Optimization, Vol. 14, pp. 216–235, 1976.
Tapia, R. A.,Newton's Method for Optimization Problems with Equality Constraints, SIAM Journal on Numerical Analysis, Vol. 11, pp. 874–886, 1974.
Tapia, R. A.,Diagonalized Multiplier Methods and Quasi-Newton Methods for Constrained Optimization, Journal of Optimization Theory and Applications, Vol. 22, pp. 135–194, 1977.
Han, S. P.,Dual Variable Metric Algorithms for Constrained Optimization, SIAM Journal on Control and Optimization, Vol. 15, pp. 546–565, 1977.
Bertsekas, D. P.,Convergence Rate of Penalty and Multiplier Methods, Proceedings of 1973 IEEE Conference on Decision and Control, San Diego, California, pp. 260–264, 1973.
Polyak, V. T., andTretyakov, N. V.,The Method of Penalty Estimates for Conditional Extremum Problems, USSR Computational Mathematics and Mathematical Physics, Vol. 13, pp. 42–58, 1974.
Bertsekas, D. P.,Combined Penalty and Lagrangian Methods for Constrained Optimization, University of Illinois, Urbana, Illinois, Coordinated Science Laboratory, Working Paper, 1977.
Author information
Authors and Affiliations
Additional information
Communicated by O. L. Mangasarian
This work was supported by Grant No. NSF ENG 74-19332.
Rights and permissions
About this article
Cite this article
Bertsekas, D.P. On the convergence properties of second-order multiplier methods. J Optim Theory Appl 25, 443–449 (1978). https://doi.org/10.1007/BF00932905
Issue Date:
DOI: https://doi.org/10.1007/BF00932905