Abstract
Over the past few years a number of researchers in mathematical programming became very interested in the method of the Augmented Lagrangian to solve the nonlinear programming problem. The main reason being that the Augmented Lagrangian approach overcomes the ill-conditioning problem and the slow convergence of the penalty methods. The purpose of this paper is to present a new method of solving the nonlinear programming problem, which has similar characteristics to the Augmented Lagrangian method. The original nonlinear programming problem is transformed into the minimization of a leastpth objective function which under certain conditions has the same optimum as the original problem. Convergence and rate of convergence of the new method is also proved. Furthermore numerical results are presented which illustrate the usefulness of the new approach to nonlinear programming.
Similar content being viewed by others
References
R.R. Allan and S.E.J. Johnsen, “An algorithm for solving nonlinear programming problems subject to nonlinear inequality constraints”,The Computer Journal 13 (1970) 171–177.
J. Asaadi, “A computational comparison of some non-linear programs”,Mathematical Programming 4 (1973) 144.
J.W. Bandler and C. Charalambous, “A new approach to nonlinear programming”, in:Proceedings of the fifth Hawaii international conference on system sciences (University of Hawaii, Honolulu, HI, January 1972).
J.W. Bandler and C. Charalambous, “Nonlinear programming using minimax techniques”,Journal of Optimization Theory and Applications 13 (1974) 607–619.
J.W. Bandler and C. Charalambous, “Practical leastpth optimization of networks”,IEEE Transactions on Microwave Theory and Technology (1972 Symposium Issue) MTT-20 (1972) 834–840.
D.P. Bertsekas, “On penalty and multiplier methods for constrained optimization”, in:Proceedings of the nonlinear programming symposium (University of Wisconsin, Madison, WI, 1974).
M.J. Best and K. Ritter, “A class of accelerated conjugate direction methods for linear constrained minimization problems”, Rept. CORR 74-12, dept. of combinatorics and optimization, Univ. Waterloo, Waterloo, Ont., Canada (1974).
C. Charalambous and J.W. Bandler, “Nonlinear minimax optimization as a sequence of leastpth optimization with finite values ofp”,International Journal of Systems Science 7 (1976) 377–391.
A.R. Conn, “Constrained optimization using nondifferentiable penalty function”,SIAM Journal on Numerical Analysis 10 (1973) 760–784.
A.V. Fiacco and G.P. McCormick,Nonlinear programming: sequential unconstrained minimization techniques (Wiley, New York, 1968).
R. Fletcher, “A new approach to variable metric algorithms”,The Computer Journal 13 (1970) 317–322.
R. Fletcher, “An exact penalty function for nonlinear programming with inequalities”,Mathematical Programming 5 (1973) 129–150.
P.C. Haarhoff and J.D. Buys, “A new method for the optimization of a nonlinear function subject to nonlinear constraints”,The Computer Journal 13 (1970) 178.
M.R. Hestenes, “Multiplier and gradient methods”,Journal of Optimization Theory and Applications 4 (1969) 303.
L.S. Lasdon,Optimization theory for large systems (Macmillan, New York, 1970).
F.A. Lootsma, “A survey of methods for solving constrained optimization problems via unconstrained minimization”, in: F.A. Lootsma, ed.,Numerical methods for nonlinear programming (Academic Press, New York, 1972).
T. Pietrzykowski, “An exact potential method for constrained maxima”,SIAM Journal on Numerical Analysis 6 (1969) 299–304.
V.T. Polyak and N.V. Tret'yakov, “The method of penalty estimates for conditional extremum problems”,Žurnal Vyčhislitel'noi Matematiki i Matematičeskoi Fiziki 13 (1973) 34–36.
M.J.D. Powell, “A method for nonlinear constraints in minimization problems”, in: R. Fletcher, ed.,Optimization (Academic Press, 1969).
J.R. Rice,The approximation of functions (Addison-Wesley, Reading, MA, 1969).
R.T. Rockafellar, “A dual approach to solving nonlinear programming problems by unconstrained optimization”,Mathematical Programming 5 (1973) 354–373.
R.T. Rockafellar, “Augmented Lagrangian multiplier functions and duality in nonconvex programming”,SIAM Journal on Control 12 (1974) 268–285.
Author information
Authors and Affiliations
Additional information
This work was supported by the National Research Council of Canada and by the Department of Combinatorics and Optimization of the University of Waterloo.
Rights and permissions
About this article
Cite this article
Charalambous, C. Nonlinear leastpth optimization and nonlinear programming. Mathematical Programming 12, 195–225 (1977). https://doi.org/10.1007/BF01593788
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF01593788