Abstract
An algorithm for solving linearly constrained optimization problems is proposed. The search direction is computed by a bundle principle and the constraints are treated through an active set strategy. Difficulties that arise when the objective function is nonsmooth, require a clever choice of a constraint to relax. A certain nondegeneracy assumption is necessary to obtain convergence.
Similar content being viewed by others
References
R.H. Byrd and G.A. Shultz, “A practical class of globally convergent active set strategies for linearly constrained optimization,” Computer Science Department Report CUCS238-82, University of Colorado, (Boulder, 1982).
R.S. Dembo and S. Sahi, “A convergent framework for constrained nonlinear optimization,” School of Organization and Management Working Paper Series B #80, Yale University (New Haven, 1983).
R. Fletcher,Practical Methods of Optimization, Vol. 2 (John Wiley and Sons, Chichester-New York, 1980) pp. 113–117.
P.E. Gill, W. Murray and M.H. Wright,Practical Optimization (Academic Press, London-New York, 1981).
J.B. Hiriart-Urruty, “ε-Subdifferential calculus. Convex analysis and optimization,” in: J.P. Aubin and B. Vinter, eds.,Research Notes in Mathematics Series 57 (Pitman Publishers, Boston, Massachusetts, London, 1982) pp. 43–92.
C. Lemaréchal, “A view of line searches,” in: A. Auslender, W. Oettli and J. Stoer, eds.,Optimization and Optimal Control, Lecture Notes in Control and Information Sciences 30 (Springer-Verlag, Berlin-New York, 1981) pp. 59–78.
C. Lemaréchal, “Basic theory in nondifferentiable optimization. A tutorial and algorithmic oriented approach,” Rapport de Recherche #181, INRIA (Rocquencourt, 1982).
C. Lemaréchal, J.J. Strodiot and A. Bihain, “On a bundle algorithm for nonsmooth optimization,” in: O. Mangasarian, R. Meyer and S. Robinson, eds.,Nonlinear Programming 4 (Academic Press, New York-London, 1981) pp. 245–282.
M.L. Lenard, “A computational study of active set strategies in nonlinear programming with linear constraints,”Mathematical Programming 16 (1979) 81–97.
G.P. McCormick, “Anti-zigzagging by bending,”Management Science 15 (1969) 315–320.
R. Mifflin, “A stable method for solving certain constrained least squares problems,”Mathematical Programming 16 (1979) 141–158.
R. Mifflin, “Stationarity and superlinear convergence of an algorithm for univariate locally Lipschitz constrained minimization,”Mathematical Programming 28 (1984) 50–71.
V.H. Nguyen and J.J. Strodiot, “A linearly constrained algorithm not requiring derivative continuity,”Engineering Structures 6 (1984) 7–11.
M.J.D. Powell, “Gradient conditions and Lagrange multipliers in nonlinear programming”, in: L.C.W. Dixon, E. Spedicato and G.P. Szegö, eds.,Nonlinear Optimization Theory and Algorithms (Birkhäuser 1980), pp. 201–220.
K. Ritter, “A method of conjugate directions for linearly constrained nonlinear programming problems,”SIAM Journal on Numerical Analysis 12 (1975) 273–303.
R.T. Rockafellar,The Theory of Subgradients and its Applications to Problems of Optimization, Collection de la Chaire Aisenstadt (Les Presses de l'Université de Montréal, Canada, 1978).
J.B. Rosen, “The gradient projection method for nonlinear programming. Part I. Linear Constraints,”SIAM Journal 8 (1960) 181–217.
H.K. Schultz, “A Kuhn-Tucker algorithm,”SIAM Journal on Control and optimization 11 (1973) 438–445.
V.P. Sreedharan, “A subgradient projection algorithm,”Journal of Approximation Theory 35 (1982) 111–126.
J.J. Strodiot, V.H. Nguyen and N. Heukemes, “ε-Optimal solutions in nondifferentiable convex programming and some related questions,”Mathematical Programming 25 (1983) 307–328.
P. Wolfe, “On the convergence of gradient methods under constraint. Mathematics of numerical computation,”IBM Journal of Research and Development 16 (1972) 407–411.
G. Zoutendijk, “Nonlinear programming, computational methods,” in: J. Abadie, ed.,Integer and Nonlinear Programming (North-Holland, Amsterdam, 1970) pp. 511–523.
J. Zowe, “Nondifferentiable optimization,” in: K. Schittkowski, ed.,Computational Mathematical Programming (Springer-Verlag, Berlin, 1985) pp. 323–356.
Author information
Authors and Affiliations
Additional information
Most of this research was performed when the author was with I.N.R.I.A. (Domaine de Voluceau-Rocquencourt, B.P. 105, 78153 Le Chesnay Cédex, France).
This research was supported in part by the National Science Foundation, Grants No. DMC-84-51515 and OIR-85-00108.
Rights and permissions
About this article
Cite this article
Panier, E.R. An active set method for solving linearly constrained nonsmooth optimization problems. Mathematical Programming 37, 269–292 (1987). https://doi.org/10.1007/BF02591738
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02591738