Skip to main content
Log in

An active set method for solving linearly constrained nonsmooth optimization problems

  • Published:
Mathematical Programming Submit manuscript

Abstract

An algorithm for solving linearly constrained optimization problems is proposed. The search direction is computed by a bundle principle and the constraints are treated through an active set strategy. Difficulties that arise when the objective function is nonsmooth, require a clever choice of a constraint to relax. A certain nondegeneracy assumption is necessary to obtain convergence.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. R.H. Byrd and G.A. Shultz, “A practical class of globally convergent active set strategies for linearly constrained optimization,” Computer Science Department Report CUCS238-82, University of Colorado, (Boulder, 1982).

    Google Scholar 

  2. R.S. Dembo and S. Sahi, “A convergent framework for constrained nonlinear optimization,” School of Organization and Management Working Paper Series B #80, Yale University (New Haven, 1983).

    Google Scholar 

  3. R. Fletcher,Practical Methods of Optimization, Vol. 2 (John Wiley and Sons, Chichester-New York, 1980) pp. 113–117.

    Google Scholar 

  4. P.E. Gill, W. Murray and M.H. Wright,Practical Optimization (Academic Press, London-New York, 1981).

    MATH  Google Scholar 

  5. J.B. Hiriart-Urruty, “ε-Subdifferential calculus. Convex analysis and optimization,” in: J.P. Aubin and B. Vinter, eds.,Research Notes in Mathematics Series 57 (Pitman Publishers, Boston, Massachusetts, London, 1982) pp. 43–92.

    Google Scholar 

  6. C. Lemaréchal, “A view of line searches,” in: A. Auslender, W. Oettli and J. Stoer, eds.,Optimization and Optimal Control, Lecture Notes in Control and Information Sciences 30 (Springer-Verlag, Berlin-New York, 1981) pp. 59–78.

    Chapter  Google Scholar 

  7. C. Lemaréchal, “Basic theory in nondifferentiable optimization. A tutorial and algorithmic oriented approach,” Rapport de Recherche #181, INRIA (Rocquencourt, 1982).

  8. C. Lemaréchal, J.J. Strodiot and A. Bihain, “On a bundle algorithm for nonsmooth optimization,” in: O. Mangasarian, R. Meyer and S. Robinson, eds.,Nonlinear Programming 4 (Academic Press, New York-London, 1981) pp. 245–282.

    Google Scholar 

  9. M.L. Lenard, “A computational study of active set strategies in nonlinear programming with linear constraints,”Mathematical Programming 16 (1979) 81–97.

    Article  MATH  MathSciNet  Google Scholar 

  10. G.P. McCormick, “Anti-zigzagging by bending,”Management Science 15 (1969) 315–320.

    Article  Google Scholar 

  11. R. Mifflin, “A stable method for solving certain constrained least squares problems,”Mathematical Programming 16 (1979) 141–158.

    Article  MATH  MathSciNet  Google Scholar 

  12. R. Mifflin, “Stationarity and superlinear convergence of an algorithm for univariate locally Lipschitz constrained minimization,”Mathematical Programming 28 (1984) 50–71.

    MATH  MathSciNet  Google Scholar 

  13. V.H. Nguyen and J.J. Strodiot, “A linearly constrained algorithm not requiring derivative continuity,”Engineering Structures 6 (1984) 7–11.

    Article  Google Scholar 

  14. M.J.D. Powell, “Gradient conditions and Lagrange multipliers in nonlinear programming”, in: L.C.W. Dixon, E. Spedicato and G.P. Szegö, eds.,Nonlinear Optimization Theory and Algorithms (Birkhäuser 1980), pp. 201–220.

  15. K. Ritter, “A method of conjugate directions for linearly constrained nonlinear programming problems,”SIAM Journal on Numerical Analysis 12 (1975) 273–303.

    Article  MATH  MathSciNet  Google Scholar 

  16. R.T. Rockafellar,The Theory of Subgradients and its Applications to Problems of Optimization, Collection de la Chaire Aisenstadt (Les Presses de l'Université de Montréal, Canada, 1978).

    Google Scholar 

  17. J.B. Rosen, “The gradient projection method for nonlinear programming. Part I. Linear Constraints,”SIAM Journal 8 (1960) 181–217.

    MATH  Google Scholar 

  18. H.K. Schultz, “A Kuhn-Tucker algorithm,”SIAM Journal on Control and optimization 11 (1973) 438–445.

    Article  MATH  MathSciNet  Google Scholar 

  19. V.P. Sreedharan, “A subgradient projection algorithm,”Journal of Approximation Theory 35 (1982) 111–126.

    Article  MATH  MathSciNet  Google Scholar 

  20. J.J. Strodiot, V.H. Nguyen and N. Heukemes, “ε-Optimal solutions in nondifferentiable convex programming and some related questions,”Mathematical Programming 25 (1983) 307–328.

    MATH  MathSciNet  Google Scholar 

  21. P. Wolfe, “On the convergence of gradient methods under constraint. Mathematics of numerical computation,”IBM Journal of Research and Development 16 (1972) 407–411.

    Article  MATH  MathSciNet  Google Scholar 

  22. G. Zoutendijk, “Nonlinear programming, computational methods,” in: J. Abadie, ed.,Integer and Nonlinear Programming (North-Holland, Amsterdam, 1970) pp. 511–523.

    Google Scholar 

  23. J. Zowe, “Nondifferentiable optimization,” in: K. Schittkowski, ed.,Computational Mathematical Programming (Springer-Verlag, Berlin, 1985) pp. 323–356.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

Most of this research was performed when the author was with I.N.R.I.A. (Domaine de Voluceau-Rocquencourt, B.P. 105, 78153 Le Chesnay Cédex, France).

This research was supported in part by the National Science Foundation, Grants No. DMC-84-51515 and OIR-85-00108.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Panier, E.R. An active set method for solving linearly constrained nonsmooth optimization problems. Mathematical Programming 37, 269–292 (1987). https://doi.org/10.1007/BF02591738

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02591738

Key words

Navigation