Skip to main content
Log in

A bundle-Newton method for nonsmooth unconstrained minimization

  • Published:
Mathematical Programming Submit manuscript

Abstract

An algorithm based on a combination of the polyhedral and quadratic approximation is given for finding stationary points for unconstrained minimization problems with locally Lips-chitz problem functions that are not necessarily convex or differentiable. Global convergence of the algorithm is established. Under additional assumptions, it is shown that the algorithm generates Newton iterations and that the convergence is superlinear. Some encouraging numerical experience is reported.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Cheney, E.W., Goldstein, A.A., 1959. Newton's method for convex programming and Tchebycheff approximation. Numer. Math 1, 253–268.

    Article  MATH  MathSciNet  Google Scholar 

  • Clarke, F.H., 1983. Optimization and Nonsmooth Analysis. Wiley-Interscience, New York.

    MATH  Google Scholar 

  • Fletcher, R., 1987. Practical Methods of Optimization. Wiley, Chichester.

    MATH  Google Scholar 

  • Gill, P.E., Murray, W., 1974. Newton-type methods for unconstrained and linearly constrained optimization. Math. Programming 7, 311–350.

    Article  MATH  MathSciNet  Google Scholar 

  • Hiriart-Urruty, J.B., Lemarechal, C., 1993. Convex Analysis and Minimization Algorithms I, II. Springer, Berlin.

    Google Scholar 

  • Kelley, J.E., 1960. The cutting plane method for solving convex programs. SIAM J. 8, 703–712.

    MathSciNet  Google Scholar 

  • Kiwiel, K.C., 1985. Methods of descent for nondifferentiable optimization. In: Lecture Notes in Mathematics, vol. 1133, Springer, Berlin.

    Google Scholar 

  • Kiwiel, K.C., 1989. An ellipsoid trust region bundle method for nonsmooth convex minimization. SIAM J. Control Optim. 27, 737–757.

    Article  MATH  MathSciNet  Google Scholar 

  • Kiwiel, K.C., 1996. Restricted step and Levenberg-Marquardt techniques in proximal bundle methods for nonconvex nondifferentiable optimization. SIAM J. Optim. 6, 227–249.

    Article  MATH  MathSciNet  Google Scholar 

  • Lemarechal, C., 1978. Nonsmooth optimization and descent methods, Report RR-78-4, International Institute for Applied System Analysis, Laxenburg, Austria.

    Google Scholar 

  • Lukšan, L., 1984. Dual method for solving a special problem of quadratic programming as a subproblem at lineary constrained nonlinear minimar approximation. Kybernetika 20, 445–457.

    MathSciNet  Google Scholar 

  • Mäkelä, M.M., Neittaanmäki, P., 1992. Nonsmooth Optimization. World Scientific, London.

    MATH  Google Scholar 

  • Mifflin, R., 1982. A modification and an extension of Lemarechal's algorithm for nonsmooth minimization. Math. Programming Study 17, 77–90.

    MATH  MathSciNet  Google Scholar 

  • Mifflin, R., 1984. Better than linear convergence and safeguarding in nonsmooth minimization. In: Thoft-Christensen, P. (Ed.), System Modelling and Optimization, Springer, New York, pp. 321–330.

    Chapter  Google Scholar 

  • Mifflin, R., 1992. Ideas for developing a rapidly convergent algorithm for nonsmooth minimization. In: Gianessi, F. (Ed.), Nonsmooth Optimization Methods and Applications. Gordon and Breach, Amsterdam, pp. 228–239.

    Google Scholar 

  • Schramm, H., Zowe, J., 1992. A version of the bundle idea for minimizing a nonsmooth function: conceptual idea, convergence analysis, numerical results. SIAM J. Optim. 2, 121–152.

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

This work was supported by the grant No. 201/96/0918 given by the Czech Republic Grant Agency.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lukšan, L., Vlček, J. A bundle-Newton method for nonsmooth unconstrained minimization. Mathematical Programming 83, 373–391 (1998). https://doi.org/10.1007/BF02680566

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02680566

Keywords

Navigation