Abstract
An algorithm based on a combination of the polyhedral and quadratic approximation is given for finding stationary points for unconstrained minimization problems with locally Lips-chitz problem functions that are not necessarily convex or differentiable. Global convergence of the algorithm is established. Under additional assumptions, it is shown that the algorithm generates Newton iterations and that the convergence is superlinear. Some encouraging numerical experience is reported.
Similar content being viewed by others
References
Cheney, E.W., Goldstein, A.A., 1959. Newton's method for convex programming and Tchebycheff approximation. Numer. Math 1, 253–268.
Clarke, F.H., 1983. Optimization and Nonsmooth Analysis. Wiley-Interscience, New York.
Fletcher, R., 1987. Practical Methods of Optimization. Wiley, Chichester.
Gill, P.E., Murray, W., 1974. Newton-type methods for unconstrained and linearly constrained optimization. Math. Programming 7, 311–350.
Hiriart-Urruty, J.B., Lemarechal, C., 1993. Convex Analysis and Minimization Algorithms I, II. Springer, Berlin.
Kelley, J.E., 1960. The cutting plane method for solving convex programs. SIAM J. 8, 703–712.
Kiwiel, K.C., 1985. Methods of descent for nondifferentiable optimization. In: Lecture Notes in Mathematics, vol. 1133, Springer, Berlin.
Kiwiel, K.C., 1989. An ellipsoid trust region bundle method for nonsmooth convex minimization. SIAM J. Control Optim. 27, 737–757.
Kiwiel, K.C., 1996. Restricted step and Levenberg-Marquardt techniques in proximal bundle methods for nonconvex nondifferentiable optimization. SIAM J. Optim. 6, 227–249.
Lemarechal, C., 1978. Nonsmooth optimization and descent methods, Report RR-78-4, International Institute for Applied System Analysis, Laxenburg, Austria.
Lukšan, L., 1984. Dual method for solving a special problem of quadratic programming as a subproblem at lineary constrained nonlinear minimar approximation. Kybernetika 20, 445–457.
Mäkelä, M.M., Neittaanmäki, P., 1992. Nonsmooth Optimization. World Scientific, London.
Mifflin, R., 1982. A modification and an extension of Lemarechal's algorithm for nonsmooth minimization. Math. Programming Study 17, 77–90.
Mifflin, R., 1984. Better than linear convergence and safeguarding in nonsmooth minimization. In: Thoft-Christensen, P. (Ed.), System Modelling and Optimization, Springer, New York, pp. 321–330.
Mifflin, R., 1992. Ideas for developing a rapidly convergent algorithm for nonsmooth minimization. In: Gianessi, F. (Ed.), Nonsmooth Optimization Methods and Applications. Gordon and Breach, Amsterdam, pp. 228–239.
Schramm, H., Zowe, J., 1992. A version of the bundle idea for minimizing a nonsmooth function: conceptual idea, convergence analysis, numerical results. SIAM J. Optim. 2, 121–152.
Author information
Authors and Affiliations
Additional information
This work was supported by the grant No. 201/96/0918 given by the Czech Republic Grant Agency.
Rights and permissions
About this article
Cite this article
Lukšan, L., Vlček, J. A bundle-Newton method for nonsmooth unconstrained minimization. Mathematical Programming 83, 373–391 (1998). https://doi.org/10.1007/BF02680566
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02680566