Abstract
In this paper, we present a general scheme for bundle-type algorithms which includes a nonmonotone line search procedure and for which global convergence can be proved. Some numerical examples are reported, showing that the nonmonotonicity can be beneficial from a computational point of view.
Similar content being viewed by others
References
Rockafellar, R. T.,Convex Analysis, Princeton University Press, Princeton, New Jersey, 1970.
Dem'yanov, V. F., andMalozemov, V. N.,Introduction to Minimax, Wiley, New York, New York, 1974.
Clarke, F. H.,Optimization and Nonsmooth Analysis, Wiley, New York, New York, 1983.
Dem'yanov, V. F., andVasil'ev, V.,Nondifferentiable Optimization, Springer-Verlag, New York, New York, 1986.
Shor, N. Z.,Minimization Methods for Nondifferentiable Functions, Springer-Verlag, Berlin, Germany, 1985.
Lemarechal, C.,An Extension of Davidon Methods to Nondifferentiable Problems, Mathematical Programming Study, Vol. 3, pp. 95–109, 1975.
Mifflin, R.,An Algorithm for Constrained Optimization with Semismooth Functions, Mathematics of Operations Research, Vol. 2, pp. 191–207, 1977.
Wolfe, P.,A Method of Conjugate Subgradients for Minimizing Nondifferentiable Convex Functions, Mathematical Programming Study, Vol. 3, pp. 145–173, 1975.
Auslander, A.,Numerical Methods for Nondifferentiable Convex Optimization, Mathematical Programming Study, Vol. 30, pp. 102–126, 1987.
Fukushima, M.,A Descent Algorithm for Nonsmooth Convex Optimization, Mathematical Programming, Vol. 30, pp. 163–175, 1984.
Gaudioso, M., andMonaco, M. F.,A Bundle-Type Approach to the Unconstrained Minimization of Convex Nonsmooth Functions, Mathematical Programming, Vol. 23, pp. 216–226, 1984.
Gaudioso, M., andMonaco, M. F.,Quadratic Approximations in Convex Nondifferentiable Optimization, SIAM Journal on Control and Optimization, Vol. 29, pp. 1–13, 1991.
Kiwiel, K. C.,An Aggregate Subgradient Method for Nonsmooth Convex Minimization, Mathematical Programming, Vol. 27, pp. 320–341, 1983.
Kiwiel, K. C.,Methods of Descent for Nondifferentiable Optimization, Lecture Notes in Mathematics, Springer-Verlag, Berlin, Germany, Vol. 1133, 1985.
Kiwiel, K. C.,An Ellipsoid Trust-Region Bundle Method for Convex Nondifferentiable Minimization, SIAM Journal on Control and Optimization, Vol. 27, pp. 737–757, 1989.
Kiwiel, K. C.,Proximity Control in Bundle Methods for Convex Nondifferentiable Minimization, Mathematical Programming, Vol. 46, pp. 105–122, 1990.
Mifflin, R.,A Modification and an Extension of Lemaréchal's Algorithm for Nonsmooth Optimization, Mathematical Programming Study, Vol. 17, pp. 77–90, 1982.
Schramm, H., andZowe, J.,A Version of the Bundle Idea for Minimizing a Nonsmooth Function: Conceptual Idea, Convergence Analysis, Numerical Results, SIAM Journal on Optimization, Vol. 2, pp. 121–152, 1992.
Lemarechal, C.,Numerical Experiments in Nonsmooth Optimization, Progress in Nondifferentiable Optimization, Edited by E. A. Nurminskii, IIASA Proceedings, Laxenburg, Austria, pp. 61–84, 1982.
Grippo, L., Lampariello, F., andLucidi, S.,A Nonmonotone Line Search Technique for Newton's Method, SIAM Journal on Numerical Analysis, Vol. 23, pp. 707–716, 1986.
Grippo, L., Lampariello, F., andLucidi, S.,A Class of Nonmonotone Stabilization Methods in Unconstrained Optimization, Numerische Mathematik, Vol. 59, pp. 779–805, 1991.
Zowe, J.,Nondifferentiable Optimization, Computational Mathematical Programming, Edited by K. Schittkowski, Springer-Verlag, Berlin, Germany, pp. 323–356, 1985.
Pang, J. S., Han, S. P., andRangaraj, N.,Minimization of Locally Lipschitz Functions, SIAM Journal on Optimization, Vol. 1, pp. 57–82, 1991.
Polyak, B. T.,Introduction to Optimization, Springer-Verlag, New York, New York, 1987.
Facchinei, F., andLucidi, S.,A Nonmonotone Bundle-Type Method for Convex Nonsmooth Minimization, Technical Report DIS-07.89, Università di Roma “La Sapienza,” 1989.
Powell, M. J. D.,A Fast Algorithm for Nonlinearly Constrained Optimization Calculations, Numerical Analysis Dundee, Edited by G. A. Watson, Springer-Verlag, Berlin, Germany, pp. 144–157, 1978.
Pesamosca, R.,On the Solution of the Generalized Steiner Problem by the Subgradient Method, Technical Report DMMM, Universita' di Roma “La Sapienza,” 1987.
Author information
Authors and Affiliations
Additional information
Communicated by G. Di Pillo
This work was partially supported by the National Research Program on “Metodi di ottimizzazione per le decisioni,” Ministero dell' Universitá e della Ricerca Scientifica e Tecnologica and by ASI: Agenzia Spaziale Italiana.
Rights and permissions
About this article
Cite this article
Facchinei, F., Lucidi, S. Nonmonotone bundle-type scheme for convex nonsmooth minimization. J Optim Theory Appl 76, 241–257 (1993). https://doi.org/10.1007/BF00939607
Issue Date:
DOI: https://doi.org/10.1007/BF00939607