Abstract
A readily implementable subgradient algorithm is given for minimizing a convex, but not necessarily differentiable, functionf subject to a finite number of linear constraints. It is shown that the algorithm converges to a solution, if any. The convergence is finite iff is piecewise linear.
Zusammenfassung
Ein Subgradientenalgorithmus für konvexe, nicht unbedingt differenzierbare Funktionen mit einer endlichen Anzahl von Nebenbedingungen wird angegeben. Es wird bewiesen, daß der Algorithmus gegen die Lösung konvergiert, wenn es eine Lösung gibt. Die Lösung wird im Fall einer stückweise linearen Funktion nach endlich vielen Schritten erreicht.
Similar content being viewed by others
References
Dantzig, G. B.: Linear Programming and Extensions. Princeton, N. J.: Princeton University Press 1963.
Demyanov, V. F., Vasilev, L. V.: Nondifferentiable Optimization. Moscow: Nauka 1981 (in Russian). (English translation: Optimization Software Inc. New York: Springer 1985.)
Kelley, J. E.: The cutting plane method for solving convex programs. Journal of the Society for Industrial and Applied Mathematics8, 703–712 (1960).
Kiwiel, K. C.: Efficient algorithms for nonsmooth optimization and their applications Ph. D. Thesis, Dept. of Electronics, Technical University of Warsaw, Warsaw, 1982 (in Polish).
Kiwiel, K. C.: An aggregate subgradient method for nonsmooth convex minimization. Mathematical Programming27, 320–341 (1983).
Kiwiel, K. C.: An algorithm for linearly constrained convex nondifferentiable minimization problems. Journal of Mathematical Analysis and Applications105, 452–465 (1985).
Lasdon, L. S.: Optimization Theory for Large Systems. New York: Macmillan 1970.
Lemarechal, C.: Nonsmooth optimization and descent methods. RR-78-4, International Institute for Applied Systems Analysis, Laxenburg, Austria, 1978.
Lemarechal, C., Strodiot, J. J., Bihain, A.: On a boundle algorithm for nonsmooth optimization. In: Nonlinear Programming 4 (O. L. Mangasarian, R. R. Meyer and S. M. Robinson, eds.), pp. 245–281. New York: Academic Press 1981.
Mifflin, R.: An algorithm for constrained optimization with semismooth functions. Mathematics of Operations Research2, 191–207 (1977).
Mifflin, R.: A modification and an extension of Lemarechal's algorithm for nonsmooth optimization. In: Nondifferential and Variational Techniques in Optimization (D. C. Sorensen and R. J. B. Wets, eds.). Mathematical Programming Study.17, 77–90. Amsterdam: North Holland 1982.
Pshenichny, B. N.: Convex Analysis and Extremal Problems. Moskow: Nauka 1980 (in Russian).
Shor, N. Z.: Methods for Minimizing Nondifferentiable Functions and Their Applications. Kiev: Naukova Dumka 1979. (in Russian). (English translation: Minimization Methods for Nondifferentiable Functions. Berlin: Springer 1985.)
Strodiot, J. J., Nguyen, V. H., Heukemes, M.: ε-optimal solutions and related questions. Mathematical Programming25, 307–328 (1983).
Wierzbicki, A. P.: Lagrangian functions and nondifferentiable optimization. In: Progress in Nondifferentiable Optimization (E. A. Nurminski, ed.), pp. 173–213. International Institute for Applied Systems Analysis, Laxenburg, Austria, 1982.
Wolfe, P.: A method of conjugate subgradients for minimizing nondifferentiable functions. In: Nondifferentiable Optimization (M. Balinski, P. Wolfe, eds.), Mathematical Programming Study3, 145–173. Amsterdam: North Holland 1975.
Author information
Authors and Affiliations
Additional information
This work was sponsored by Project CPBP-02-15.
Rights and permissions
About this article
Cite this article
Kiwiel, K.C. A subgradient selection method for minimizing convex functions subject to linear constraints. Computing 39, 293–305 (1987). https://doi.org/10.1007/BF02239973
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF02239973