Abstract
The problem of finding minima of weakly sequentially lower semicontinuous functions on reflexive Banach spaces is studied by means of convex and nonconvex subdifferentials. Finding a descent direction for a non-stationary point is a question of importance for many optimization algorithms. The existence or non-existence of such a direction is clarified through several theorems and a series of selective examples. For the general problem, a notion called radius of descent is proposed and shown to be useful for the analysis related to descent directions.
Similar content being viewed by others
References
Clarke, F.H.: Optimization and Nonsmooth Analysis. Classics in Applied Mathematics. SIAM, Philadelphia (1990)
Ioffe, A.D., Tihomirov, V.M.: Theory of Extremal Problems. North-Holland Publishing Co, Amsterdam (1979)
Mordukhovich, B.S.: Variational Analysis and Generalized Differentiation. Vol. I: Basic Theory, Vol. II: Applications. Springer, Berlin (2006)
Rockafellar, R.T.: Convex Analysis. Princeton University Press, Princeton (1970)
Kiwiel, K.C.: Methods of Descent for Nondifferentiable Optimization. Lecture Notes in Mathematics, vol. 1133. Springer, Berlin (1985)
Kiwiel, K.C.: An aggregate subgradient method for nonsmooth and nonconvex minimization. J. Comput. Appl. Math. 14, 391–400 (1986)
Brezis, H.: Functional Analysis, Sobolev Spaces and Partial Differential Equations. Springer, New York (2011)
Nocedal, J., Wright, S.J.: Numerical Optimization, 2nd edn. Springer, New York (2006)
Polyak, B.T.: Introduction to Optimization. Translated from the Russian. Optimization Software, Inc., New York (1987)
Ruszczyński, A.: Nonlinear Optimization. Princeton University Press, Princeton, NJ (2006)
Vasilev, F.P.: Numerical Methods for Solving Extremal Problems (in Russian), 2nd edn. Nauka, Moscow (1988)
Rudin, W.: Functional Analysis, 2nd edn. McGraw-Hill, New York (1991)
Kurdila, A.J., Zabarankin, M.: Convex Functional Analysis. Birkhäser Verlag, Basel (2005)
Acknowledgments
The researches of Khanh, Yao, Yen were funded, respectively, by the Vietnam Institute for Advanced Study in Mathematics (VIASM), the Grant MOST 102-2115-M-039-003-MY3, and the Vietnam National Foundation for Science and Technology Development (NAFOSTED) under grant number 101.01-2014.37. We would like to thank Professor Nguyen Nang Tam for a useful discussion on generalized Weierstrass Theorems and the referees for their constructive comments.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Khanh, P.D., Yao, JC. & Yen, N.D. The Mordukhovich Subdifferentials and Directions of Descent. J Optim Theory Appl 172, 518–534 (2017). https://doi.org/10.1007/s10957-015-0774-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10957-015-0774-0
Keywords
- Weakly sequentially lower semicontinuous function
- Minimization
- Subdifferential
- Descent direction
- Radius of descent