Abstract
This works investigates a conceptual algorithm for computing critical points of nonsmooth nonconvex optimization problems whose objective function is the sum of two locally Lipschitzian (component) functions. We show that upon additional assumptions on the component functions and or feasible set, the given algorithm extends several well-known optimization methods.
Similar content being viewed by others
Notes
Such an assumption is minimal for minimization of a function to be meaningful in the first place.
References
Bonvin, G., Demassey, S., Le Pape, C., Maïzi, N., Mazauric, V., Samperio, A.: A convex mathematical program for pump scheduling in a class of branched water networks. Appl. Energy 185, 1702–1711 (2017)
Borwein, J.M., Preiss, D.: A smooth variational principle with applications to subdifferentiability and differentiability of convex functions. Trans. Am. Math. Soc. 303, 517–527 (1987)
Borwein, J.M., Zhu, Q.J.: Techniques of Variational Analysis. CMS Books in Mathematics/Ouvrages de Mathématiques de la SMC, vol. 20. Springer, New York (2005)
Clarke, F.H.: Optimisation and Nonsmooth Analysis. Classics in Applied Mathematics. Society for Industrial and Applied Mathematics (1987)
de Oliveira, W.: Proximal bundle methods for nonsmooth DC programming. J. Glob. Optim. (2019). https://doi.org/10.1007/s10898-019-00755-4
de Oliveira, W., Sagastizábal, C.: Bundle methods in the XXI century: a birds’-eye view. Pesquisa Operacional 34(3), 647–670 (2014)
de Oliveira, W., Tcheou, M.P.: An inertial algorithm for DC programming. Set-Valued Var. Anal. https://doi.org/10.1007/s11228-018-0497-0
Kruger, A.Y.: On Fréchet subdifferentials. J. Math. Sci. 116(3), 3325–3358 (2003)
Lavaei, J., Low, S.: Zero duality gap in optimal power flow problem. IEEE Trans. Power Syst. 27(1), 92–107 (2012)
Le Thi, H.A., Ngai, H.V., Tao, P.D.: DC programming and DCA for general DC programs. In: Van Do, T., Le Thi, H.A., Nguyen, N.T. (eds.) Advanced Computational Methods for Knowledge Engineering: Proceedings of the 2nd International Conference on Computer Science, Applied Mathematics and Applications (ICCSAMA 2014), pp. 15–35. Springer, Cham (2014)
Le Thi, H.A., Ngai, H.V., Tao, P.D.: Convergence analysis of Difference-of-Convex algorithm with subanalytic data. J. Optim. Theory Appl. 179(1), 103–126 (2018)
Le Thi, H.A., Tao, P.D.: DC programming in communication systems: challenging problems and methods. Vietnam J. Comput. Sci. 1(1), 15–28 (2014)
Le Thi, H.A., Tao, P.D.: DC programming and DCA: thirty years of developments. Math. Program. 169(1), 5–68 (2018)
Le Thi, H.A., Tao, P.D., Ngai, H.V.: Exact penalty and error bounds in DC programming. J. Glob. Optim. 52(3), 509–535 (2012)
Mordukhovich, B.S.: Variational Analysis and Applications. Springer, Cham (2018)
Nesterov, Y.: Introductory Lectures on Convex Optimization. A Basic Course, volume 87 of Applied Optimization. Springer, Cham (2004)
Pang, J.S., Razaviyayn, M., Alvarado, A.: Computing B-stationary points of nonsmooth DC programs. Math. Oper. Res. 42(1), 95–118 (2017)
Parikh, N., Boyd, S.: Proximal algorithms. Found. Trends Optim. 1(3), 127–239 (2014)
Rockafellar, R.T., Wets, R.J.-B.: Variational Analysis. Grundlehren der mathematischen Wissenschaften, vol. 317, 3rd edn. Springer, Berlin (2009)
Sun, J.: When Are Nonconvex Optimization Problems Not Scary? Ph.D. thesis, Columbia University (2016)
Tao, P.D.: Exact penalty in DC programming. Vietnam J. Math. 27(2), 169–178 (1999)
Tao, P.D., Le Thi, H.A.: Convex analysis approach to DC programming: theory, algorithms and applications. Acta Mathematica Vietnamica 22(1), 289–355 (1997)
Tao, P.D., Le Thi, H.A.: Recent advances in DC programming and DCA. In: Nguyen, N.-T., Le Thi, H.A. (eds.) Transactions on Computational Intelligence XIII, pp. 1–37. Springer, Berlin (2014)
Tao, P.D., Souad, E.B.: Algorithms for solving a class of nonconvex optimization problems. Methods of subgradients. N.-Holl. Math. Stud. 129, 249–271 (1986)
Tao, P.D., Souad, E.B.: Duality in d.c. (difference of convex functions) optimization. Subgradient methods. In: Hoffmann, K.H., Zowe, J., Hiriart-Urruty, J.B., Lemarechal, C. (eds.) Trends in Mathematical Optimization, volume 84 of International Series of Numerical Mathematics, pp. 277–293. Birkhauser, Basel (1988)
Teboulle, M.: A simplified view of first order methods for optimization. Math. Program. (B) 170(1), 67–96 (2018)
van Ackooij, W., de Oliveira, W.: Nonsmooth and nonconvex optimization via approximate difference of-convex decompositions. J. Optim. Theory Appl. 182(1), 49–80 (2019)
Acknowledgements
We would like to thank three anonymous reviewers for their valuable time and interesting comments.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
van Ackooij, W., de Oliveira, W. Some brief observations in minimizing the sum of locally Lipschitzian functions. Optim Lett 14, 509–520 (2020). https://doi.org/10.1007/s11590-019-01477-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11590-019-01477-y