Abstract
The paper proposes a method for solving computationally time-consuming multidimensional global optimization problems. The developed method combines the use of a nested dimensional reduction scheme and numerical estimates of the objective function derivatives. Derivatives significantly reduce the cost of solving global optimization problems, however, the use of a nested scheme can lead to the fact that the derivatives of the reduced function become discontinuous. Typical global optimization methods are highly dependent on the continuity of the objective function. Thus, to use derivatives in combination with a nested scheme, an optimization method is required that can work with discontinuous functions. The paper discusses the corresponding method, as well as the results of numerical experiments in which such an optimization scheme is compared with other known methods.
Supported by Russian Foundation for Basic Research (grant 19-07-00242).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Baritompa, W.: Accelerations for a variety of global optimization methods. J. Global Optim. 4, 37–45 (1994)
Breiman, L., Cutler, A.: A deterministic algorithm for global optimization. Math. Program. 58, 179–199 (1993)
Brent, R.P.: Algorithms for Minimization Without Derivatives. Prentice-Hall, Englewood Cliffs (1973)
Dam, E.R., Husslage, B., Hertog, D.: One-dimensional nested maximin designs. J. Glob. Optim. 46, 287–306 (2010)
Floudas, C.A., Pardalos, M.P.: State of the Art in Global Optimization. Computational Methods and Applications. Kluwer Academic Publishers, Dordrecht (1996)
Floudas, C.A., Pardalos, M.P.: Recent Advances in Global Optimization. Princeton University Press, Princeton (2016)
Galperin, E.A.: The cubic algorithm. J. Math. Anal. Appl. 112, 635–640 (1985)
Gergel, V.P.: A method of using derivatives in the minimization of multiextremum functions. Comput. Math. Math. Phys. 36, 729–742 (1996). (In Russian)
Gergel, V.P.: A global optimization algorithm for multivariate function with Lipschitzian first derivatives. J. Glob. Optim. 10, 257–281 (1997)
Gergel, V., Goryachih, A.: Global optimization using numerical approximations of derivatives. In: Battiti, R., Kvasov, D.E., Sergeyev, Y.D. (eds.) LION 2017. LNCS, vol. 10556, pp. 320–325. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-69404-7_25
Gergel, V., Goryachih, A.: Multidimensional global optimization using numerical estimates of objective function derivatives. In: Optimization Methods and Software (2019)
Goryachih, A.S., Rachinskaya, M.A.: Multidimensional global optimization method using numerically calculated derivatives. Proc. Comput. Sci. 119, 90–96 (2017)
Griewank, A., Walther, A.: Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation. SIAM (2008)
Hansen, P., Jaumard, B., Lu, S.H.: Global optimization of univariate Lipshitz functions. II. New algorithms and computational comparison. Math. Program. 55, 273–292 (1992)
Horst, R., Tuy, H.: Global Optimization: Deterministic Approaches. Springer, Heidelberg (1990). https://doi.org/10.1007/978-3-662-02598-7
Lera, D., Sergeyev, Y.D.: Acceleration of univariate global optimization algorithms working with Lipschitz functions and Lipschitz first derivatives. SIAM J. Optim. 23, 508–529 (2013)
Locatelli, M., Schoen, F.: Global Optimization: Theory, Algorithms, and Applications. SIAM (2013)
Nocedal, J., Wright, S.: Numerical Optimization. Springer, Heidelberg (2006). https://doi.org/10.1007/978-0-387-40065-5
Pardalos, M.P., Zhigljavsky, A.A., Žilinskas, J.: Advances in Stochastic and Deterministic Global Optimization. Springer, Heidelberg (2016). https://doi.org/10.1007/978-3-319-29975-4
Paulavic̆ius R., Z̆ilinskas J.: Simplicial Global Optimization. Springer Briefs in Optimization. Springer, Heidelberg (2014). https://doi.org/10.1007/978-1-4614-9093-7
Pintér, J.D.: Global Optimization in Action (Continuous and Lipschitz Optimization: Algorithms, Implementations and Applications). Kluwer Academic Publishers, Dordrecht (1996)
Piyavskij, S.: An algorithm for finding the absolute extremum of a function. Computat. Math. Math. Phys. 12, 57–67 (1972). (In Russian)
Sergeyev, Y.D.: Global one-dimensional optimization using smooth auxiliary functions. Math. Program. 81, 127–146 (1998)
Sergeyev, Y.D.: A deterministic global optimization using smooth diagonal auxiliary functions. Commun. Nonlinear Sci. Numer. Simul. 21, 99–111 (2015)
Shi, L., Ólafsson, S.: Nested partitions method for global optimization. Oper. Res. 48, 390–407 (2000)
Shpak, A.: Global optimization in one-dimensional case using analytically defined derivatives of objective function. Comput. Sci. J. Mold. 3, 168–184 (1995)
Shubert, B.O.: A sequential method seeking the global maximum of a function. SIAM J. Numer. Anal. 9, 379–388 (1972)
Strongin, R.G.: Numerical Methods in the Multiextremal Problems (Information-Statistical Algorithms). Nauka (1978). (In Russian)
Strongin R.G.: Search of global optimum. Znanie (1990). (In Russian)
Strongin, R.G., Sergeyev, Ya.D.: Global Optimization with Non-convex Constraints: Sequential and Parallel Algorithms. Kluwer Academic Publishers, Dordrecht (2000). 2nd edn. 2013, 3rd edn. 2014
Strongin, R.G., Gergel, V.P., Grishagin, V.A., Barkalov K.A.: Parallel Computations in the Global Optimization Problems. MSU Publishing (2013). (In Russian)
Zhigljavsky, A., Z̆ilinskas, A.: Stochastic Global Optimization. Springer, Berlin (2008). https://doi.org/10.1007/978-0-387-74740-8
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Gergel, V., Sysoyev, A. (2020). Global Optimization Method with Numerically Calculated Function Derivatives. In: Olenev, N., Evtushenko, Y., Khachay, M., Malkova, V. (eds) Advances in Optimization and Applications. OPTIMA 2020. Communications in Computer and Information Science, vol 1340. Springer, Cham. https://doi.org/10.1007/978-3-030-65739-0_1
Download citation
DOI: https://doi.org/10.1007/978-3-030-65739-0_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-65738-3
Online ISBN: 978-3-030-65739-0
eBook Packages: Computer ScienceComputer Science (R0)