Global optimization based on bisection of rectangles, function values at diagonals, and a set of Lipschitz constants
- 1.2k Downloads
We consider a global optimization problem for Lipschitz-continuous functions with an unknown Lipschitz constant. Our approach is based on the well-known DIRECT (DIviding RECTangles) algorithm and motivated by the diagonal partitioning strategy. One of the main advantages of the diagonal partitioning scheme is that the objective function is evaluated at two points at each hyper-rectangle and, therefore, more comprehensive information about the objective function is considered than using the central sampling strategy used in most DIRECT-type algorithms. In this paper, we introduce a new DIRECT-type algorithm, which we call BIRECT (BIsecting RECTangles). In this algorithm, a bisection is used instead of a trisection which is typical for diagonal-based and DIRECT-type algorithms. The bisection is preferable to the trisection because of the shapes of hyper-rectangles, but usual evaluation of the objective function at the center or at the endpoints of the diagonal are not favorable for bisection. In the proposed algorithm the objective function is evaluated at two points on the diagonal equidistant between themselves and the endpoints of a diagonal. This sampling strategy enables reuse of the sampling points in descendant hyper-rectangles. The developed algorithm gives very competitive numerical results compared to the DIRECT algorithm and its well know modifications.
KeywordsGlobal optimization Lipschitz optimization DIRECT-type algorithms Diagonal approach Bisection
This research was funded by a Grant (No. MIP-051/2014) from the Research Council of Lithuania.
- 4.Finkel, D.E.: Global optimization with the Direct algorithm. Ph.D. thesis, North Carolina State University (2005)Google Scholar
- 6.Floudas, C.A., Pardalos, P.M. (eds.): Encyclopedia of Optimization (Vol. 6), 2nd edn. Springer, Berlin (2009)Google Scholar
- 7.Gablonsky, J.M.: Modifications of the Direct algorithm. Ph.D. thesis, North Carolina State University (2001)Google Scholar
- 9.Gorodetsky, S.Y.: Paraboloid triangulation methods in solving multiextremal optimization problems with constraints for a class of functions with Lipschitz directional derivatives. Vestn. Lobachevsky State Univ. Nizhni Novgorod 1(1), 144–155 (2012). (in Russian)Google Scholar
- 10.Hedar, A.: Test functions for unconstrained global optimization. http://www-optima.amp.i.kyoto-u.ac.jp/member/student/hedar/Hedar_files/TestGO.htm (2005). Accessed: 22 Feb 2016
- 28.Paulavičius, R., Žilinskas, J.: Analysis of different norms and corresponding Lipschitz constants for global optimization. Inf. Technol. Control 36(4), 383–387 (2007)Google Scholar
- 39.Sergeyev, Y.D., Kvasov, D.E.: On deterministic diagonal methods for solving global optimization problems with Lipschitz gradients. In: Optimization, Control, and Applications in the Information Age, vol. 130, pp. 315–334. Springer, Switzerland (2015). doi: 10.1007/978-3-319-18567-5-16