Optimizing Objective Functions with Non-Linearly Correlated Variables Using Evolution Strategies with Kernel-Based Dimensionality Reduction
This paper proposes an improvement of Evolutionary Strategies for objective functions with non-linearly correlated variables. It focuses on detecting non-linear local dependencies among variables of the objective function by analyzing the manifold in the search space that contains the current population and transforming individuals to a reduced search space defined by the Kernel Principal Components. Experiments performed on some popular benchmark functions confirm that the method may significantly improve the search process, especially in the case of complex objective functions with a large number of variables, which usually occur in many practical applications.
KeywordsObjective Function Search Space Dimensionality Reduction Benchmark Function Kernel Principal Component Analysis
Unable to display preview. Download preview PDF.
- 1.Back, T.: Evolutionary Algorithms in Theory and Practice. Oxford University Press (1995)Google Scholar
- 3.Brockhoff, D., Zitzler, E., Dimensionality Reduction in Multiobjective Optimization with (Partial) Dominance Structure Preservation: Generalized Minimum Objective Subset Problems, TIK Report, no. 247, ETH Zurich (2006)Google Scholar
- 4.Cox, T., Cox, M., Multidimensional Scaling. Chapman & Hall (2001)Google Scholar
- 5.Goldberg, D.,E., Genetic Algorithms in Search, Optimization and Machine Learning. Addison Wesley (1989)Google Scholar
- 6.Hansen, N., Ostermeier, A.: Adapting arbitrary normal mutation distributions in evolution strategies: The covariance matrix adaptation. CEC, 312–317 (1996)Google Scholar
- 7.Jolliffe, I.T.: Principal Component Analysis, Springer (1986)Google Scholar
- 8.Larranaga, P., Lozano, J. A.: Estimation of Distribution Algorithms. Kluwer Academic Publishers (2002)Google Scholar
- 11.Schoelkopf, B., Smola, A. J., Mueller, K.-R.: Nonlinear component analysis as a kernel eigenvalue problem, Technical Report, no. 44, Max Planck Institute (1996)Google Scholar
- 12.Schwefel, H.-P., Evolution and Optimum Seeking. John Wiley and Sons (1995)Google Scholar