On the Impact of Systematic Noise on the Evolutionary Optimization Performance—A Sphere Model Analysis
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
Quality evaluations in optimization processes are frequently noisy. In particular evolutionary algorithms have been shown to cope with such stochastic variations better than other optimization algorithms. So far mostly additive noise models have been assumed for the analysis. However, we will argue in this paper that this restriction must be relaxed for a large class of applied optimization problems. We suggest “systematic noise” as an alternative scenario, where the noise term is added to the objective parameters or to environmental parameters inside the fitness function. We thoroughly analyze the sphere function with systematic noise for the evolution strategy with global intermediate recombination. The progress rate formula and a measure for the efficiency of the evolutionary progress lead to a recommended ratio between μ and λ. Furthermore, analysis of the dynamics identifies limited regions of convergence dependent on the normalized noise strength and the normalized mutation strength. A residual localization error R ∞ can be quantified and a second μ to λ ratio is derived by minimizing R ∞.
- Abramowitz, M., Stegun, I. A. (1984) Pocketbook of Mathematical Functions. Verlag Harri Deutsch, Thun
- Arnold, B. C., Balakrishnan, N., Nagaraja, H. N. (1992) A First Course in Order Statistics. Wiley, New York
- Arnold, D. V. (2002) Noisy Optimization with Evolution Strategies. Kluwer Academic Publishers, Dordrecht
- Arnold, D. V., Beyer, H.-G. Local performace of the (µ /µI λ)-ES in a noisy environment. In: Martin, W., Spears, W. eds. (2001) Foundations of Genetic Algorithms. Morgan Kaufmann, San Francisco, CA, pp. 127-141
- Arnold, D. V., Beyer, H.-G. (2002) Performance analysis of evolution strategies with multi-recombination in high-dimensional ℝN-search spaces disturbed by noise. Theoretical Computer Science 289: pp. 629-647
- Beyer, H.-G. (1993) Toward a theory of evolution strategies: Some asymptotical results from the (1 + λ)-theory. Evolutionary Computation 1: pp. 165-188
- Beyer, H.-G. (1996) Toward a theory of evolution strategies: Self-adaptation. Evolutionary Computation 3: pp. 311-347
- Beyer, H.-G. (2000) Evolutionary algorithms in noisy environments: Theoretical issues and guidelines for practice. Computer Methods in Applied Mechanics and Engineering 186: pp. 239-267
- Beyer, H.-G. (2001) The Theory of Evolution Strategies, Natural Computing Series. Springer, Heidelberg
- Beyer, H.-G., Arnold, D. V. The steady state behavior of (µ / µI, λ)-ES on ellipsoidal fitness models disturbed by noise. In: CantÚ-Paz, E., Foster, J. A., Deb, L. D. K., Davis, , Roy, R., O'Reilly, U.-M., Beyer, H.-G., Standish, R., Kendall, G., Wilson, S., Harman, M., Wegener, J., Dasgupta, D., Potter, M. A., Schultz, A. C., Dowsland, K. A., Jonoska, N., Miller, J. eds. (2003) GECCO-2003: Proceedings of the Genetic and Evolutionary Computation Conference. Springer, Berlin, Germany, pp. 525-536
- Beyer, H.-G., Olhofer, M., Sendhoff, B. On the behavior of (µ /µI λ)-ES optimizing functions disturbed by generalized noise. In: De Jong, K., Poli, R., Rowe, J. eds. (2003) Foundations of Genetic Algorithms. Morgan Kaufmann, San Francisco, CA, pp. 307-328
- J. Branke, “Efficient evolutionary algorithms for searching robust solutions,” in Adaptive Computing in Design and Manufacture (ACDM), I. C. Parmee (Ed.), Springer Verlag, 2000, pp. 275–285.
- Branke, J. (2002) Evolutionary Optimization in Dynamic Environments. Kluwer Academic Publishers, Dordrecht
- Floreano, D., Mondada, F. (1996) Evolution of homing navigation in a real mobile robot. IEEE Transactions on Systeme, Man and Cybernetics: Part B Cybernetics 26: pp. 396-407
- Hansen, N., Ostermeier, A. (1996) Adapting arbitrary normal mutation distributions in evolution strategies: The covariance matrix adaptation. Proceedings of 1996 IEEE Int'l Conf. on Evolutionary Computation (ICEC '96). IEEE Press, NY, pp. 312-317
- Hansen, N., Ostermeier, A. (2001) Completely derandomized self-adaptation in evolution strategies. Evolutionary Computation 9: pp. 159-195
- Y. Jin and B. Sendhoff, “Trade-off between optimality and robustness: An evolutionary multiobjective approach,” in Evolutionary Multi-Criterion Optimization, C. M. Fonseca, P. J. Fleming, E. Zitzler, K. Deb, and L. Thiele, (Eds.), Springer Verlag, 2003, pp. 237–251.
- Obayashi, S., Yamaguchi, Y., Nakamura, T. (1997) Multiobjective genetic algorithm for multidisciplinary design of transonic wing planform. Journal of Aircraft 34: pp. 690-693
- M. Olhofer, T. Arima, Y. Jin, T. Sonoda, and B. Sendhoff, “Optimisation of transonic gas turbine blades with evolution strategies,” Honda Technical Reviews, April 2002, pp. 203–216.
- Olhofer, M., Arima, T., Sonoda, T., Fischer, M., Sendhoff, B. Aerodynamic shape optimisation using evolution strategies. In: Parmee, I., Hajela, P. eds. (2002) Optimisation in Industry. Springer Verlag, Berlin, pp. 83-94
- Olhofer, M., Jin, Y., Sendhoff, B. (2001) Adaptive encoding for aerodynamic shape optimization using evolution strategies. Congress on Evolutionary Computation (CEC) 2: pp. 576-583
- Rechenberg, I. (1994) Evolutionsstrategie '94. Frommann-Holzboog Verlag, Stuttgart
- Schwefel, H.-P. (1981) Numerical Optimization of Computer Models. Wiley, Chichester
- B. Sendhoff, H.-G. Beyer, and M. Olhofer, “On noise induced multi-modality in evolutionary algorithms,” in Proceedings of the 4th Asia-Pacific Conference on Simulated Evolution And Learning-SEAL, L. Wang, K. C. Tan, T. Furuhashi, J.-H. Kim, and X. Yao (Eds.), 2002, vol. 1, pp. 219–224.
- T. Sonoda, Y. Yamaguchi, T. Arima, M. Olhofer, B. Sendhoff, and H.-A. Schreiber, “Advanced high turning compressor airfoils for low reynolds number condition, Part 1: Design and optimization,” in Proceedings of the ASME Turbo Expo 2003: Power for Land, Sea, and Air, June 16–19, 2003, Atlanta, Georgia, USA.
- P. Stagge, “Averaging efficiently in the presence of noise,” in Parallel Problem Solving from Nature-PPSN V, A. E. Eiben, T. Bäck, M. Schoenauer, and H.-P. Schwefel (Eds.), Springer Verlag, 1998, pp. 188–197.
- A. Thompson and P. Layzell, “Evolution of robustness in an electronics design,” in Proc. 3rd Int. Conf. on Evolvable Systems (ICES2000): From Biology to Hardware, J. Miller, A. Thompson, P. Thomson, and T. Fogarty (Eds.), vol. 1801 of LNCS, Springer-Verlag, 2000, pp. 218–228.
- Tsutsui, S., Gosh, A. (1997) Genetic algorithms with a robust solution searching scheme. IEEE Transactions on Evolutionary Computation 1: pp. 201-208
- Wiesmann, D., Hammel, U., B¨ ack, T. (1998) Robust design of multilayer optical coatings by means of evolutionary algorithms. IEEE Transactions on Evolutionary Computation 2: pp. 162-167
- Y. Yamaguchi and T. Arima, “Multiobjective optimization for transonic compressor stator blade,” in 8th AIAA/USAF/NASA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, 2000.
- On the Impact of Systematic Noise on the Evolutionary Optimization Performance—A Sphere Model Analysis
Genetic Programming and Evolvable Machines
Volume 5, Issue 4 , pp 327-360
- Cover Date
- Print ISSN
- Online ISSN
- Kluwer Academic Publishers
- Additional Links
- evolution strategies
- noisy optimization
- performance analysis
- robust optimization