On Applications of Extreme Value Theory in Optimization

  • Jürg HüslerEmail author


We present a statistical study of the distribution of the objective value of solutions (outcomes) obtained by stochastic optimizers, applied for continuous objective functions. We discuss the application of extreme value theory for the optimization procedures. A short review of the extreme value theory is presented to understand the investigations. In this chapter three optimization procedures are compared in this context: the random search and two evolution strategies. The outcomes of these optimizers applied to three objective functions are discussed in the context of extreme value theory and the performances of the procedures investigated, analytically and by simulations. In particular, we find that the estimated extreme value distributions and the fit to the outcomes characterize the performance of the optimizer in one single instance.


Weibull Distribution Random Search Generalize Extreme Value Generalize Pareto Distribution Lower Tail 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Bäck T, Hoffmeister F, Schwefel HP (1991) A survey of evolution strategies. In: Belew RK, Booker LB (eds) Genetic Algorithms: Proceedings of the Fourth International Conference at San Diego, Morgan Kaufmann, San Mateo, pp 2–9Google Scholar
  2. Beirlant J, Goegebeur Y, Segers J, Teugels J (2004) Statistics of Extremes: Theory and Applications. Wiley, New York, NYzbMATHCrossRefGoogle Scholar
  3. Dekkers A, Einmahl J, de Haan L (1989) A moment estimator for the index of an extreme-value distribution. Annals of Statistics 17:1833–1855zbMATHCrossRefMathSciNetGoogle Scholar
  4. Dietrich D, de Haan L, Hüsler J (2002) Testing extreme value conditions. Extremes 5:71–86CrossRefMathSciNetGoogle Scholar
  5. Drees H, de Haan L, Li D (2006) Approximations to the tail empirical distribution function with application to testing extreme value conditions. Journal of Statistical Planning and Inference 136:3498–3538zbMATHCrossRefMathSciNetGoogle Scholar
  6. Embrechts P, Klüppelberg C, Mikosch T (1997) Modelling Extremal Events for Insurance and Finance. SpringerzbMATHGoogle Scholar
  7. Falk M, Hüsler J, Reiss R (2004) Laws of Small Numbers: Extremes and Rare Events, 2nd edn. Birkhäuser, Basel and BostonzbMATHGoogle Scholar
  8. Fisher R, Tippett L (1928) Limiting forms of the frequency distribution in the largest particle size and smallest number of a sample. In: Proceedings of the Cambridge Philosophical Society, pp 180–190Google Scholar
  9. Fonseca C, Fleming P (1996) On the performance and comparison of stochastic multiobjective optimizers. In: Voigt HM, Ebeling W, Rechenberg I, Schwefel HP (eds) Parallel Problem Solving from Nature - PPSN IV, Springer, Lecture Notes in Computer Science, vol 1141, pp 584–593CrossRefGoogle Scholar
  10. de Haan L, Ferreira A (2006) Extreme Value Theory: An Introduction. SpringerzbMATHGoogle Scholar
  11. Hüsler J, Li D (2006) On testing extreme value conditions. .Extremes 9:69–86zbMATHCrossRefMathSciNetGoogle Scholar
  12. Hüsler J, Li D (2007) Testing extreme value conditions with applications. In: Reiss RD, Thomas M (eds) Statistical analysis of extreme values, 3rd edn, Birkhäuser, Basel, pp 144–151Google Scholar
  13. Hüsler J, Cruz P, Hall A, Fonseca C (2003) On optimization and extreme value theory. Methodology and Computing in Applied Probability 5:183–195zbMATHCrossRefMathSciNetGoogle Scholar
  14. Leadbetter M, Lindgren G, Rootzen H (1983) Extremes and Related Properties of Random Sequences and Processes. SpringerzbMATHGoogle Scholar
  15. Lockhart R, Stephens M (2006) Estimation and tests of fit for the three-parameter Weibull distribution. Journal of the Royal Statistics Society B (56):491–500MathSciNetGoogle Scholar
  16. Reiss RD, Thomas M (1997) Statistical Analysis of Extreme Values with Application to Insurance, Finance, Hydrology and Other Fields. Birkhäuser, BaselGoogle Scholar
  17. Resnick S (2007) Heavy-tail Phenomena. SpringerzbMATHGoogle Scholar
  18. Smith R (1986)Extreme value theory based on the r largest annual events. Journal of Hydrology (86):27–43CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  1. 1.Dept. Mathematical StatisticsUniversity of BernBernSwitzerland

Personalised recommendations