Skip to main content

A Fair Performance Comparison of Different Surrogate Optimization Strategies

Part of the Lecture Notes in Computer Science book series (LNTCS,volume 10671)


Much of the literature found on surrogate models presents new approaches or algorithms trying to solve black-box optimization problems with as few evaluations as possible. The comparisons of these new ideas with other algorithms are often very limited and constrained to non-surrogate algorithms or algorithms following very similar ideas as the presented ones. This work aims to provide both an overview over the most important general trends in surrogate assisted optimization and a more wide-spanning comparison in a fair environment by reimplementation within the same software framework.


  • Surrogate models
  • Evolutionary algorithms
  • Black-box optimization

This is a preview of subscription content, access via your institution.

Buying options

USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-74718-7_49
  • Chapter length: 8 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
USD   79.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-74718-7
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   99.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.


  1. Barton, R.R.: Simulation metamodels. In: 1998 Winter Simulation Conference Proceedings, vol. 1, pp. 167–174. IEEE (1998)

    Google Scholar 

  2. Cruz-Vega, I., Garcia-Limon, M., Escalante, H.J.: Adaptive-surrogate based on a neuro-fuzzy network and granular computing. In: Proceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation, pp. 761–768. ACM (2014)

    Google Scholar 

  3. Hardy, R.L.: Multiquadric equations of topography and other irregular surfaces. J. Geophys. Res. 76(8), 1905–1915 (1971)

    CrossRef  Google Scholar 

  4. Jin, Y.: Surrogate-assisted evolutionary computation: recent advances and future challenges. Swarm Evolut. Comput. 1(2), 61–70 (2011)

    CrossRef  Google Scholar 

  5. Jones, D.R., Schonlau, M., Welch, W.J.: Efficient global optimization of expensive black-box functions. J. Global Optim. 13(4), 455–492 (1998)

    MathSciNet  CrossRef  MATH  Google Scholar 

  6. Lim, D., Jin, Y., Ong, Y.S., Sendhoff, B.: Generalizing surrogate-assisted evolutionary computation. IEEE Trans. Evol. Comput. 14(3), 329–355 (2010)

    CrossRef  Google Scholar 

  7. Loshchilov, I., Schoenauer, M., Sebag, M.: Self-adaptive surrogate-assisted covariance matrix adaptation evolution strategy. In: Proceedings of the 14th annual Conference on Genetic and Evolutionary Computation, pp. 321–328. ACM (2012)

    Google Scholar 

  8. Mullur, A.A., Messac, A.: Extended radial basis functions: more flexible and effective metamodeling. AIAA J. 43(6), 1306–1315 (2005)

    CrossRef  Google Scholar 

  9. Ulmer, H., Streichert, F., Zell, A.: Evolution strategies assisted by Gaussian processes with improved preselection criterion. In: The 2003 Congress on Evolutionary Computation, CEC 2003, vol. 1, pp. 692–699. IEEE (2003)

    Google Scholar 

  10. Wang, G.G., Shan, S.: Review of metamodeling techniques in support of engineering design optimization. J. Mech. Des. 129(4), 370–380 (2007)

    CrossRef  Google Scholar 

  11. Wang, L., Shan, S., Wang, G.G.: Mode-pursuing sampling method for global optimization on expensive black-box functions. Eng. Optim. 36(4), 419–438 (2004)

    CrossRef  Google Scholar 

  12. Zhang, J., Chowdhury, S., Messac, A.: An adaptive hybrid surrogate model. Struct. Multidisc. Optim. 46(2), 223–238 (2012)

    CrossRef  Google Scholar 

Download references


This work was supported by the European Union through the European Regional Development Fund (EFRE; further information on IWB/EFRE is available at

Author information

Authors and Affiliations


Corresponding author

Correspondence to Bernhard Werth .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Werth, B., Pitzer, E., Affenzeller, M. (2018). A Fair Performance Comparison of Different Surrogate Optimization Strategies. In: Moreno-Díaz, R., Pichler, F., Quesada-Arencibia, A. (eds) Computer Aided Systems Theory – EUROCAST 2017. EUROCAST 2017. Lecture Notes in Computer Science(), vol 10671. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-74717-0

  • Online ISBN: 978-3-319-74718-7

  • eBook Packages: Computer ScienceComputer Science (R0)