Skip to main content
Book cover
  • Book
  • Jun 2023

Enhancing Surrogate-Based Optimization Through Parallelization

Authors:

  1. Frederik Rehbach

    1. Fakultät Informatik, TU Dortmund University, Köln, Germany

    View author publications

    You can also search for this author in PubMed   Google Scholar

  • Presents an in-depth analysis on parallel Surrogate-Based Optimization (SBO) algorithms

  • Introduces a novel benchmarking framework for the fair comparison of parallel SBO algorithms

  • Focuses on the application of parallel SBO

Part of the book series: Studies in Computational Intelligence (SCI, volume 1099)

About this book

This book presents a solution to the challenging issue of optimizing expensive-to-evaluate industrial problems such as the hyperparameter tuning of machine learning models. The approach combines two well-established concepts, Surrogate-Based Optimization (SBO) and parallelization, to efficiently search for optimal parameter setups with as few function evaluations as possible.

Through in-depth analysis, the need for parallel SBO solvers is emphasized, and it is demonstrated that they outperform model-free algorithms in scenarios with a low evaluation budget. The SBO approach helps practitioners save significant amounts of time and resources in hyperparameter tuning as well as other optimization projects. As a highlight, a novel framework for objectively comparing the efficiency of parallel SBO algorithms is introduced, enabling practitioners to evaluate and select the most effective approach for their specific use case.

Based on practical examples, decision support is delivered, detailing which parts of industrial optimization projects can be parallelized and how to prioritize which parts to parallelize first. By following the framework, practitioners can make informed decisions about how to allocate resources and optimize their models efficiently.
Back to top

Keywords

  • Computational Intelligence
  • Surrogate-based Optimization
  • SBO
  • Parallelization
  • Data Engineering
Back to top

Authors and Affiliations

  • Fakultät Informatik, TU Dortmund University, Köln, Germany

    Frederik Rehbach

Back to top

Bibliographic Information

Back to top