Skip to main content

The Sequential Parameter Optimization Toolbox

  • Chapter
  • First Online:
Experimental Methods for the Analysis of Optimization Algorithms

Abstract

The sequential parameter optimization toolbox (SPOT) is one possible implementation of the SPO framework introduced in Chap. 2. It has been successfully applied to numerous heuristics for practical and theoretical optimization problems. We describe the mechanics and interfaces employed by SPOT to enable users to plug in their own algorithms. Furthermore, two case studies are presented to demonstrate how SPOT can be applied in practice, followed by a discussion of alternative metamodels to be plugged into it.We conclude with some general guidelines.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Armitage P (1975) Sequential medical trials, 2nd edn. Blackwell, Oxford, U.K.

    Google Scholar 

  • Bartz-Beielstein T (2010a) Sequential parameter optimization. Tech. Rep. 04/2010, Institute of Computer Science, Faculty of Computer Science and Engineering Science, Cologne University of Applied Sciences, Germany, URL http: //www.gm.fh-koeln.de/imperia/md/content/personen/ lehrende/bartz_beielstein_thomas/spotannotatedbib.pdf

    Google Scholar 

  • Bartz-Beielstein T (2010b) SPOT: An R package for automatic and interactive tuning of optimization algorithms by sequential parameter optimization. Tech. Rep. CIOP TR 05-10, Cologne University of Applied Sciences, URL http://arxiv.org/abs/1006.4645, related software can be downloaded from http://cran.r-project.org/web/packages/SPOT/index.html

    Google Scholar 

  • Bartz-Beielstein T, Lasarczyk C, Preuß M (2005) Sequential parameter optimization. In: McKay B, et al. (eds) Proceedings 2005 Congress on Evolutionary Computation (CEC’05), Edinburgh, Scotland, IEEE Press, Piscataway NJ, vol 1, pp 773–780

    Chapter  Google Scholar 

  • Beyer HG (2001) The Theory of Evolution Strategies. Springer

    Google Scholar 

  • Beyer HG, Schwefel HP (2002) Evolution strategies—A comprehensive introduction.Natural Computing 1:3–52

    Article  MATH  MathSciNet  Google Scholar 

  • Breiman L, Friedman JH, Olshen RA, Stone CJ (1984) Classification and Regression Trees. Wadsworth, Monterey CA

    MATH  Google Scholar 

  • Chen J, Chen C, Kelton D (2003) Optimal computing budget allocation of indifference-zone-selection procedures, working paper, taken from http://www.cba.uc.edu/faculty/keltonwd:. Cited 6 January 2005

  • Draper NR, Smith H (1998) Applied Regression Analysis, 3rd edn. Wiley, New York NY

    Google Scholar 

  • Fober T, Mernberger M, Klebe G, Hüllermeier E (2009) Evolutionary construction of multiple graph alignments for the structural analysis of biomolecules. Bioinformatics 25(16):2110–2117

    Article  Google Scholar 

  • Fox J (2002) An R and S-Plus Companion to Applied Regression. Sage

    Google Scholar 

  • Ihaka R, Gentleman R (1996) R: A language for data analysis and graphics. Journal of Computational and Graphical Statistics 5(3):299–314

    Article  Google Scholar 

  • Kleijnen JPC (1987) Statistical Tools for Simulation Practitioners. Marcel Dekker, New York NY

    MATH  Google Scholar 

  • Konen W, Zimmer T, Bartz-Beielstein T (2009) Optimierte Modellierung von üllständen in Regenüberlaufbecken mittels CI-basierter Parameterselektion Optimized Modelling of Fill Levels in Stormwater Tanks Using CI-based Parameter Selection Schemes.at-Automatisierungstechnik 57(3):155–166

    Article  Google Scholar 

  • Lasarczyk CWG (2007) Genetische Programmierung einer algorithmischen Chemie. PhD thesis, Technische Universität Dortmund

    Google Scholar 

  • Lophaven S, Nielsen H, Søndergaard J (2002) DACE—A Matlab Kriging Toolbox. Tech. Rep. IMM-REP-2002-12, Informatics and Mathematical Modelling, Technical University of Denmark, Copenhagen, Denmark

    Google Scholar 

  • Maindonald J, Braun J (2003) Data Analysis and Graphics using R—an Examplebased Approach. Cambridge University Press, Cambridge UK

    Google Scholar 

  • Mehnen J, Michelitsch T, Bartz-Beielstein T, Henkenjohann N (2004) Systematic analyses of multi-objective evolutionary algorithms applied to real-world problems using statistical design of experiments. In: Teti R (ed) Proceedings Fourth International Seminar Intelligent Computation in Manufacturing Engineering, CIRP ICME’04, Naples, Italy, vol 4, pp 171–178

    Google Scholar 

  • Mehnen J, Michelitsch T, Lasarczyk C, Bartz-Beielstein T (2007) Multi-objective evolutionary design of mold temperature control using DACE for parameter optimization. International Journal of Applied Electromagnetics and Mechanics 25(1–4):661–667

    Google Scholar 

  • Montgomery DC (2001) Design and Analysis of Experiments, 5th edn. Wiley, New York NY

    Google Scholar 

  • Pukelsheim F (1993) Optimal Design of Experiments. Wiley, New York NY

    MATH  Google Scholar 

  • Rudolph G, Preuss M, Quadflieg J (2009) Two-layered surrogate modeling for tuning optimization metaheuristics. Algorithm Engineering Report TR09-2-005, Faculty of Computer Science, Algorithm Engineering (Ls11), Technische Universität Dortmund, Germany

    Google Scholar 

  • Santner TJ, Williams BJ, Notz WI (2003) The Design and Analysis of Computer Experiments. Springer

    MATH  Google Scholar 

  • Tukey J (1991) The philosophy of multiple comparisons. Statistical Science 6:100– 116

    Article  Google Scholar 

  • Volkert L (2006) Investigating ea based training of hmm using a sequential parameter optimization approach. In: Yen GG, Lucas SM, Fogel G, KendallG, Salomon R, Zhang BT, Coello CAC, Runarsson TP (eds) Proceedings of the 2006 IEEE Congress on Evolutionary Computation, IEEE Press, Vancouver, BC, Canada, pp 2742–2749, URL http://ieeexplore.ieee.org/ servlet/opac?punumber=11108

    Chapter  Google Scholar 

  • Y (2008) Fuzzy operator trees for modeling utility functions. PhD thesis, Philipps-Universität Marburg

    Google Scholar 

  • Ziegenhirt J, Bartz-Beielstein T, Flasch O, KonenW, Zaefferer M (2010) Optimization of biogas production with computational intelligence—a comparative study. Tech. Rep. 03/2010, Institute of Computer Science, Faculty of Computer Science and Engineering Science, Cologne University of Applied Sciences, Germany

    Google Scholar 

Download references

Acknowledgements

This work has been supported by the Bundesministerium für Forschung und Bildung (BMBF) under the grant FIWA (AIF FKZ 17N2309, "Ingenieurnachwuchs") and by the Cologne University of Applied Sciences under the grant COSA.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Thomas Bartz-Beielstein , Christian Lasarczyk or Mike Preuss .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Bartz-Beielstein, T., Lasarczyk, C., Preuss, M. (2010). The Sequential Parameter Optimization Toolbox. In: Bartz-Beielstein, T., Chiarandini, M., Paquete, L., Preuss, M. (eds) Experimental Methods for the Analysis of Optimization Algorithms. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02538-9_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-02538-9_14

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-02537-2

  • Online ISBN: 978-3-642-02538-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics