Algorithm Configuration in the Cloud: A Feasibility Study

  • Daniel GeschwenderEmail author
  • Frank Hutter
  • Lars Kotthoff
  • Yuri Malitsky
  • Holger H. Hoos
  • Kevin Leyton-Brown
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8426)


Configuring algorithms automatically to achieve high performance is becoming increasingly relevant and important in many areas of academia and industry. Algorithm configuration methods take a parameterized target algorithm, a performance metric and a set of example data, and aim to find a parameter configuration that performs as well as possible on a given data set.



The authors were supported by an Amazon Web Services research grant, European Union FP7 grant 284715 (ICON), a DFG Emmy Noether Grant, and Compute Canada.


  1. 1.
    Ansótegui, C., Sellmann, M., Tierney, K.: A gender-based genetic algorithm for the automatic configuration of algorithms. In: Gent, I.P. (ed.) CP 2009. LNCS, vol. 5732, pp. 142–157. Springer, Heidelberg (2009) CrossRefGoogle Scholar
  2. 2.
    Birattari, M., Yuan, Z., Balaprakash, P., Stützle, T.: F-race and iterated F-race: an overview. In: Bartz-Beielstein, T., Chiarandini, M., Paquete, L., Preuss, M. (eds.) Empirical Methods for the Analysis of Optimization Algorithms. Springer, Heidelberg (2010)Google Scholar
  3. 3.
    Hutter, F., Babić, D., Hoos, H.H., Hu, A.J.: Boosting verification by automatic tuning of decision procedures. In: Formal Methods in Computer Aided Design, pp. 27–34 (2007)Google Scholar
  4. 4.
    Hutter, F., Hoos, H.H., Leyton-Brown, K.: Sequential model-based optimization for general algorithm configuration. In: Coello, C.A.C. (ed.) LION 5. LNCS, vol. 6683, pp. 507–523. Springer, Heidelberg (2011) CrossRefGoogle Scholar
  5. 5.
    Hutter, F., Hoos, H.H., Leyton-Brown, K., Stützle, T.: ParamILS: an automatic algorithm configuration framework. J. Artif. Int. Res. 36(1), 267–306 (2009)zbMATHGoogle Scholar
  6. 6.
    Kotthoff, L.: Reliability of computational experiments on virtualised hardware. JETAI (2013)Google Scholar
  7. 7.
    Lampe, U., Kieselmann, M., Miede, A., Zöller, S., Steinmetz, R.: A tale of millis and nanos: time measurements in virtual and physical machines. In: Lau, K.-K., Lamersdorf, W., Pimentel, E. (eds.) ESOCC 2013. LNCS, vol. 8135, pp. 172–179. Springer, Heidelberg (2013) CrossRefGoogle Scholar
  8. 8.
    Schad, J., Dittrich, J., Quiané-Ruiz, J.-A.: Runtime measurements in the cloud: observing, analyzing, and reducing variance. VLDB Endow. 3, 460–471 (2010)Google Scholar
  9. 9.
    Thornton, C., Hutter, F., Hoos, H.H., Leyton-Brown, K.: Auto-WEKA: combined selection and hyperparameter optimization of classification algorithms. In: KDD, pp. 847–855 (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Daniel Geschwender
    • 1
    Email author
  • Frank Hutter
    • 2
  • Lars Kotthoff
    • 3
  • Yuri Malitsky
    • 3
  • Holger H. Hoos
    • 4
  • Kevin Leyton-Brown
    • 4
  1. 1.University of Nebraska-LincolnLincolnUSA
  2. 2.University of FreiburgFreiburg im BreisgauGermany
  3. 3.INSIGHT Centre for Data AnalyticsCorkIreland
  4. 4.University of British ColumbiaVancouverCanada

Personalised recommendations