Hyperparameter Tuning in Bandit-Based Adaptive Operator Selection

  • Maciej Pacula
  • Jason Ansel
  • Saman Amarasinghe
  • Una-May O’Reilly
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7248)


We are using bandit-based adaptive operator selection while autotuning parallel computer programs. The autotuning, which uses evolutionary algorithm-based stochastic sampling, takes place over an extended duration and occurs in situ as programs execute. The environment or context during tuning is either largely static in one scenario or dynamic in another. We rely upon adaptive operator selection to dynamically generate worthy test configurations of the program. In this paper, we study how the choice of hyperparameters, which control the trade-off between exploration and exploitation, affects the effectiveness of adaptive operator selection which in turn affects the performance of the autotuner. We show that while the optimal assignment of hyperparameters varies greatly between different benchmarks, there exists a single assignment, for a context, of hyperparameters that performs well regardless of the program being tuned.


Score Function Mutation Operator Image Compression Convergence Time Dynamic Context 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ansel, J., Chan, C., Wong, Y.L., Olszewski, M., Zhao, Q., Edelman, A., Amarasinghe, S.: Petabricks: A language and compiler for algorithmic choice. In: ACM SIGPLAN Conference on Programming Language Design and Implementation, Dublin, Ireland (June 2009)Google Scholar
  2. 2.
    Ansel, J., Wong, Y.L., Chan, C., Olszewski, M., Edelman, A., Amarasinghe, S.: Language and compiler support for auto-tuning variable-accuracy algorithms. In: International Symposium on Code Generation and Optimization, Chamonix, France (April 2011)Google Scholar
  3. 3.
    Auer, P., Cesa-Bianchi, N., Fischer, P.: Finite-time analysis of the multiarmed bandit problem. Mach. Learn. 47, 235–256 (2002)zbMATHCrossRefGoogle Scholar
  4. 4.
    Eiben, A., Hinterding, R., Michalewicz, Z.: Parameter control in evolutionary algorithms. IEEE Transactions on Evolutionary Computation 3(2), 124–141 (1999)CrossRefGoogle Scholar
  5. 5.
    Fialho, Á.: Adaptive Operator Selection for Optimization. PhD thesis, Université Paris-Sud XI, Orsay, France (December 2010)Google Scholar
  6. 6.
    Fialho, Á., Da Costa, L., Schoenauer, M., Sebag, M.: Analyzing bandit-based adaptive operator selection mechanisms. Annals of Mathematics and Artificial Intelligence – Special Issue on Learning and Intelligent Optimization (2010)Google Scholar
  7. 7.
    Fialho, Á., Ros, R., Schoenauer, M., Sebag, M.: Comparison-Based Adaptive Strategy Selection with Bandits in Differential Evolution. In: Schaefer, R., Cotta, C., Kołodziej, J., Rudolph, G. (eds.) PPSN XI. LNCS, vol. 6238, pp. 194–203. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  8. 8.
    Maturana, J., Fialho, Á., Saubion, F., Schoenauer, M., Sebag, M.: Extreme com-pass and dynamic multi-armed bandits for adaptive operator selection. In: CEC 2009: Proc. IEEE International Conference on Evolutionary Computation, pp. 365–372. IEEE Press (May 2009)Google Scholar
  9. 9.
    Pacula, M.: Evolutionary algorithms for compiler-enabled program autotuning. Master’s thesis, Massachusetts Institute of Technology, Cambridge, MA (2011)Google Scholar
  10. 10.
    Price, K., Storn, R.M., Lampinen, J.A.: Differential Evolution: A Practical Approach to Global Optimization. Natural Computing Series. Springer-Verlag New York, Inc., Secaucus (2005)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Maciej Pacula
    • 1
  • Jason Ansel
    • 1
  • Saman Amarasinghe
    • 1
  • Una-May O’Reilly
    • 1
  1. 1.CSAILMassachusetts Institute of TechnologyCambridgeUSA

Personalised recommendations