Skip to main content

Automated Parameter Tuning Framework for Heterogeneous and Large Instances: Case Study in Quadratic Assignment Problem

  • Conference paper
  • First Online:
Learning and Intelligent Optimization (LION 2013)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 7997))

Included in the following conference series:

Abstract

This paper is concerned with automated tuning of parameters of algorithms to handle heterogeneous and large instances. We propose an automated parameter tuning framework with the capability to provide instance-specific parameter configurations. We report preliminary results on the Quadratic Assignment Problem (QAP) and show that our framework provides a significant improvement on solutions qualities with much smaller tuning computational time.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ansótegui, C., Sellmann, M., Tierney, K.: A gender-based genetic algorithm for the automatic configuration of algorithms. In: 15th International Conference on Principles and Practice of Constraint Programming, pp. 142–157 (2009)

    Google Scholar 

  2. Bartz-Beielstein, T., Lasarczyk, C., Preuss, M.: Sequential parameter optimization. In: Congress on Evolutionary Computation 2005, pp. 773–780. IEEE Press (2005)

    Google Scholar 

  3. Birattari, M., Gagliolo, M., Saifullah bin Hussin, Stützle, T., Yuan, Z.: Discussion in IRIDIA coffee room, October 2008

    Google Scholar 

  4. Birattari, M., Yuan, Z., Balaprakash, P., Stützle, T.: F-race and iterated f-race: an overview. In: Bartz-Beielstein, T., Chiarandini, M., Paquete, L., Preuss, M. (eds.) Experimental Methods for the Analysis of Optimization Algorithms, pp. 311–336. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  5. Glover, F.: Tabu search - part I. ORSA J. Comput. 1, 190–206 (1989)

    Article  MathSciNet  MATH  Google Scholar 

  6. Gunawan, A., Lau, H.C., Lindawati, : Fine-tuning algorithm parameters using the design of experiments approach. In: Coello Coello, C.A. (ed.) LION 5. LNCS, vol. 6683, pp. 278–292. Springer, Heidelberg (2011)

    Google Scholar 

  7. Gusfield, D.: Algorithms on Strings, Trees and Sequences. Cambridge University Press, Cambridge (1997)

    Book  MATH  Google Scholar 

  8. Guyon, I., Gunn, S., Nikravesh, M., Zadeh, L.A. (eds.): Feature Extraction: Foundations and Applications. Springer, Heidelberg (2006)

    Google Scholar 

  9. Halim, S., Yap, Y.: Designing and tuning sls through animation and graphics an extended walk-through. In: Stochastic Local Search, Workshop (2007)

    Google Scholar 

  10. Halim, S., Yap, Y., Lau, H.C.: Viz: a visual analysis suite for explaining local search behavior. In: 19th ACM Symposium on User Interface Software and Technology, pp. 57–66 (2006)

    Google Scholar 

  11. Halim, S., Yap, R.H.C., Lau, H.C.: An integrated white+black box approach for designing and tuning stochastic local search. In: Bessière, C. (ed.) CP 2007. LNCS, vol. 4741, pp. 332–347. Springer, Heidelberg (2007)

    Google Scholar 

  12. Han, J., Kamber, M.: Data Mining: Concept and Techniques, 2nd edn. Morgan Kaufman, San Francisco (2006)

    Google Scholar 

  13. Hoos, H.H., Stützle, T.: Stochastic Local Search: Foundation and Application. Morgan Kaufman, San Francisco (2004)

    Google Scholar 

  14. Hutter, F., Hoos, H., Leyton-Brown, K.: Tradeoffs in the empirical evaluation of competing algorithm designs. Ann. Math. Artif. Intell. (AMAI), Spec. Issue Learn. Intell. Optim. 60, 65–89 (2011)

    Article  MathSciNet  Google Scholar 

  15. Hutter, F., Hoos, H.H., Leyton-Brown, K.: Sequential model-based optimization for general algorithm configuration. In: Coello Coello, C.A. (ed.) LION 5. LNCS, vol. 6683, pp. 507–523. Springer, Heidelberg (2011)

    Google Scholar 

  16. Hutter, F., Hoos, H.H., Leyton-Brown, K., Stützle, T.: Paramils: an automatic algorithm configuration framework. J. Artif. Intell. Res. 36, 267–306 (2009)

    MATH  Google Scholar 

  17. Kadioglu, S., Malitsky, Y., Sellmann, M., Tierney, K.: Isac: instance-specific algorithm configuration. In: 19th European Conference on Artificial Intelligence (2010)

    Google Scholar 

  18. Kirkpatrick, S., Gelatt, C.D., Vecchi, M.P.: Optimization by simulated annealing. Science 200, 671–680 (1983)

    Article  MathSciNet  Google Scholar 

  19. Knowles, J.D., Corne, D.W.: Instance generators and test suites for the multiobjective quadratic assignment problem. In: Fonseca, C.M., Fleming, P.J., Zitzler, E., Thiele, L., Deb, K. (eds.) EMO 2003. LNCS, vol. 2632, pp. 295–310. Springer, Heidelberg (2003)

    Google Scholar 

  20. Lau, H.C., Xiao, F.: Enhancing the speed and accuracy of automated parameter tuning in heuristic design. In: 8th Metaheuristics International Conference (2009)

    Google Scholar 

  21. Lindawati, Lau, H.C., Lo, D.: Clustering of search trajectory and its application to parameter tuning. JORS Special Edition: Systems to Build Systems (to appear)

    Google Scholar 

  22. Ng, K.M., Gunawan, A., Poh, K.L.: A hybrid algorithm for the quadratic assignment problem. In: International Conference on Scientific Computing, pp. 14–17 (2008)

    Google Scholar 

  23. Ochoa, G., Verel, S., Daolio, F., Tomassini, M.: Clustering of local optima in combinatorial fitness landscapes. In: Coello Coello, C.A. (ed.) LION 5. LNCS, vol. 6683, pp. 454–457. Springer, Heidelberg (2011)

    Google Scholar 

  24. Reeves, C.R.: Landscapes, operators and heuristic search. Ann. Oper. Res. 86(1), 473–490 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  25. Salvador, S., Chan, P.: Determining the number of clusters/segments in hierarchical clustering/segmentation algorithms. In: 16th IEEE International Conference on Tools with Artificial Intelligence, pp. 576–584 (2004)

    Google Scholar 

  26. Schneider, M., Hoos, H.H.: Quantifying homogeneity of instance sets for algorithm configuration. In: Hamadi, Y., Schoenauer, M. (eds.) LION 6. LNCS, vol. 7219, pp. 190–204. Springer, Heidelberg (2012)

    Google Scholar 

  27. Smith-Miles, K., Lopes, L.: Measuring instance difficulty for combinatorial optimization problems. Comput. Oper. Res. 39(5), 875–889 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  28. Stützle, T., Fernandes, S.: New benchmark instances for the QAP and the experimental analysis of algorithms. In: Gottlieb, J., Raidl, G. (eds.) EvoCOP 2004. LNCS, vol. 3004, pp. 199–209. Springer, Heidelberg (2004)

    Google Scholar 

  29. Styles, J., Hoos, H.H., Müller, M.: Automatically configuring algorithms for scaling performance. In: Hamadi, Y., Schoenauer, M. (eds.) LION 6. LNCS, vol. 7219, pp. 205–219. Springer, Heidelberg (2012)

    Google Scholar 

  30. Xu, L., Hoos, H.H., Leyton-Brown, K.: Hydra: automatically configuring algorithms for portfolio-based selection. In: Conference of the Association for the Advancement of Artificial Intelligence (AAAI-10) (2010)

    Google Scholar 

  31. Yong, L., Pardalos, P.M., Resende, M.G.C.: A greedy randomized adaptive search procedure for the quadratic assignment problem. In: Pardalos, P.M., Wolkowicz, H. (eds.) Quadratic Assignment and Related Problems. DIMACS Series in Discrete Mathematics and Theoretical Computer Science, vol. 16, pp. 237–261. American Mathematical Society, Providence (1994)

    Google Scholar 

  32. Yuan, Z., Montes de Oca, M., Birattari, M., Stützle, T.: Continuous optimization algorithms for tuning real and integer parameters of swarm intelligence algorithms. Swarm Intell. 6(1), 49–75 (2012)

    Article  Google Scholar 

Download references

Acknowledgments

We thank Saifullah bin Hussin, Thomas Stützle, Mauro Birattari, Matteo Gagliolo for valuable discussion on scaling large instances, and Aldy Gunawan for allowing us to use his DoE codes.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Feida Zhu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Lindawati, Yuan, Z., Lau, H.C., Zhu, F. (2013). Automated Parameter Tuning Framework for Heterogeneous and Large Instances: Case Study in Quadratic Assignment Problem. In: Nicosia, G., Pardalos, P. (eds) Learning and Intelligent Optimization. LION 2013. Lecture Notes in Computer Science(), vol 7997. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-44973-4_45

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-44973-4_45

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-44972-7

  • Online ISBN: 978-3-642-44973-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics