Annals of Mathematics and Artificial Intelligence

, Volume 61, Issue 2, pp 87–104

Discovering the suitability of optimisation algorithms by learning from evolved instances


DOI: 10.1007/s10472-011-9230-5

Cite this article as:
Smith-Miles, K. & van Hemert, J. Ann Math Artif Intell (2011) 61: 87. doi:10.1007/s10472-011-9230-5


The suitability of an optimisation algorithm selected from within an algorithm portfolio depends upon the features of the particular instance to be solved. Understanding the relative strengths and weaknesses of different algorithms in the portfolio is crucial for effective performance prediction, automated algorithm selection, and to generate knowledge about the ideal conditions for each algorithm to influence better algorithm design. Relying on well-studied benchmark instances, or randomly generated instances, limits our ability to truly challenge each of the algorithms in a portfolio and determine these ideal conditions. Instead we use an evolutionary algorithm to evolve instances that are uniquely easy or hard for each algorithm, thus providing a more direct method for studying the relative strengths and weaknesses of each algorithm. The proposed methodology ensures that the meta-data is sufficient to be able to learn the features of the instances that uniquely characterise the ideal conditions for each algorithm. A case study is presented based on a comprehensive study of the performance of two heuristics on the Travelling Salesman Problem. The results show that prediction of search effort as well as the best performing algorithm for a given instance can be achieved with high accuracy.


Algorithm selection Combinatorial optimization Travelling salesman problem Hardness prediction Phase transition Instance difficulty 

Mathematics Subject Classifications (2010)

49-04 68Q25 68Q87 68T05 68T20 90B99 

Copyright information

© Springer Science+Business Media B.V. 2011

Authors and Affiliations

  1. 1.School of Mathematical SciencesMonash UniversityVictoriaAustralia
  2. 2.School of InformaticsUniversity of EdinburghEdinburghUK

Personalised recommendations