Clustering Problems for More Useful Benchmarking of Optimization Algorithms
This paper analyses the data clustering problem from the continuous black-box optimization point of view and proposes methodological guidelines for a standard benchmark of clustering problem instances. Clustering problems have been used many times in the literature to evaluate evolutionary, metaheuristic and other global optimization algorithms. However much of this work has occurred independently and the various experimental methodologies used have produced results which tend to be incomparable and provide little collective wisdom as to the difficulty of the problems used, or an objective measure for comparing and evaluating the performance of algorithms. This paper surveys some of the clustering literature and results to identify issues relevant for benchmarking. A set of 27 problem instances ranging from 4-D to 40-D and based on three well-known datasets is identified. To establish some pilot results on this benchmark set, experiments are presented for the Covariance Matrix Adaptation-Evolution Strategy and several other standard algorithms. A web-repository has also been created for this problem set to facilitate better experimental evaluations of algorithms.
KeywordsAlgorithm Benchmarking Continuous Black-box Optimization Clustering
Unable to display preview. Download preview PDF.
- 1.Blake, C., Keogh, E., Merz, C.J.: UCI repository of machine learning databases(1998), http://www.ics.uci.edu/~mlearn/MLRepository.html (retrieved)
- 7.Liu, R., Shen, Z., Jiao, L., Zhang, W.: Immunodomaince based clonal selection clustering algorithm. In: 2010 IEEE Congress on Evolutionary Computation (CEC), pp. 1–7 (2010)Google Scholar
- 9.Salhi, S., Gamal, M.D.H.: A genetic algorithm based approach for the uncapacitated continuous location-allocation problem. Annals of Operations Research 123, 230–222 (2003)Google Scholar
- 14.Ye, F., Chen, C.-Y.: Alternative kpso-clustering algorithm. Tamkang Journal of Science and Engineering 8(2), 165 (2005)Google Scholar