An Adaptive Michigan Approach PSO for Nearest Prototype Classification
Nearest Prototype methods can be quite successful on many pattern classification problems. In these methods, a collection of prototypes has to be found that accurately represents the input patterns. The classifier then assigns classes based on the nearest prototype in this collection. In this paper we develop a new algorithm (called AMPSO), based on the Particle Swarm Optimization (PSO) algorithm, that can be used to find those prototypes. Each particle in a swarm represents a single prototype in the solution; the swarm evolves using modified PSO equations with both particle competition and cooperation. Experimentation includes an artificial problem and six common application problems from the UCI data sets. The results show that the AMPSO algorithm is able to find solutions with a reduced number of prototypes that classify data with comparable or better accuracy than the 1-NN classifier. The algorithm can also be compared or improves the results of many classical algorithms in each of those problems; and the results show that AMPSO also performs significantly better than any tested algorithm in one of the problems.
KeywordsClassification Data Mining Nearest Neighbor Particle Swarm Swarm Intelligence
Unable to display preview. Download preview PDF.
- 3.Kennedy, J., Eberhart, R.C., Shi, Y.: Swarm intelligence. Morgan Kaufmann Publishers, San Francisco (2001)Google Scholar
- 4.Holland, J.H.: Adaptation. Progress in theoretical biology, 263–293 (1976)Google Scholar
- 7.Blackwell, T.M., Bentley, P.J.: Don’t push me! collision-avoiding swarms. In: Proceedings of the IEEE Congress on Evolutionary Computation (CEC), pp. 1691–1696. IEEE Computer Society Press, Los Alamitos (2002)Google Scholar
- 8.Blackwell, T.M., Bentley, P.J.: Dynamic search with charged swarms. In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2002), pp. 19–26 (2002)Google Scholar
- 9.Cervantes, A., Isasi, P., Galván, I.: Binary particle swarm optimization in classification. Neural Network World 15(3), 229–241 (2005)Google Scholar