Improving Nearest Neighbor Partitioning Neural Network Classifier Using Multi-layer Particle Swarm Optimization
- 640 Downloads
Nearest neighbor partitioning (NNP) method has been proved to be an effective method to enhance the quality of neural network classifiers. However, there are many cluster shapes in NNP, which results in a large number of local optimal solutions in the searching space by the traditional particle swarm optimization (PSO) algorithm. Therefore, the multi-layer particle swarm optimization (MLPSO) is introduced to increase the diversity of searching groups through increasing the number of layers, thereby improving the performance when facing with large scale problems. In this study, we adopt the combination of multi-layer particle swarm optimization and nearest neighbor partitioning to solve the local optimal problem caused by multi-cluster shapes in the optimization of NNP. Experimental results show that this method improves the performance of classifier.
KeywordsClassification Nearest neighbor partitioning Neural network Multi-layer particle swarm optimization
This work was supported by National Natural Science Foundation of China under Grant No. 61573166, No. 61572230, No. 61872419, No. 61873324, No. 81671785, No. 61672262. Science and technology project of Shandong Province under Grant No. 2015GGX101025. Project of Shandong Province Higher Educational Science and Technology Program under Grant no. J16LN07. Shandong Provincial Key R&D Program under Grant No. 2016ZDJS01A12, No. 2016GGX101001. Taishan Scholar Project of Shandong Province, China.
- 5.Wang, L., Orchard, J.: Investigating the evolution of a neuroplasticity network for learning. IEEE Trans. Syst. Man Cybern. Syst. PP(99), 1–13 (2017)Google Scholar
- 13.Bridle, J.S.: Probabilistic interpretation of feedforward classification network outputs, with relationships to statistical pattern recognition. In: Neurocomputing, pp. 227–236. Springer, Berlin (1990)Google Scholar
- 17.Xiong, Z.Y., Liu, D.Q., Zhang, Y.F.: Constructing classifier of neural networks using improved genetic algorithms. Comput. Appl. 25(01), 31–34 (2005)Google Scholar
- 18.Zhou, W., Xiong, S.: Optimization of BP neural network classifier using genetic algorithm. Energy Procedia 11, 578–584 (2013)Google Scholar