Abstract
This paper presents a new learning algorithm, Multi-Population Cooperative Particle Swarm Optimizer (MCPSO), for neural network training. MCPSO is based on a master-slave model, in which a population consists of a master group and several slave groups. The slave groups execute a single PSO or its variants independently to maintain the diversity of particles, while the master group evolves based on its own information and also the information of the slave groups. The particles both in the master group and the slave groups are co-evolved during the search process by employing a parameter, termed migration factor. The MCPSO is applied for training a multilayer feed-forward neural network, for three benchmark classification problems. The performance of MCPSO used for neural network training is compared to that of Back Propagation (BP), genetic algorithm (GA) and standard PSO (SPSO), demonstrating its effectiveness and efficiency.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Nekovei, R., Sun, Y.: Back-propagation Network and its Configuration for Blood Vessel Detection in Angiograms. IEEE Trans. Neural Networks 6(1), 64–72 (1995)
Billings, S.A., Zheng, G.L.: Radial Basis Function Network Configuration Using Genetic Algorithms. Neural Networks 8(6), 877–890 (1995)
Tandon, V., El-Mounayri, H., Kishawy, H.: NC End Milling Optimization Using Evolutionary Computation. Int. J. Mach. Tools Manuf. 42(5), 595–605 (2002)
Angeline, P.J.: Evolutionary Optimization versus Particle Swarm Optimization: Philosophy and Performance Difference. In: Porto, V.W., Waagen, D. (eds.) EP 1998. LNCS, vol. 1447, pp. 745–754. Springer, Heidelberg (1998)
Kennedy, J., Eberhart, R.C., Shi, Y.: Swarm Intelligence. Morgan Kaufmann Publishers, San Francisco (2001)
Clerc, M., Kennedy, J.: The Particle Swarm: Explosion, Stability, and Convergence in a Multidimensional Complex Space. IEEE Trans. Evol. Comput. 6(1), 58–73 (2002)
Niu, B., Zhu, Y.L., He, X.X.: Construction of Fuzzy Models for Dynamic Systems Using Multi-population Cooperative Particle Swarm Optimizer. In: Wang, L., Jin, Y. (eds.) FSKD 2005. LNCS (LNAI), vol. 3613, pp. 987–1000. Springer, Heidelberg (2005)
Niu, B., Zhu, Y.L., He, X.X.: Multi-population Cooperative Particle Swarm Optimization. In: Capcarrère, M.S., Freitas, A.A., Bentley, P.J., Johnson, C.G., Timmis, J. (eds.) ECAL 2005. LNCS (LNAI), vol. 3630, pp. 874–883. Springer, Heidelberg (2005)
Genkai-Kato, M., Yamamura, N.: Evolution of Mutualistic Symbiosis without Vertical Transmission. Comp. Biochem. Physiol. 123(3), 269–278 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Niu, B., Zhu, YL., He, XX. (2006). A Multi-population Cooperative Particle Swarm Optimizer for Neural Network Training. In: Wang, J., Yi, Z., Zurada, J.M., Lu, BL., Yin, H. (eds) Advances in Neural Networks - ISNN 2006. ISNN 2006. Lecture Notes in Computer Science, vol 3971. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11759966_85
Download citation
DOI: https://doi.org/10.1007/11759966_85
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-34439-1
Online ISBN: 978-3-540-34440-7
eBook Packages: Computer ScienceComputer Science (R0)