Abstract
In this chapter, after a brief introduction to the Particle Swarm Optimization (PSO), a novel PSO algorithm based on magnification transformation called Magnifier Particle Swarm Optimization (MPSO) is presented. In the MPSO, the range around each generation’s best individual is enlarged akin to using a magnifier, while the velocity of particles stays unchanged. This way, the MPSO achieves much faster convergence speed and better optimization solving capability than the Standard Particle Swarm Optimization (SPSO) by a number of simulations. In the context, the proposed MPSO algorithm is described and explained in detail by comparing it with the SPSO. Simulations on thirteen benchmark test functions are conducted to verify the effectiveness of the MPSO. Our experimental results show that the proposed MPSO not only speeds up the convergence tremendously but also maintains a strong capability of searching for the global solution with high accuracy. The application to spam detection shows that the proposed MPSO gives a promising result.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lai, C.C., Wu, C.H.: Particle swarm optimization-aided feature selection for spam email classification. In: Proceedings of the Second International Conference on Innovative Computing, Information and Control, pp. 165–168 (2007)
Bratton, D., Kennedy, J.: Defining a standard for particle swarm optimization. In: Proceedings of the IEEE Swarm Intelligence Symposlum (SIS), pp. 120–127 (2007)
Ozcan, E., Mohan, C.: Analysis of a simple particle swarm optimization system. In: Proceedings of the IEEE International Conference on Intelligent Engineering Systems Through Artificial Neural Networks, pp. 253–258 (1998)
Ozcan, E., Mohan, C.: Particle swarm optimization: surfing the waves. In: Proceedings of the IEEE Congress on Evolution Computation, pp. 1939–1944 (1999)
van den Bergh, F.: An analysis of particle swarm optimizers. PhD thesis, Department of Computer Science, University of Pretoria, South Africa (2002)
van den Bergh, F., Engelbrecht, A.P.: A cooperative approach to particle swarm optimization. IEEE Trans. on Evolutionary Computation 8, 225–239 (2004)
Holland, J.H.: Adaption in natural and artificial systems. MIT Press, Cambridge (1975)
Trelea, I.C.: The particle swarm optimization algorithm: convergence analysis and parameter selection. Information Processing Letters 85, 317–325 (2003)
Androutsopoulos, I., Koutsias, J., Chandrinos, K.V., Spyropoulos, C.D.: An experimental comparison of naive Bayesian and keyword-based anti-spam filtering with personal e-mail messages. In: Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 160–167 (2000)
Androutsopoulos, I., Koutsias, J., Chandrinos, K.V., Paliouras, G., Spyropoulos, C.D.: An evaluation of naive Bayesian anti-spam filtering. In: Potamias, G., Moustakis, V., Someren, M.V. (eds.) Proceedings of the workshop on Machine Learning in the New Information Age, 11th European Conference on Machine Learning, pp. 9–17 (2000)
Koprinska, I., Poon, J., Clark, J., Chan, J.: Learning to classify e-mail. Information Science 177, 2167–2187 (2007)
Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of the IEEE International Conference on Neural Networks, pp. 1942–1948 (1995)
Kennedy, J.: The particle swarm: social adaption of knowledge. In: Proceedings of the IEEE International Conference on Evolutionary Computation, pp. 13–16 (1997)
Kennedy, J.: Bare bones particle swarms. In: Proceedings of the IEEE International Conference on Swarm Intelligence Symposium, pp. 24–26 (2003)
Kennedy, J.: Probability and dynamics in the particle swarm. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp. 340–347 (2004)
Kennedy, J.: Why does it need velocity. In: Proceedings of the IEEE International Conference on Swarm Intelligence Symposium, pp. 38–44 (2005)
Kennedy, J.: Dynamic-probabilistic particle swarms. In: Proceedings of the IEEE International Conference on Genetic and Evolutionary Computation Conference, pp. 201–207 (2005)
Kennedy, J., Mendes, R.: Population structure and particle swarm performance. In: Proceedings of IEEE Congress on Evolutionary Computation, pp. 1671–1676 (2002)
Clark, J., Koprinska, I., Poon, J.: A neural network based approach to automated E-mail classification. In: Proceedings of IEEE International Conference on Web Intelligence, pp. 702–705 (2003)
Liang, J.J., Qin, A.K., Suganthan, P.N., Baskar, S.: Comprehensive learning particle swarm optimizer for global optimi-zation of multimodal functions. IEEE Trans. on Evolutionary Computation 10, 281–296 (2006)
Zhang, J.Q., Liu, K., Tan, Y., He, X.G.: Hybrid particle swarm optimizer with advance and retreat strategy and clonal mechanism for global numerical optimiza-tion. In: Proceedings of IEEE Congress on Evolutionary Computation, pp. 2059–2066 (2008)
Zhang, J.Q., Liu, K., Tan, Y., He, X.G.: Random black hole particle swarm optimization. In: Proceedings of International Conference on Neural Networks and Signal Processing, pp. 359–365 (2008)
Yasuda, K., Ide, A., Iwasaki, N.: Adaptive particle swarm optimization. In: Proceedings of IEEE International Conference on Systems, Man and Cybernetics, pp. 1554–1559 (2003)
Parsopoulos, K.E., Vrahatis, M.N.: UPSO-a united particle swarm optimization scheme. In: Proceedings of the International Conference of Computational Methods in Sciences and Engineering, pp. 868–873 (2004)
Clerc, M., Kennedy, J.: The particle swarm - explosion, stability, and convergence in a multidimensional complex space. IEEE Trans. on Evolutionary Computation 6(1), 58–73 (2002)
Clerc, M.: Stagnation analysis in particle swarm optimization or what happens when nothing happens. Technical Report CSM-460 (2006)
Clerc, M.: Particle swarm optimization. In: Proceedings of International Scientific and Technical Encyclopedia (2006)
El-Abd, M., Kamel, M.S.: A hierarchal cooperative particle swarm optimizer. In: Proceedings of Swarm Intelligence Symposium, pp. 43–47 (2006)
Parsopoulos, K.E., et al.: Stretching technique for obtaining global minimizers through particle swarm optimization. In: Proceedings of the Workshop on Particle Swarm Optimization, pp. 22–29 (2001)
Zhang, J.Q., Liu, K., Tan, Y., He, X.G.: Magnifier particle swarm optimization for numerical optimization. In: Proceedings of ACM SIGEVO Gentic and Evolutionary Computation Conference (GECCO 2008), pp. 167–168 (2008)
Blenkhorn, P., Evans, D.G.: A screen magnifier using ‘high level’ implementation techniques. IEEE Trans. on Neural Systems and Rehabilitation Engineering 14(4), 501–504 (2006)
Suganthan, P.N., et al.: Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. In: Proceedings of the IEEE Swarm Intelligence Symposlum (SIS) (2005)
Eberhart, R.C., Kennedy, J.: A new optimizer using particle swarm theory. In: Proceedings of the 6th Int. Symp. Mcro Machine Human Science, pp. 39–43 (1995)
Poli, R., Langdon, W.B.: Markov chain models of bare-bones particle swarm optimizers. In: Proceedings of the IEEE International Conference on Genetic And Evolutionary Computation Conference, pp. 142–149 (2007)
Poli, R., Broomhead, D.: Exact analysis of the sampling distribution for canonical particle swarm optimiser and its convergence during stagnation. In: Proceedings of the IEEE International Conference on Genetic and Evolutionary Computation Conference, pp. 134–141 (2007)
Poli, R.: On the moments of the sampling distribution of particle swarm optimizers. In: Proceedings of the IEEE International Conference on Genetic and Evolutionary Computation Conference, pp. 2907–2914 (2007)
Poli, R.: Dynamics and stability of the sampling distribution of particle swarm optimisers via moment analysis. Journal of Artificial Evolution and Applications 1, 1–10 (2008)
Keahey, T.A., Robertson, E.L.: Techniques for nonlinear magnification transformations. In: Proceedings of the IEEE Symposium on Information Visualization, pp. 38–45 (1996)
Blackwell, T.M.: Particle swarms and population diversity. In: Proceedings of IEEE International Conference on Soft Computing, pp. 793–802 (2005)
Peram, T.: Fitness-distance-ratio based particle swarm optimization. In: Proceedings of Swarm Intelligence Symposium, pp. 174–181 (2003)
Kadirkamanathan, V., et al.: Stability analysis of the particle dynamics in particle swarm optimizer. IEEE Trans. Evolutionary Computation 10(3), 245–255 (2006)
Vapnik, V.: The Nature of Statistical Learning Theory. Springer, New York (1995)
Tan, Y., Xiao, Z.M.: Clonal particle swarm optimization and its applications. In: Proceedings of IEEE Congress on Evolutionary Computation, pp. 2303–2309 (2007)
Shi, Y.H., Eberhart, R.: A modified particle swarm optimizer. In: Proceedings of IEEE World Congress on Computational Intelligence, pp. 69–73 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Tan, Y., Zhang, J. (2009). Magnifier Particle Swarm Optimization. In: Chiong, R. (eds) Nature-Inspired Algorithms for Optimisation. Studies in Computational Intelligence, vol 193. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-00267-0_10
Download citation
DOI: https://doi.org/10.1007/978-3-642-00267-0_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-00266-3
Online ISBN: 978-3-642-00267-0
eBook Packages: EngineeringEngineering (R0)