Abstract
Several techniques have been proposed to extend the particle swarm optimization (PSO) paradigm so that multiple optima can be located and maintained within a convoluted search space. A significant number of these implementations are subswarm-based, that is, portions of the swarm are optimized separately. Niches are formed to contain these subswarms, a process that often requires user-specified parameters. The proposed technique, known as the vector-based PSO, uses a novel approach to locate and maintain niches by using additional vector operations to determine niche boundaries. As the standard PSO uses weighted vector combinations to update particle positions and velocities, the niching technique builds upon existing knowledge of the particle swarm. Once niche boundaries have been calculated, the swarm can be organized into subswarms without prior knowledge of the number of niches and their corresponding niche radii. This paper presents the vector-based PSO with emphasis on its underlying principles. Results for a number of functions with different characteristics are reported and discussed. The performance of the vector-based PSO is also compared to two other niching techniques for particle swarm optimization.
Similar content being viewed by others
References
Bird S, Li X (2006) Adaptively choosing niching parameters in a PSO. In: Proceeding of the genetic and evolutionary computation conference, Seattle, Washington, USA, pp 3–9
Bratley P, Fox BL (1988) Algorithm 659: implementing Sobol’s quasirandom sequence generator. ACM Trans Math Softw 14:88–100
Brits R, Engelbrecht AP, Van den Bergh F (2002a) Solving systems of unconstrained equations using particle swarm optimizers. In: Proceedings of the IEEE conference on systems, man and cybernetics, Hammamet,Tunisa, pp 102–107
Brits R, Engelbrecht AP, Van den Bergh F (2002b) A niching particle swarm optimizer. In: Proceedings of the 4th Asia-Pacific conference on simulated evolution and learning, Singapore, pp 692–696
Brits R, Engelbrecht AP, Van den Bergh F (2007) Locating multiple optima using particle swarm optimization. Appl Math Comput 189(2):1859–1883
Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Sixth international symposium on micro machine and human science. IEEE Service Center, Nagoya, Japan, pp 39–43
Hendtlass T (2005) WoSP: a Multi-optima particle swarm algorithm. In: Proceedings of the IEEE congress on evolutionary computation, Edinburgh, UK, pp 727–734
Joe S, Kuo FY (2003). Remark on Algorithm 659: implementing Sobol’s quasirandom sequence generator. ACM Trans Math Softw 29:49–57
Kennedy J (1999) Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance. In: Proceedings of the congress on evolutionary computation (Washington DC, USA). IEEE Service Center, Piscataway, NJ, pp 1931–1938
Kennedy J (2000) Stereotyping improving particle swarm performance with cluster analysis. In: Proceedings of the Congress on Evolutionary Computation. San Diego USA. IEEE Service Center, Piscataway, NJ, pp 1507–1512
Kennedy J (2005) Why does it need velocity? In: Proceedings of the IEEE swarm intelligence symposium, Pasadena CA
Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks (Perth, Australia), vol IV. IEEE Service Center, Piscataway, NJ, pp 1942–1948
Kennedy J, Mendes R (2002) Population structure and particle swarm performance. In: Proceedings of the IEEE congress on evolutionary computation, Hawaii, USA
Li X (2004) Adaptively choosing neighbourhood bests using species in a particle swarm optimizer for multimodal function optimization. In: Proceedings of the genetic and evolutionary computation conference (GECCO 2004), pp 105–116
Li X (2007) A multimodal particle swarm optimizer based on fitness Euclidian-distance ratio. In: Proceeding of the genetic and evolutionary computation conference (GECCO 2007), London, England, UK, pp 78–85
Ozcan E, Mohan C (1999) Particle swarm optimization: surfing the waves. In: Proceedings of the international congress on evolutionary computation, Washington, USA, pp 1939–1944
Parsopoulos KE, Vrahatis MN (2001) Modification of the particle swarm optimizer for locating all the global minima. In: Kurkova V, Steele NC, Neruda R, Karny M (eds) Artificial neural networks and genetic algorithms. Springer, Wien, pp 324–327
Parsopoulos KE, Plagianakos VP, Magoulas GD, Vrahatis MN (2001) Stretching techniques for obtaining global minimizers through particle swarm optimization. In: Proceedings of the particle swarm optimization workshop, Indianapolis, USA, pp 22–29
Schoeman IL, Engelbrecht AP (2004) Using vector operations to identify niches for particle swarm optimization. In: Proceedings of the IEEE conference on cybernetics and intelligent systems, Singapore, pp 361–366
Schoeman IL, Engelbrecht AP (2005a) A Parallel vector-based particle swarm optimizer. In: Proceedings of the international conference on artificial neural networks and genetic algorithms (ICANNGA2005), Coimbra, Portugal, pp 268–271
Schoeman IL, Engelbrecht AP (2005b) Containing particles inside niches when optimizing multimodal functions. In: Proceedings of SAICSIT2005, White River, South Africa, pp 78–85
Shi Y, Eberhart R (1998a) A modified particle swarm optimizer. In: IEEE international conference of evolutionary computation. Anchorage, Alaska, pp 69–73
Shi Y, Eberhart RC (1998b) Parameter selection in particle swarm optimization. In: Evolutionary programming VII: proceedings of EP 98, pp 591–600
Van den Bergh F (2002) An analysis of particle swarm optimizers. PhD Thesis, University of Pretoria
Van den Bergh F, Engelbrecht AP (2002) A new locally convergent particle swarm optimiser. In: Proceedings of the IEEE international conference on systems, man and cybernetics, Hammamet, Tunisia, October
Van den Bergh F, Engelbrecht AP (2006) A study of particle swarm optimization particle trajectories. Inform Sci 176:937–971
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Schoeman, I.L., Engelbrecht, A.P. A novel particle swarm niching technique based on extensive vector operations. Nat Comput 9, 683–701 (2010). https://doi.org/10.1007/s11047-009-9170-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11047-009-9170-8