Multiple Cooperating Swarms for Non-Linear Function Optimization

  • Mohammed El-Abd
  • Mohamed Kamel
Part of the Advances in Soft Computing book series (AINSC, volume 29)


This paper investigates a new approach applied to particle swarm optimization. The paper addresses the idea of having multiple swarms searching for a solution while cooperating with each other by exchanging their best solutions. The experiments show that this approach behaves in a way that is dependent on the function being optimized. They also show that changing the synchronization period (number of generations) after which the swarms cooperate with each other has a great effect on the obtained solution quality.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Angeline P. (1999), “Using Selection To Improve Particle Swarm Optimization”, Proceedings of IJCNN’99, pp. 84–89.Google Scholar
  2. 2.
    Baskar S., and Suganthan P. N. (2004), “A Novel Concurrent Particle Swarm Optimization”, Proceedings of the 2004 Congress on Evolutionary Computation, vol. 1, pp. 792–796.CrossRefGoogle Scholar
  3. 3.
    Cantu-Paz E. (1997), “A Survey of Parallel Genetic Algorithms”. IllGAL Report 97003, The University of Illinois. Available on-line at: ftp://ftpilligal. Scholar
  4. 4.
    Clerc M., and Kennedy J. (2002), “The Particle Swarm Explosion, stability, and Convergence in a Multi-Dimensional Complex Space”, IEEE Transactions on Evolutionary Computing, no. 6, pp. 58–73.CrossRefGoogle Scholar
  5. 5.
    Crainic T. G., and Gendreau M. (2000), “Cooperative Parallel Tabu Search for Capacitated Network Design”. Journal of Heuristics, vol. 8, pp.601–627.CrossRefGoogle Scholar
  6. 6.
    Eberhart R. C., and Kennedy J. (1995), “A New Optimizer using Particle Swarm Theory”, Proceedings of the 6th International Symposium on Micro Machine and Human Science, pp. 39–43.Google Scholar
  7. 7.
    Eberhart R. C., Simpson P., and Dobbins R. (1996), Computational Intelligence PC Tools: Academic, ch. 6, pp. 212–226.Google Scholar
  8. 8.
    Eberhart R. C. and Shi Y. (2000), “Comparing Inertia Weights and Constriction Factors in Particle Swarm Optimization”. Proceedings of the 2000 Congress of Evolutionary Computation, pp. 84–89.Google Scholar
  9. 9.
    Engelbrech A. P., and Ismail A (1999), “Training Product Unit Neural Networks”, Stability Control: Theory Appl, vol. 2, no. 1–2, pp. 59–74.Google Scholar
  10. 10.
    Kennedy J., and Eberhart R. C (1995), “Particle Swarm Optimization”, Proceeding of the IEEE International Conference on Neural Networks, vol. 4, pp. 1942–1948.CrossRefGoogle Scholar
  11. 11.
    Kennedy J. (2000), “Stereotyping: Improving Particle Swarm Performance With Cluster Analysis”, Proceeding of the 2000 Congress on Evolutionary Computation, vol. 2, pp. 1507–1512.CrossRefGoogle Scholar
  12. 12.
    Liu H., Li B., and Wang X. (2004), “Particle Swarm Optimization from lbest to gbest”, 1st Int. Wkshp on Swarm Intelligence and Patterns.Google Scholar
  13. 13.
    Middendorf M., Reischle F., and Schmeck H. (2000), “Information Exchange in Multi Colony Ant Algorithms”. In Rolim J., editor, Parallel and Distributed Computing, Proceedings of 15 IPDPS 2000 Workshops, 3rd Workshop on Biologically Inspired Solutions to Parallel Processing Problems (BioSP3), LNCS 1800, Springer-Verlag, pp.645–652.Google Scholar
  14. 14.
    Milano M., and Roli A. (2004), “MAGMA: A Multiagent Architecture for Metaheuristics”. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 33, No. 2, pp.Google Scholar
  15. 15.
    Peram T., Veeramachaneni K., and Mohan C. K. (2003), “Distance-Fitness-Ratio Particle Swarm Optimization”, Proceeding of the IEEE 2000 Swarm Intelligence Symposium, pp. 174–181.Google Scholar
  16. 16.
    Potter M.A., and de Jong K. A. (1994), “A Cooperative Coevloutinary Approach to Function Optimization”, in The Third Parallel Problem Solving from Nature, Springer-Verlag, pp. 249–257.Google Scholar
  17. 17.
    Shi Y., and Eberhart R. C (1999), “Empirical Study of Particle Swarm Optimization”, Proceedings of the 1999 Congress of Evolutionary Computation, pp.1945–1949.Google Scholar
  18. 18.
    Toulouse M., Crainic T. G., and Sanso B (1999), “An Experimental Study of The Systemic Behavior of Cooperative Search Algorithms”. In Meta-Heuristics: Advances and Trends in Local Search Paradigms for Optimization. S. Voss. S. Martello, I. Osman, and C. Roucairol, editors. Kluwer Academic Publishers, Chapter 26, pp. 373–392.Google Scholar
  19. 19.
    van den Bergh F. and Engelbrech A. P. (2004), “A Cooperative Approach to Particle Swarm Optimization”, IEEE Transactions on Evolutionary Computation, vol. 8, no. 3, pp. 225–239.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Mohammed El-Abd
    • 1
  • Mohamed Kamel
    • 1
  1. 1.Dept. of Electrical and Computer EngineeringUniversity of WaterlooWaterlooCanada

Personalised recommendations