Advertisement

Soft Computing

, Volume 22, Issue 8, pp 2603–2618 | Cite as

A sophisticated PSO based on multi-level adaptation and purposeful detection

  • Xuewen Xia
  • Bojian Wang
  • Chengwang Xie
  • Zhongbo Hu
  • Bo Wei
  • Chang Jin
Methodologies and Application

Abstract

Although particle swarm optimization (PSO) has successfully applied on many global optimization problems, it is prone to premature convergence due to its monotonic and static learning pattern for all individuals. Furthermore, few purposeful operator is proposed to help population jump out of potential local optimum. To address the drawbacks and improve the comprehensive performance of PSO, we propose a sophisticated PSO (SopPSO) based on multi-level adaptation and purposeful detection. In SopPSO, a particle not only updates its learning model according to its fitness landscape, but also periodically re-selects target dimensions that the particle learns from its neighbors. The adaptive strategy applied in multi-level (i.e., individual level and dimension level) endows PSO with a more accurate simulation on emergent collective behaviors. In addition, a tabu detecting and a local searching strategies based on some historical information are proposed to help the population to jump out of local optima and improve the accuracy of solutions, respectively. The extensive experimental results illustrate the effectiveness and efficiency of the proposed strategies. Furthermore, the comparison results between SopPSO and other peer algorithms on different problems verify its favorable performance on unimodal, multimodal and large-scale problems as well as some real applications.

Keywords

Particle swarm optimization Global optimization Multi-level adaptation Tabu detecting strategy Local learning strategy 

Notes

Acknowledgements

This studywas funded by the NationalNatural Science Foundation of China (Nos. 61663009, 61602174, 61562028), the National Natural Science Foundation of Jiangxi Province (Nos. 20161BAB202064, 20161BAB212052, 20151BAB207022) and the National Natural Science Foundation of Jiangxi Provincial Department of Education (Nos. GJJ160469, GJJ150496).

Compliance with ethical standards

Conflict of interest

The authors claim that none of the material in the paper has been published or is under consideration for publication elsewhere. And all authors declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

References

  1. Angeline PJ (1998) Using selection to improve particle swarm optimization. In: Proceedings of IEEE congress on evolutionary computation, pp 84–89Google Scholar
  2. Bergh VD, Engelbrecht AP (2004) A cooperative approach to particle swarm optimization. IEEE Trans Evol Comput 8(3):225–239CrossRefGoogle Scholar
  3. Cheng R, Jin YC (2015) A social learning particle swarm optimization algorithm for scalable optimization. Inf Sci 291(6):43–60MathSciNetCrossRefzbMATHGoogle Scholar
  4. Eberhart R, Shi Y (2000) Comparing inertia weights and constriction factors in particle swarm optimization. In: Proceedings of IEEE congress on evolutionary computation, CEC’00, San Diego, CA, USA, pp 84–88Google Scholar
  5. Higashi H, Iba H (2003) Particle swarm optimization with Gaussian mutation. In: Proceedings of IEEE symposium on swarm intelligence, pp 72–79Google Scholar
  6. Jin X, Liang YQ, Tian DP, Zhuang FZ (2013) Particle swarm optimization using dimension selection methods. Appl Math Comput 219(10):5185–5197MathSciNetzbMATHGoogle Scholar
  7. Kennedy J (1999) Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance. In: Proceedings of IEEE congress on evolutionary computation, pp 1931–1938Google Scholar
  8. Kennedy J, Eberhart RC (1995) A new optimizer using particle swarm theory. In: Proceedings of the sixth international symposium on Micro machine and Human Science, pp 39–43Google Scholar
  9. Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of IEEE international conference on neural network. pp 1942–1948Google Scholar
  10. Kennedy J, Mendes R (2002) Population structure and particle swarm performance. In: Proceedings of IEEE congress on evolutionary computation, pp 1671–1676Google Scholar
  11. Latorre A, Muelas S, José-María Peña (2013) Large scale global optimization: experimental results with MOS-based hybrid algorithm. In: Proceedings of IEEE congress on evolutionary computation, pp 2742–2749Google Scholar
  12. Li C, Yang S, Nguyen TT (2012) A self-learning particle swarm optimizer for global optimization problems. IEEE Trans Syst Man Cybern B Cybern 42(2):627–646Google Scholar
  13. Liang JJ, Suganthan PN (2005) Dynamic multi-swarm particle swarm optimizer. In: Proceedings of IEEE symposium on swarm intelligence, pp 124–129Google Scholar
  14. Liang JJ, Qin AK, Suganthan PN et al (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans Evol Comput 10(3):281–295CrossRefGoogle Scholar
  15. Ling SH, Iu HHC, Chan KY et al (2004) Hybrid particle swarm optimization with wavelet mutation and its industrial applications. IEEE Trans Syst Man Cybern B Cybern 34(2):997–1006CrossRefGoogle Scholar
  16. Li X, Tang K, Omidvar M, Yang Z, Qin K (2013) Benchmark functions for the cec’2013 special session and competition on large scale global optimization. Technical report, Evolutionary Computation and Machine Learning Group, RMIT University, AustraliaGoogle Scholar
  17. Liu J, Tang K (2013) Scaling up covariance matrix adaptation evolution strategy using cooperative coevolution. In: Proceedings of the 14th international conference on intelligent data engineering and automated learning, pp 350–357Google Scholar
  18. Li XD, Yao X (2012) Cooperatively coevolving particle swarms for large scale optimization. IEEE Trans Evol Comput 16(2):210–224CrossRefGoogle Scholar
  19. Lynn N, Suganthan PN (2015) Heterogeneous comprehensive learning particle swarm optimization with enhanced exploration and exploitation. Swarm Evol Comput 24:11–24CrossRefGoogle Scholar
  20. Marco A, Montes dO, Thomas S et al (2009) Frankenstein’s PSO: a composite particle swarm optimization algorithm. IEEE Trans Evol Comput 13(5):1120–1132CrossRefGoogle Scholar
  21. Mendes R, Kennedy J, Neves J (2004) The fully informed particle swarm: simpler, maybe better. IEEE Trans Evol Comput 8(3):204–210CrossRefGoogle Scholar
  22. Molina D, Herrera F (2015) Iterative hybrization of DE with local search for the CEC’2015 special session on large scale global optimization. In: Proceedings of IEEE congress on evolutionary computation, pp 1974–1978Google Scholar
  23. Peram T, Veeramachaneni K, Mohan CK (2003) Fitness-distance-ratio based particle swarm optimization. In: Proceedings of IEEE symposium on swarm intelligence, pp 174–181Google Scholar
  24. Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417CrossRefGoogle Scholar
  25. Ratnaweera A, Halgamuge SK, Watson HC (2004) Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients. IEEE Trans Evol Comput 8(3):240–255CrossRefGoogle Scholar
  26. Sarkar K, Bhattacharyya SP (2013) Single string based global optimizer for geometry optimization in strongly coupled finite clusters: An adaptive mutation-driven strategy. J Chem Phys 139(7):074106CrossRefGoogle Scholar
  27. Sayah S, Hamouda A (2013) A hybrid differential evolution algorithm based on particle swarm optimization for nonconvex economic dispatch problems. Appl Soft Comput 13(4):1608–1619CrossRefGoogle Scholar
  28. Sedki A, Ouazar D (2012) Hybrid particle swarm optimization and differential evolution for optimal design of water distribution systems. Adv Eng Inform 26(3):582–591CrossRefGoogle Scholar
  29. Shi Y, Eberhart RC (1998) A modified particle swarm optimizer. In: Proceedings of IEEE world congress on computational intelligence. pp 68–73Google Scholar
  30. Shi Y, Eberhart RC (2001) Fuzzy adaptive particle swarm optimization. In: Proceedings of IEEE congress on evolutionary computation, pp 101–106Google Scholar
  31. Soh H, Ong YS, Nguyen QC, Nguyen QH et al (2010) Discovering unique, low-energy pure water isomers: memetic exploration, optimization and landscape analysis. IEEE Trans Evol Comput 14(3):419–437CrossRefGoogle Scholar
  32. Swagatam D, Suganthan PN (2010) Problem definitions and evaluation criteria for the CEC 2011 competition on testing evolutionary algorithm on real world optimization problems. Nanyang Technological Univ., Singapore, Tech. RepGoogle Scholar
  33. Wachowiak MP, Smolikova R, Zheng YF et al (2004) An approach to multimodal biomedical image registration utilizing particle swarm optimization. IEEE Trans Evol Comput 8(3):280–288CrossRefGoogle Scholar
  34. Wang Y, Cai ZZ, Zhang QF (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans Evol Comput 15(1):55–66CrossRefGoogle Scholar
  35. Wei C, He Z, Zhang Y et al. (2002) Swarm directions embedded in fast evolutionary programming. In: Proceedings of IEEE congress on evolutionary computation, pp 1278–1283Google Scholar
  36. Xia XW, Liu JN, Hu ZB (2014) An improved particle swarm optimizer based on tabu detecting and local learning strategy in a shrunk search space. Appl Soft Comput 23(5):76–90CrossRefGoogle Scholar
  37. Xu G (2009) An adaptive parameter tuning of particle swarm optimiztion algorithm. Appl Math Comput 219(9):4560–4569zbMATHGoogle Scholar
  38. Yang ZY, Tang K, Yao X (2008) Large scale evolutionary optimization using cooperative coevolution. Inf Sci 178(15):2985–2999MathSciNetCrossRefzbMATHGoogle Scholar
  39. Zhan ZH, Zhang J, Li Y et al (2009) Adaptive particle swarm optimization. IEEE Trans Syst Man Cybern B Cybern 39(6):1362–1381CrossRefGoogle Scholar
  40. Zhan ZH, Li Y, Shi YH (2011) Orthogonal learning particle swarm optimization. IEEE Trans Evol Comput 15(6):832–847CrossRefGoogle Scholar
  41. Zhang J, Sanderson AC (2009) JADE: adaptive differential evolution with optional external archive. IEEE Trans Evol Comput 13(5):945–958CrossRefGoogle Scholar
  42. Zhao SZ, Liang JJ, Suganthan PN et al. (2008) Dynamic multi-swarm particle optimizer with local search for large scale global optimization. In: Proceedings of IEEE congress on evolutionary computation, pp 3845–3852Google Scholar
  43. Zheng YJ, Ling HF, Guan Q (2009) Adaptive parameters for a modified comprehensive learning particle swarm optimizer. Math Probl Eng 68(3):939–955Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2017

Authors and Affiliations

  • Xuewen Xia
    • 1
    • 2
  • Bojian Wang
    • 1
    • 2
  • Chengwang Xie
    • 1
    • 2
  • Zhongbo Hu
    • 3
  • Bo Wei
    • 1
    • 2
  • Chang Jin
    • 1
    • 2
  1. 1.School of SoftwareEast China Jiaotong UniversityJiangxiChina
  2. 2.Intelligent Optimization and Information Processing Lab.East China Jiaotong UniversityJiangxiChina
  3. 3.School of Information and MathematicsYangtze UniversityHubeiChina

Personalised recommendations