Particle Swarm Optimization with Ensemble of Inertia Weight Strategies
Particle swarm optimization (PSO) has gained significant attention for solving numerical optimization problems in different applications. However, the performance of PSO depends on the appropriate setting of inertia weight and the optimal setting changes with generations during the evolution. Therefore, different adaptive inertia weight strategies have been proposed. However, the best inertia weight adaptive strategy depends on the nature of the optimization problem. In this paper, different inertia weight strategies such as linear, Gompertz, logarithmic and exponential decreasing inertia weights as well as chaotic and oscillating inertia weight strategies are explored. Finally, PSO with an adaptive ensemble of linear & Gompertz decreasing inertia weights is proposed and compared with other strategies on a diverse set of benchmark optimization problems with different dimensions. Additionally, the proposed method is incorporated into heterogeneous comprehensive learning PSO (HCLPSO) to demonstrate its effectiveness.
KeywordsParticle swarm optimization Ensemble of inertia weight strategies Gompertz decreasing inertia weight Linear decreasing inertia weight
This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology under the Grant NRF- 2015R1C1A1A01055669.
- 1.Eberhart, R., Kennedy, J.: A new optimizer using particle swarm theory. In: Proceedings of the Sixth International Symposium on Micro Machine and Human Science, pp. 39–43 (1995)Google Scholar
- 2.Kennedy, J., Eberhart, R.: Particle swarm optimization. In: 4th IEEE International Conference on Neural Networks (1995)Google Scholar
- 3.Gao, Y., Duan, Y.: An adaptive particle swarm optimization algorithm with new random inertia weight. In: International Conference on Intelligent Computing, pp. 342–350 (2007)Google Scholar
- 4.Xin, J., Chen, G., Hai, Y..: A particle swarm optimizer with multi-stage linearly-decreasing inertia weight. In: International Joint Conference on Computational Sciences and Optimization, pp. 505–508 (2009)Google Scholar
- 6.Nepomuceno, F.V., Engelbrecht, A.P.: A self-adaptive heterogeneous pso for real-parameter optimization. In: IEEE Congress on Evolutionary Computation (CEC), pp. 361–368 (2013)Google Scholar
- 7.van Zyl, E., Engelbrecht, A.: Comparison of self-adaptive particle swarm optimizers. In: IEEE Symposium on Swarm Intelligence (SIS), pp. 1–9 (2014)Google Scholar
- 8.Harrison, K.R., Engelbrecht, A.P., Ombuki-Berman, B.M.: The sad state of self-adaptive particle swarm optimizers. In: IEEE Congress on Evolutionary Computation (CEC), pp. 431–439 (2016)Google Scholar
- 11.Jiang, M., Luo, Y., Yang, S.: Stagnation analysis in particle swarm optimization. In: Proceedings of the 2007 IEEE Swarm Intelligence Symposium (2007)Google Scholar
- 12.Shi, Y., Eberhart, R.: A modified particle swarm optimizer. In: IEEE World Congress on Computational Intelligence, pp. 69–73 (1998)Google Scholar
- 13.Bansal, J.C., Singh, P., Saraswat, M., Verma, A., Jadon, S.S., Abraham, A.: Inertia weight strategies in particle swarm optimization. In: Third World Congress on Nature and Biologically Inspired Computing (NaBIC), pp. 633–640 (2011)Google Scholar