Abstract
An Adaptive Cooperative Particle Swarm Optimizer (ACPSO) is introduced in this paper, which facilitates cooperation technique through the usage of the Learning Automata (LA) algorithm. The cooperative strategy of ACPSO optimizes the problem collaboratively and evaluates it in different contexts. In the ACPSO algorithm, a set of learning automata associated with dimensions of the problem are trying to find the correlated variables of the search space and optimize the problem intelligently. This collective behavior of ACPSO will fulfill the task of adaptive selection of swarm members. Simulations were conducted on four types of benchmark suites which contain three state-of-the-art numerical optimization benchmark functions in addition to one new set of active coordinate rotated test functions. The results demonstrate the learning ability of ACPSO in finding correlated variables of the search space and also describe how efficiently it can optimize the coordinate rotated multimodal problems, composition functions and high-dimensional multimodal problems.
Similar content being viewed by others
References
Kennedy J (2006) Swarm intelligence. In: Handbook of nature-inspired and innovative computing, pp 187–219
Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings IEEE international conference on neural networks, 1995. vol 4, pp 1942–1948
Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: Proceedings of the sixth international symposium on micro machine and human science, MHS’95, pp 39–43
Bratton D, Kennedy J (2007) Defining a standard for particle swarm optimization. In: IEEE swarm intelligence symposium, 2007, SIS 2007, pp 120–127
Holland JH (1992) Genetic algorithms. Sci Am 267(1):66–72
Potter M, De Jong K (1994) A cooperative coevolutionary approach to function optimization. In: Parallel problem solving from nature—PPSN III, pp 249–257
van den Bergh F, Engelbrecht AP (2000) Cooperative learning in neural networks using particle swarm optimizers. South Afr Comput J 26:84–90
van den Bergh F, Engelbrecht AP (2004) A cooperative approach to particle swarm optimization. IEEE Trans Evol Comput 8(3):225–239
Narendra KS, Thathachar M (1974) Learning automata: a survey. IEEE Trans Syst Man Cybern 4:323–334
Narendra KS, Thathachar MAL (1989) Learning automata: an introduction. Prentice Hall, New York
Ünsal C (1997) Intelligent navigation of autonomous vehicles in an automated highway system: Learning methods and interacting vehicles approach, Virginia Polytechnic Institute and State University
Beigy H, Meybodi MR (2010) Cellular learning automata with multiple learning automata in each cell and its applications. IEEE Trans Syst Man Cybern, Part B, Cybern 40(1):54–65
Esnaashari M, Meybodi MR (2010) Dynamic point coverage problem in wireless sensor networks: a cellular learning automata approach. J Ad Hoc Sens Wirel Netw 10(2–3):193–234
Hashemi AB, Meybodi MR (2011) A note on the learning automata based algorithms for adaptive parameter selection in PSO. Appl Soft Comput 11(1):689–705
Hashemi A, Meybodi M (2009) Cellular PSO: a PSO for dynamic environments. In: Advances in computation and intelligence, pp 422–433
Thathachar M, Sastry PS (2002) Varieties of learning automata: an overview. IEEE Trans Syst Man Cybern, Part B, Cybern 32(6):711–722
Suganthan PN, Hansen N, Liang JJ, Deb K, Chen Y, Auger A, Tiwari S (2005) Problem definitions and evaluation criteria for the CEC 2005 special session on real-parameter optimization. Nanyang Technol. Univ., Singapore, IIT Kanpur, Kanpur, India, #2005005, May 2005
Liang J, Qin A, Suganthan PN, Baskar S (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans Evol Comput 10(3):281–295
Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3:1157–1182
He S, Wu Q, Saunders J (2009) Group search optimizer: an optimization algorithm inspired by animal searching behavior. IEEE Trans Evol Comput 13(5):973–990
He S, Wu Q, Saunders J (2006) A novel group search optimizer inspired by animal behavioural ecology. In: IEEE Congress on evolutionary computation. CEC 2006, pp 1272–1278
Bellman R (1956) Dynamic programming and Lagrange multipliers. Proc Natl Acad Sci USA 42(10):767
Poli R, Kennedy J, Blackwell T (2007) Particle swarm optimization. An overview. Swarm Intell 1(1):33–57
Lim A, Lin J, Xiao F (2007) Particle swarm optimization and hill climbing for the bandwidth minimization problem. Appl Intell 26(3):175–182
Khan SA, Engelbrecht AP (2012) A fuzzy particle swarm optimization algorithm for computer communication network topology design. Appl Intell 36(1):161–177
Chu CP, Chang YC, Tsai CC (2011) PC 2 PSO: personalized e-course composition based on particle swarm optimization. Appl Intell 34(1):141–154
Wang K, Zheng YJ (2012) A new particle swarm optimization algorithm for fuzzy optimization of armored vehicle scheme design. Appl Intell 37(4):520–526
Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: The 1998 IEEE international conference on evolutionary computation proceedings. IEEE world congress on computational intelligence, 1998, pp 69–73
Zhan ZH, Zhang J, Li Y, Chung HSH (2009) Adaptive particle swarm optimization. IEEE Trans Syst Man Cybern, Part B, Cybern 39(6):1362–1381
Zhu Z, Zhou J, Ji Z, Shi YH (2011) DNA sequence compression using adaptive particle swarm optimization-based memetic algorithm. IEEE Trans Evol Comput 15(5):643–658
Ji, Z, Liao H, Wang Y, Wu QH (2007) A novel intelligent particle optimizer for global optimization of multimodal functions. In: IEEE congress on evolutionary computation. CEC 2007, pp 3272–3275.
Zhan Z-H, Zhang J, Li Y, Shi Y-H (2011) Orthogonal learning particle swarm optimization. IEEE Trans Evol Comput 15(6):832–847
Zhang Q, Leung Y-W (1999) An orthogonal genetic algorithm for multimedia multicast routing. IEEE Trans Evol Comput 3(1):53–62
Norouzzadeh MS, Ahmadzadeh MR, Palhang M (2012) LADPSO: using fuzzy logic to conduct PSO algorithm. Appl Intell 37(2):290–304
Blackwell T, Branke J (2006) Multiswarms, exclusion, and anti-convergence in dynamic environments. IEEE Trans Evol Comput 10(4):459–472
Niu B, Zhu Y, He X, Wu H (2007) MCPSO: a multi-swarm cooperative particle swarm optimizer. Appl Math Comput 185(2):1050–1062
Zhang J, Ding X (2011) A multi-swarm self-adaptive and cooperative particle swarm optimization. Engineering applications of artificial intelligence
Ali YMB (2012) Psychological model of particle swarm optimization based multiple emotions. Appll Intell 36(3):649–663
Ong YS, Keane AJ, Nair PB (2002) Surrogate-assisted coevolutionary search. In: Proceedings of the 9th international conference on neural information processing, ICONIP’02, vol 3, pp 1140–1145
Bäck T, Schwefel HP (1993) An overview of evolutionary algorithms for parameter optimization. Evol Comput 1(1):1–23
Sofge D, De Jong K, Schultz A (2002) A blended population approach to cooperative coevolution for decomposition of complex problems. In: Proceedings of the 2002 Congress on evolutionary computation. CEC’02, vol 1, pp 413–418
Han MF, Liao SH, Chang JY, Lin CT (2012) Dynamic group-based differential evolution using a self-adaptive strategy for global optimization problems. Appl Intell. doi:10.1007/s10489-012-0393-5
Shi Y, Teng H, Li Z (2005) Cooperative co-evolutionary differential evolution for function optimization. In: Advances in natural computation, p 428
Yang Z, Tang K, Yao X (2008) Large scale evolutionary optimization using cooperative coevolution. Inf Sci 178(15):2985–2999
Cuevas E, Sención F, Zaldivar D, Pérez-Cisneros M, Sossa H (2012) A multi-threshold segmentation approach based on Artificial Bee Colony optimization. Appl Intell 37(3):321–336
El-Abd M (2010) A cooperative approach to the artificial bee colony algorithm. In: 2010 IEEE congress on evolutionary computation (CEC), pp 1–5
Esnaashari M, Meybodi MR (2011) A cellular learning automata-based deployment strategy for mobile wireless sensor networks. J Parallel Distrib Comput 71:988–1001
Akbari Torkestani J, Meybodi MR (2011) A cellular learning automata-based algorithm for solving the vertex coloring problem. Expert Syst Appl 38:9237–9247
Misir M, Wauters T, Verbeeck K, Vanden Berghe G (2012) A hyper-heuristic with learning automata for the traveling tournament problem. In: Metaheuristics: intelligent decision making
Noroozi V, Hashemi A, Meybodi M (2011) CellularDE: a cellular based differential evolution for dynamic optimization problems. In: Adaptive and natural computing algorithms, pp 340–349
Vafashoar R, Meybodi MR, Momeni Azandaryani AH (2011) CLA-DE: a hybrid model based on cellular learning automata for numerical optimization. Appl Intell
Cheshmehgaz HR, Haron H, Maybodi MR (2011) Cellular-based population to enhance genetic algorithm for assignment problems. Am J Intell Syst 1(1):1–5
Wallenta C, Kim J, Bentley PJ, Hailes S (2010) Detecting interest cache poisoning in sensor networks using an artificial immune algorithm. Appl Intell 32(1):1–26
Yang XS (2009) Firefly algorithms for multimodal optimization. In: Stochastic algorithms: foundations and applications, pp 169–178
Farahani SM, Abshouri AA, Nasiri B, Meybodi M (2012) Some hybrid models to improve firefly algorithm performance. Int J Artif Intell 8(S12):97–117
Rezvanian A, Meybodi MR (2010) LACAIS: learning automata based cooperative artificial immune system for function optimization. In: 3rd international conference on contemporary computing (IC3 2010), CCIS, 2010, Noida, India. Contemporary computing, vol 94 pp 64–75
Meybodi M, Beigy H (2002) A note on learning automata-based schemes for adaptation of BP parameters. Neurocomputing 48(1):957–974
Rastegar R, Meybodi MR, Badie K (2004) A new discrete binary particle swarm optimization based on learning automata. In: Proceedings international conference on machine learning and applications, 2004, pp 456–462
Jafarpour B, Meybodi M, Shiry S (2007) A hybrid method for optimization (discrete PSO+ CLA). In: International conference on intelligent and advanced systems. ICIAS 2007, pp 55–60. 2007
Sheybani M, Meybodi MR (2007) PSO-LA: a new model for optimization. In: Proceedings of 12th annual CSI computer conference of Iran, pp 1162–1169
Soleimanzadeh R, Farahani BJ, Fathy M (2010) PSO based deployment algorithms in hybrid sensor networks. Int J Comput Sci Netw Secur 10(7):167–171
Hamidi M, Meybodi MR (2008) New learning automata based particle swarm optimization algorithms. In: Iran data mining conference (IDMC), pp 1–15
Hasanzadeh M, Meybodi MR, Shiry S (2011) Improving learning automata based particle swarm: an optimization algorithm. In: 12th IEEE international symposium on computational intelligence and informatics, Budapest
Hasanzadeh M, Meybodi MR, Ebadzadeh MM (2012) A robust heuristic algorithm for cooperative particle swarm optimizer: a learning automata approach. In: 20th Iranian conference on electrical engineering (ICEE), pp 656–661
Wang Y, Cai Z, Zhang Q (2011) Differential evolution with composite trial vector generation strategies and control parameters. IEEE Trans Evol Comput 15(1):55–66
Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82
Acknowledgements
The work is supported by Iran Telecommunication Research Center (ITRC) grant.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hasanzadeh, M., Meybodi, M.R. & Ebadzadeh, M.M. Adaptive cooperative particle swarm optimizer. Appl Intell 39, 397–420 (2013). https://doi.org/10.1007/s10489-012-0420-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-012-0420-6