Abstract
To resolve the issue of the curse of dimensionality in continuous large-scale optimization problems, the cooperative coevolution divide-and-conquer framework was proposed by dividing the problem into several subcomponents either randomly or based on the interaction between variables, each of which can be optimized separately using metaheuristic suboptimizers. The goal of researchers is to optimize the performance of algorithms in terms of both quality of solution and computational speed, seeing that large-scale optimization can be a computationally expensive process. This work proposes a parallel implementation to the cooperative coevolution framework for solving large-scale global optimization problems using the Graphics Processing Unit (GPU) and CUDA platform. A distributed variant of the cooperative coevolution framework is outlined to expose a degree of parallelism. Features of the GPU parallel technology and CUDA platform such as shared and global memories are used to optimize the subcomponents of the problem in parallel, speeding up the optimization process while attempting to maintain comparable search quality to works in the literature. The CEC 2010 large-scale global optimization benchmark functions are used for conducting experiments and comparing results in terms of improvements in search quality and search efficiency. Results of proposed parallel implementation show that a speedup of up to x13.01 is possible on large-scale global optimization benchmarks using the GPUs.
Similar content being viewed by others
Data Availability
All data generated or analyzed during this study are included in this published article.
References
Bell JE, McMullen PR (2004) Ant colony optimization techniques for the vehicle routing problem. Adv Eng Inform 18(1):41–48
Sama M, D’Ariano A, Corman F, Pacciarelli D (2017) Metaheuristics for efficient aircraft scheduling and re-routing at busy terminal control areas. Transp Res Part C: Emerg Technol 80:485–511
Deng G-F, Lin W-T (2011) Ant colony optimization-based algorithm for airline crew scheduling problem. Expert Syst Appl 38(5):5787–5793
Bellman R (1956) Dynamic programming and Lagrange multipliers. Proc Natl Acad Sci USA 42(10):767
Deb, K., Myburgh, C.: Breaking the billion-variable barrier in real-world optimization using a customized evolutionary algorithm. In: Proceedings of the genetic and evolutionary computation conference 2016, pp. 653–660 (2016)
Hlaing ZCSS, Khine MA (2011) Solving traveling salesman problem by using improved ant colony optimization algorithm. Int J Inform Educ Technol 1(5):404
Wang D, Tan D, Liu L (2018) Particle swarm optimization algorithm: an overview. Soft Comput 22(2):387–408
Molina D, Poyatos J, Del Ser J, García S, Hussain A, Herrera F (2020) Comprehensive taxonomies of nature-and bio-inspired optimization: inspiration versus algorithmic behavior, critical analysis recommendations. Cognit Comput 12(5):897–939
Dorigo M, Maniezzo V, Colorni A (1996) Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern Part B (Cybernetics) 26(1):29–41
Katoch S, Chauhan SS, Kumar V (2021) A review on genetic algorithm: past, present, and future. Multimed Tools Appl 80(5):8091–8126
Storn R, Price K (1997) Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11(4):341–359
Dreo J (2007) Dreaming of Metaheuristics. http://nojhan.free.fr/metah/
Potter MA, De Jong KA (1994) A cooperative coevolutionary approach to function optimization. In: International conference on parallel problem solving from nature, pp. 249–257. Springer
Ma X, Li X, Zhang Q, Tang K, Liang Z, Xie W, Zhu Z (2018) A survey on cooperative co-evolutionary algorithms. IEEE Trans Evolut Comput 23(3):421–441
Jamil M, Yang X-S (2013) A literature survey of benchmark functions for global optimisation problems. Int J Math Model Numer Optim 4(2):150–194
Tang K, Yáo X, Suganthan PN, MacNish C, Chen Y-P, Chen C-M, Yang Z (2007) Benchmark functions for the CEC’2008 special session and competition on large scale global optimization. Nature Inspir Comput Appl Lab, USTC, China 24:1–18
Tang K, Li X, Suganthan PN, Yang Z, Weise T (2009) Benchmark functions for the CEC’2010 special session and competition on large-scale global optimization. Technical report, Nature Inspired Computation and Applications Laboratory
Li X, Tang K, Omidvar MN, Yang Z, Qin K, China H (2013) Benchmark functions for the cec 2013 special session and competition on large-scale global optimization. Gene 7(33):8
Omidvar MN, Li X, Yao X (2010) Cooperative co-evolution with delta grouping for large scale non-separable function optimization. In: IEEE Congress on evolutionary computation, pp. 1–8. IEEE
Chen, W., Weise, T., Yang, Z., Tang, K.: Large-scale global optimization using cooperative coevolution with variable interaction learning. In: International conference on parallel problem solving from nature, pp. 300–309 (2010). Springer
Guan S, Wang Y, Liu H (2017) A new cooperative co-evolution algorithm based on variable grouping and local search for large scale global optimization. J Netw Intell 2(4):339–350
Chen A, Ren Z, Guo W, Liang Y, Feng Z (2022) An efficient adaptive differential grouping algorithm for large-scale black-box optimization. IEEE Trans Evolut Comput
Li J-Y, Zhan Z-H, Tan KC, Zhang J (2022) Dual differential grouping: A more general decomposition method for large-scale optimization. IEEE Trans Cybern
Ma X, Huang Z, Li X, Wang L, Qi Y, Zhu Z (2022) Merged differential grouping for large-scale global optimization. IEEE Trans Evolut Comput
Omidvar MN, Li X, Mei Y, Yao X (2013) Cooperative co-evolution with differential grouping for large scale optimization. IEEE Trans Evolut Comput 18(3):378–393
Vakhnin A, Sopov E (2021) Investigation of improved cooperative coevolution for large-scale global optimization problems. Algorithms 14(5):146
El-Abd M (2022) Hybrid cooperative co-evolution for large scale optimization. In: 2014 IEEE symposium on swarm intelligence, pp. 1–6 (2014). IEEE
Yang Z, Tang K, Yao X (2008) Self-adaptive differential evolution with neighborhood search. In: 2008 IEEE congress on evolutionary computation (IEEE World Congress on Computational Intelligence), pp. 1110–1116. IEEE
NVIDIA Vingelmann P, Fitzek FHP CUDA, (2020) release: 10.2.89. https://developer.nvidia.com/cuda-toolkit
Zaharia M, Chowdhury M, Franklin MJ, Shenker S, Stoica I (2010) Spark: cluster computing with working sets. HotCloud 10(10–10):95
Tan X, Lee H, Shin S-Y (2021) Cooperative coevolution differential evolution based on spark for large-scale optimization problems. J Inform Commun Converg Eng 19(3):155–160
Wang S, Gao B, Wang K, Lauw H (2011) Ccrank: Parallel learning to rank with cooperative coevolution. In: Proceedings of the AAAI conference on artificial intelligence, vol. 25
Danoy G, Schleich J, Bouvry P, Dorronsoro B (2014) A parallel multi-objective cooperative coevolutionary algorithm for optimising small-world properties in vanets. CLEI Electr J 17(1):2–2
Cao B, Li W, Zhao J, Yang S, Kang X, Ling Y, Lv Z (2016) Spark-based parallel cooperative co-evolution particle swarm optimization algorithm. In: 2016 IEEE international conference on web services (ICWS), pp. 570–577. IEEE
Yang Z, Tang K, Yao X (2008) Large scale evolutionary optimization using cooperative coevolution. Information sciences 178(15):2985–2999
Yang Z, Tang K, Yao X (2008) Multilevel cooperative coevolution for large scale optimization. In: 2008 IEEE congress on evolutionary computation (IEEE World Congress on Computational Intelligence), pp. 1663–1670. IEEE
De Falco I, Cioppa AD, Trunfio GA (2017) Large scale optimization of computationally expensive functions: an approach based on parallel cooperative coevolution and fitness metamodeling. In:Proceedings of the Genetic and Evolutionary Computation Conference Companion, pp. 1788–1795
Cao B, Zhao J, Yang P, Lv Z, Liu X, Kang X, Yang S, Kang K, Anvari-Moghaddam A (2018) Distributed parallel cooperative coevolutionary multi-objective large-scale immune algorithm for deployment of wireless sensor networks. Future Gener Comput Syst 82:256–267
Atashpendar A, Dorronsoro B, Danoy G, Bouvry P (2018) A scalable parallel cooperative coevolutionary PSO algorithm for multi-objective optimization. J Parall Distrib Comput 112:111–125
Zitzler E, Deb K, Thiele L (2000) Comparison of multiobjective evolutionary algorithms: empirical results. Evolut Comput 8(2):173–195
Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multiobjective genetic algorithm: Nsga-ii. IEEE Trans Evolut Comput 6(2):182–197
Zitzler E, Laumanns M, Thiele L(2001) Spea2: Improving the strength pareto evolutionary algorithm. TIK-report 103
Nebro AJ, Durillo JJ, Luna F, Dorronsoro B, Alba E (2009) Mocell: a cellular genetic algorithm for multiobjective optimization. Int J Intell Syst 24(7):726–746
Yang P, Tang K, Yao X (2019) A parallel divide-and-conquer-based evolutionary algorithm for large-scale optimization. IEEE Access 7:163105–163118
He Z, Peng H, Chen J, Deng C, Wu Z (2021) A spark-based differential evolution with grouping topology model for large-scale global optimization. Clust Comput 24:515–535
Fabris F, Krohling RA (2012) A co-evolutionary differential evolution algorithm for solving min-max optimization problems implemented on GPU using C-CUDA. Expert Syst Appl 39(12):10324–10333
Blecic I, Cecchini A, Trunfio GA (2014) Fast and accurate optimization of a GPU-accelerated CA urban model through cooperative coevolutionary particle swarms. Proc Comput Sci 29:1631–1643
Liu Z-H, Li X-H, Wu L-H, Zhou S-W, Liu K (2015) GPU-accelerated parallel coevolutionary algorithm for parameters identification and temperature monitoring in permanent magnet synchronous machines. IEEE Trans Ind Inform 11(5):1220–1230
de Oliveira FB, Enayatifar R, Sadaei HJ, Guimarães FG, Potvin J-Y (2016) A cooperative coevolutionary algorithm for the multi-depot vehicle routing problem. Expert Syst Appl 43:117–130
Lü R, Guan X, Li X, Hwang I (2016) A large-scale flight multi-objective assignment approach based on multi-island parallel evolution algorithm with cooperative coevolutionary. Sci China Inform Sci 59(7):1–17
Jia Y-H, Chen W-N, Gu T, Zhang H, Yuan H-Q, Kwong S, Zhang J (2018) Distributed cooperative co-evolution with adaptive computing resource allocation for large scale optimization. IEEE Trans Evolut Comput 23(2):188–202
Jarray R, Al-Dhaifallah M, Rezk H, Bouallègue S (2022) Parallel cooperative coevolutionary grey wolf optimizer for path planning problem of unmanned aerial vehicles. Sensors 22(5):1826
Chen W-N, Jia Y-H, Zhao F, Luo X-N, Jia X-D, Zhang J (2019) A cooperative co-evolutionary approach to large-scale multisource water distribution network optimization. IEEE Trans Evolut Comput 23(5):842–857
Gong Y-J, Chen W-N, Zhan Z-H, Zhang J, Li Y, Zhang Q, Li J-J (2015) Distributed evolutionary algorithms and their models: a survey of the state-of-the-art. Appl Soft Comput 34:286–300
Dubreuil M, Gagné C, Parizeau M (2006) Analysis of a master-slave architecture for distributed evolutionary computations. IEEE Trans Syst Man Cybern Part B (Cybern) 36(1):229–235
Gong Y, Fukunaga A (2011) Distributed island-model genetic algorithms using heterogeneous parameter settings. In: 2011 IEEE congress of evolutionary computation (CEC), pp. 820–827. IEEE
Giacobini M, Tomassini M, Tettamanzi AG, Alba E (2005) Selection intensity in cellular evolutionary algorithms for regular lattices. IEEE Trans Evolut Comput 9(5):489–505
Tan KC, Yang Y, Goh CK (2006) A distributed cooperative coevolutionary algorithm for multiobjective optimization. IEEE Trans Evolut Comput 10(5):527–549
Lobel I, Ozdaglar A, Feijer D (2011) Distributed multi-agent optimization with state-dependent communication. Math Program 129(2):255–284
Chen Q, Sun J, Palade V (2019) Distributed contribution-based quantum-behaved particle swarm optimization with controlled diversity for large-scale global optimization problems. IEEE Access 7:150093–150104
Li L, Fang W, Mei Y, Wang Q (2021) Cooperative coevolution for large-scale global optimization based on fuzzy decomposition. Soft Comput 25(5):3593–3608
Yang Z, Tang K, Yao X (2007) Differential evolution for high-dimensional function optimization. In: 2007 IEEE congress on evolutionary computation, pp. 3523–3530. IEEE
Lastra M, Molina D, Benítez JM (2015) A high performance memetic algorithm for extremely high-dimensional problems. Inform Sci 293:35–58
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Kelkawi, A., El-Abd, M. & Ahmad, I. GPU-based cooperative coevolution for large-scale global optimization. Neural Comput & Applic 35, 4621–4642 (2023). https://doi.org/10.1007/s00521-022-07931-w
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-022-07931-w