Cooperative particle swarm optimization using MapReduce
- 333 Downloads
Cooperative particle swarm optimization (short in CPSO) is an effective evolutionary algorithm for optimization and has attracted a lot of research attention. As real-world optimization problems become complex and large scale, population-based optimization algorithms may take a long time to complete a task. Responding to this trend, CPSO, as a serial evolutionary algorithm, also needs to be updated and accelerated. On the other hand, MapReduce is a programming model for parallel computation and accelerates many tasks successfully. In this paper, we present MapReduce cooperative particle swarm optimization (short in MRCPSO) which implements CPSO-S, a version of CPSO, using MapReduce model. MRCPSO is compared with the original CPSO-S and two algorithms in CEC 2013 special session and competition on real-parameter single-objective optimization. The result on benchmarks shows that MRCPSO outperforms the original CPSO-S significantly on both time and the quality of solution. And in the comparisons with the other two algorithms, MRCPSO has better performance on several problems, while the advantage on time is significant.
KeywordsLarge-scale Parallel and distributed computing MapReduce PSO
This work was supported by the National Natural Science Foundation of China (Nos. 61272279, 61272282, 61371201 and 61203303), the National Basic Research Program (973 Program) of China (No. 2013CB329402), the Program for Cheung Kong Scholars and Innovative Research Team in University (No. IRT_15R53) and the Fund for Foreign Scholars in University Research and Teaching Programs (the 111 Project) (No. B07048).
Compliance with ethical standards
Conflict of interest
Yangyang Li, Zhenghan Chen, Yang Wang and Licheng Jiao declare that they no conflict of interest.
This article does not contain any studies with human participants or animals performed by any of the authors.
Informed consent was obtained from all individual participants included in the study.
- Chang-tian, Y, Jiong Y (2012) Energy-aware genetic algorithms for task scheduling in cloud computing. In: Proceedings of seventh ChinaGrid annual conference, pp 43–48Google Scholar
- Decraene J, Cheng YY, Low MYH, Zhou S, Cai W, Choo CS (2010) Evolving agent-based simulations in the clouds. In: Third international workshop on advanced computational intelligence, pp 244–249Google Scholar
- Garcia-Arenas M, Merelo JJ, Castillo P, Laredo JLJ, Romero G, Mora AM (2011) Using free cloud storage services for distributed evolutionary algorithms. In: Proceedings of the 13th annual conference on genetic and evolutionary computation (GECCO), pp 1603–1610Google Scholar
- Garcia-Arenas M, Merelo J-J, Mora AM, Castillo P, Romero G, Laredo JLJ (2011) Assessing speed-ups in commodity cloud storage services for distributed evolutionary algorithms. In: IEEE congress on evolutionary computation (CEC), pp 304–311Google Scholar
- Jindarak K, Uthayopas P (2011) Performance improvement of cloud storage using a genetic algorithm based placement. In: Proceedings of eighth international joint conference on computer science and software engineering, pp 54–57Google Scholar
- Jin C, Vecchiola C, Buyya R (2008) MRPGA: an extension of mapreduce for parallelizing genetic algorithms. In: IEEE fourth international conference on escience, pp 214–221Google Scholar
- Kaur S, Verma A (2012) An efficient approach to genetic algorithm for task scheduling in cloud computing environment. Int J Inf Technol Comput Sci 4(10):74–79Google Scholar
- Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Network, pp 1942–1948Google Scholar
- Kessaci Y, Melab N, Talbi E (2011) A Pareto-based GA for scheduling HPC applications on distributed cloud infrastructures. In: Proceedings of international conference on high performance computing and simulation, pp 456 – 462Google Scholar
- Liang JJ, Qu BY, Suganthan PN, Hernández-Díaz Alfredo G (January 2013) Problem definitions and evaluation criteria for the CEC 2013 special session on real-parameter optimization. Technical Report 201212, Computational Intelligence Laboratory, Zhengzhou University, Zhengzhou China And Technical Report, Nanyang Technological University, SingaporeGoogle Scholar
- Llora X, Verma A, Campbell RH, Goldberg DE (2010) When huge is routine: scaling genetic algorithms and estimation of distribution algorithms via data-intensive computing. In: Fernández de Vega F, Cantú-Paz E (ed) Parallel and distributed computational intelligence. Springer, Berlin, pp 11–41Google Scholar
- Loshchilov I (2013) CMA-ES with restarts for solving CEC 2013 benchmark problems. In: IEEE congress on evolutionary computation, pp 369–376Google Scholar
- Mocanu EM, Florea M, Andreica MI, Ţăpuş N (2012) Cloud computing-task scheduling based on genetic algorithms. In: Proceedings of IEEE international systems conference, pp 1–6Google Scholar
- McNabb AW, Monson CK, Seppi KD (2007) Parallel PSO using mapreduce. In: IEEE congress on evolutionary computation (CEC), pp 7–14Google Scholar
- Potter AM, De Jong KA (1994) A Cooperative co-evolutionary approach to function optimization. In: Proceedings of the third international conference on parallel problem solving from nature. Springer, pp 249–257Google Scholar
- Ren Y, Shen J, Wang J, Han J, Lee S (2015) Mutual verifiable provable data auditing in public cloud storage. J Internet Technol 16(2):317–323Google Scholar
- Roy G, Lee H, Welch JL, Zhao Y, Pandey V, Thurston D (2009) A distributed pool architecture for genetic algorithms. In: IEEE congress on evolutionary computation (CEC), pp 1177–1184Google Scholar
- Rueda JL, Erlich I (2013) Hybrid mean-variance mapping optimization for solving the IEEE-CEC 2013 competition problems. In: IEEE congress on evolutionary computation, pp 1664–1671Google Scholar
- Shi Y, Eberhart R (1998) A modified particle swarm optimizer. In: IEEE international conference on evolutionary computation, Anchorage, Alaska, May 4–9, pp 1945–1950Google Scholar
- Tagawa K, Ishimizu T (2010) Concurrent differential evolution based on MapReduce. Int J Comput 4(4):161–168Google Scholar
- Verma A, Llora X, Goldberg DE, Campbell RH (2009) Scaling genetic algorithms using mapreduce. In: Ninth international conference on intelligent systems design and applications, pp 13–18Google Scholar
- Wickramasinghe W, van Steen M, Eiben A (2007) Peer-to-peer evolutionary algorithms with adaptive autonomous selection. In: Proceedings of the 9th annual conference on genetic and evolutionary computation (GECCO), pp 1460–1467Google Scholar
- Wu B, Wu G, Yang M (2012) A mapreduce based ant colony optimization approach to combinatorial optimization problems. In: International conference on natural computation (ICNC), pp 728–732Google Scholar
- Xiong Z, Zhang Z, Kong H, Zou D (2011) Genetic algorithm-based power management in cloud platform. In: Proceedings of international conference on internet technology and applications, pp 1–4Google Scholar
- Yusoh M, Izzah Z, Maolin T (2012) Clustering composite SaaS components in cloud computing using a grouping genetic algorithm. In: IEEE congress on evolutionary computation, pp 1–8Google Scholar
- Zhangjie F, Xingming S, Qi L, Lu Z, Jiangang S (2015) Achieving efficient cloud search services: multi-keyword ranked search over encrypted cloud data supporting parallel computing. IEICE Trans Commun E98–B(1):190–200Google Scholar
- Zheng Z, Wang R, Zhong H, Zhang X (2011) An approach for cloud resource scheduling based on parallel genetic algorithm. In: Proceedings of 3rd international conference on computer research and development, vol. 2, pp 444–447Google Scholar
- Zhou C (2010) Fast parallelization of differential evolution algorithm using MapReduce. In: Proceedings of the 12th annual conference on genetic and evolutionary computation (GECCO), pp 1113–1114Google Scholar