Abstract
The paper describes a novel application of Apache Spark in population-based optimization, which facilitates the parallel search for optimal solutions. The model has been tested in solving traveling salesman problem (TSP).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alkafaween, E., Hassanat, A.B.A.: Improving TSP solutions using GA with a new hybrid mutation based on knowledge and randomness. CoRR abs/1801.07233 (2018). http://arxiv.org/abs/1801.07233
Anaya Fuentes, G.E., Hernández Gress, E.S., Seck Tuoh Mora, J.C., Medina Marn, J.: Solution to travelling salesman problem by clusters and a modified multi-restart iterated local search metaheuristic. PLOS ONE 13(8), 1–20 (2018). https://doi.org/10.1371/journal.pone.0201868
Barba-González, C., Garca-Nieto, J., Nebro, A.J., Cordero, J.A., Durillo, J., Navas Delgado, I., Aldana Montes, J.: jMetalSP: a framework for dynamic multi-objective big data optimization. Appl. Soft Comput. 69, 737–748 (2017)
Barbucha, D.: Agent-based guided local search. Expert Syst. Appl. 39(15), 12032–12045 (2012). https://doi.org/10.1016/j.eswa.2012.03.074
Barbucha, D., Czarnowski, I., Jedrzejowicz, P., Ratajczak-Ropel, E., Wierzbowska, I.: Team of A-Teams—A Study of the Cooperation between Program Agents Solving Difficult Optimization Problems, vol. 456, pp. 123–141 (2013)
Caballero-Morales, S.O., Martinez-Flores, J.L., Sanchez-Partida, D.: Dynamic reduction-expansion operator to improve performance of genetic algorithms for the traveling salesman problem. Math. Probl. Eng. 2018, 498–516 (2018). https://doi.org/10.1155/2018/2517460
Chen, J., Cao, Y., Sun, D.: Modeling, optimization, and operation of large-scale air traffic flow management on spark. J. Aerosp. Inf. Syst. 14(9) (2017). https://doi.org/10.2514/1.I010533
Jedrzejowicz, P., Ratajczak-Ropel, E.: Dynamic cooperative interaction strategy for solving RCPSP by a team of agents. In: International Conference on Computational Collective Intelligence, vol. 9875, pp. 454–463 (2016)
Karouani, Y., Elhoussaine, Z.: Efficient spark-based framework for solving the traveling salesman problem using a distributed swarm intelligence method. In: 2018 International Conference on Intelligent Systems and Computer Vision (2018)
Lin, M., Zhong, Y., Lin, J., Lin, X.: Discrete bird swarm algorithm based on information entropy matrix for traveling salesman problem. Math. Probl. Eng. 15 (2018). https://doi.org/10.1155/2018/9461861
Lin, S., Kernighan, B.W.: An effective heuristic algorithm for the traveling-salesman problem. Oper. Res. 21(2), 498–516 (1973). https://doi.org/10.1287/opre.21.2.498
Miryala, G., Ludwig, S.A.: Comparing spark with mapreduce: glowworm swarm optimization applied to multimodal functions. Int. J. Swarm Intell. Res. (IJSIR) 9(3), 1–22 (2018)
Molina, D., Latorre, A., Herrera, F.: An insight into bio-inspired and evolutionary algorithms for global optimization: review, analysis, and lessons learnt over a decade of competitions. In: Cognitive Computation, pp. 1–28 (2018)
Namazi, M., Sanderson, C., Newton, M.A.H., Polash, M.M.A., Sattar, A.: Diversified late acceptance search. In: Mitrovic, T., Xue, B., Li, X. (eds.) AI 2018: Advances in Artificial Intelligence, pp. 299–311. Springer International Publishing, Cham (2018)
Ramírez-Gallego, S., García, S., Benítez, J., Herrera, F.: A distributed evolutionary multivariate discretizer for big data processing on apache spark. Swarm Evol. Comput. 38, 240–250 (2017)
Reinelt, G.: Tsplib. http://www.iwr.uni-heidelberg.de/groups/comopt/software/TSPLIB95/ [Online]. Accessed 14 Jan 2019
Saenphon, T.: Enhancing particle swarm optimization using opposite gradient search for travelling salesman problem. Int. J. Comput. Commun. Eng. 7(4), 167–177 (2018). https://doi.org/10.17706/IJCCE
Wang, Z., Zhao, Y., Liu, Y., Lv, C.: A speculative parallel simulated annealing algorithm based on apache spark. Concurrency Comput. Pract. Experience 30, e4429 (2018)
Xiong, N., Molina, D., Leon, M., Herrera, F.: A walk into metaheuristics for engineering optimization: principles, methods and recent trends. Int. J. Comput. Intell. Syst. 8, 606–636 (2015)
Zhou, A.H., Zhu, L.P., Hu, B., Deng, S., Song, Y., Qiu, H., Pan, S.: Traveling-salesman-problem algorithm based on simulated annealing and gene-expression programming. Information 10, 7 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Jedrzejowicz, P., Wierzbowska, I. (2020). Apache Spark as a Tool for Parallel Population-Based Optimization. In: Czarnowski, I., Howlett, R., Jain, L. (eds) Intelligent Decision Technologies 2019. Smart Innovation, Systems and Technologies, vol 142. Springer, Singapore. https://doi.org/10.1007/978-981-13-8311-3_16
Download citation
DOI: https://doi.org/10.1007/978-981-13-8311-3_16
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-8310-6
Online ISBN: 978-981-13-8311-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)