Abstract
This chapter presents several methods of evolutionary computation and meta-heuristics. Evolutionary computation is a computation technique that mimics the evolutionary mechanism of life to select, deform, and convolute data structures. Because of its high versatility, its applications are found in various fields. Meta-heuristics described in this chapter are considered as representatives of swarm intelligence, such as particle swarm optimization (PSO), artificial bee colony optimization (ABC), ant colony optimization (ACO), firefly algorithms, cuckoo search, etc. A benefit of these methods is global searching as well as local searching. Existence of local minima or saddle points could lead to a locally optimum solution when using gradient methods such as the steepest descent search. By contrast, the methods described in this chapter can escape from such local solutions by means of various kinds of operations. Methods of evolutionary computation and meta-heuristics are used in combination with deep learning to establish a framework of deep neural evolution, which will be described in later chapters.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Parasitized species are almost always fixed for each female cuckoo.
- 2.
Furthermore, a cuckoo chick having just been hatched expels all the eggs of its host. For this reason, a cuckoo chick has a pit in its back to place its host’s egg, clambers up inside the nest and throw the egg out of the nest. This behavior was discovered by Edward Jenner, famous for smallpox vaccination.
- 3.
It corresponds to allele in genotype under GA.
- 4.
David Hilbert (1862–1943): German mathematician. At the second International Congress of Mathematicians (ICM) in Paris in 1900, he made a speech on “problems in mathematics,” where he stressed the importance of 23 unsolved problems and presented a prospect for future creative research through these problems. Some of them continue to be themes for research on mathematics and computer science.
- 5.
Further discussions have been presented, and there is an insistence on the part of some individuals that it is a different method. Refer to https://en.wikipedia.org/wiki/Harmony_search and [12] for details.
References
Civicioglu, P., Besdok, E.: A conceptual comparison of the Cuckoo-search, particle swarm optimization, differential evolution and artificial bee colony algorithms. Artif. Intell. Rev. 39(4), 315–346 (2013)
Deb, K.D., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6(2), 182–197 (2002)
Dorigo, M., Gambardella, L.M.: Ant colonies for the traveling salesman problem. Technical Report IRIDIA/97-12, Universite Libre de Bruxelles, Belgium (1997)
Geem, Z.W., Kim, J.H., Loganathan, G.V.: A new heuristic optimization algorithm: harmony search. Simulation 76(2), 60–68 (2001). Physical Review E 79 (2009)
Ghosh, A., Dehuri, S., Ghosh, S. (eds.): Objective Evolutionary Algorithms for Knowledge Discovery from Databases. Springer, Berlin (2008)
Goldberg, D.E.: Genetic Algorithms in Search, Optimization and Machine Learning. Addison Wesley, Reading (1989)
He, C., Noman, N., Iba, H.: An improved artificial bee colony algorithm with non-separable operator. In: Proceeding of International Conference on Convergence and Hybrid Information Technology, pp. 203–210. Springer, Berlin (2012)
Higashi, N., Iba, H.: Particle swarm optimization with Gaussian mutation. In: Proceedings of IEEE Swarm Intelligence Symposium (SIS03), pp.72–79. IEEE Press, New York (2003)
Iba. H., Noman, N.: New frontiers in evolutionary algorithms: theory and applications. World Scientific, Singapore (2011). ISBN-10:1848166818
Iba, H., Aranha, C.C.: Practical Applications of Evolutionary Computation to Financial Engineering: Robust Techniques for Forecasting, Trading and Hedging. Springer, Berlin (2012)
Iba, H.: Evolutionary Approach to Machine Learning and Deep Neural Networks—Neuro-Evolution and Gene Regulatory Networks. Springer, Berlin (2018). ISBN 978-981-13-0199-5
Iba, H.: AI and SWARM: Evolutionary Approach to Emergent Intelligence. CRC Press, West Palm Beach (2019). ISBN-13: 978-0367136314
Ishibuchi, H., Tsukamoto, N., Nojima, Y.: Evolutionary many-objective optimization: a short review. In: Proceeding of IEEE Congress on Evolutionary Computation, pp. 2419–2426 (2008)
Karaboga, D., Basturk, B.: A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm. J. Glob. Optim. 39, 459–471 (2007)
Karaboga, D., Gorkemli, B., Ozturk, C., Karaboga, N.: A comprehensive survey: artificial bee colony (ABC) algorithm and applications. Artif. Intell. Rev. (2012). https://doi.org/10.1007/s10462-012-9328-0
Kennedy, J., Eberhart, R.C.: Particle swarm optimization. In: Proceedings of IEEE the International Conference on Neural Networks, pp.1942–1948 (1995)
Lipson, H., Pollack, J.B.: Automatic design and manufacture of robotic lifeforms. Nature 406, 974–978 (2000)
Miller, J.F. (ed.): Cartesian Genetic Programming. Springer, Berlin (2011)
Sörensen, K.: Metaheuristics–the metaphor exposed. Int. Trans. Oper. Res. 22(1), 3–18 (2015)
Sörensen, K., Sevaux, M., Glover, F.: A history of metaheuristics. arXiv:1704.00853v1 [cs.AI] 4 Apr 2017, to appear in Mart, R., Pardalos, P., Resende, M., Handbook of Heuristics. Springer, Berlin.
Weyland, D.: A rigorous analysis of the harmony search algorithm—how the research community can be misled by a “novel” methodology. Int. J. Appl. Metaheuristic Comput. 1(2), 50–60 (2010)
Yang, X.: Nature-Inspired Metaheuristic Algorithms, 2nd edn. Luniver Press, Frome (2010)
Yang, X.-S., Deb, S.: 2009 Cuckoo search via Levy flights. In: Proceeding of World Congress on Nature and Biologically Inspired Computing (NaBIC 2009), pp. 210–214. IEEE, New York (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Iba, H. (2020). Evolutionary Computation and Meta-heuristics. In: Iba, H., Noman, N. (eds) Deep Neural Evolution. Natural Computing Series. Springer, Singapore. https://doi.org/10.1007/978-981-15-3685-4_1
Download citation
DOI: https://doi.org/10.1007/978-981-15-3685-4_1
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-3684-7
Online ISBN: 978-981-15-3685-4
eBook Packages: Computer ScienceComputer Science (R0)