Abstract
Most genetic programming systems use hard-coded genetic operators that are applied according to user-specified parameters. Because it is unlikely that the provided operators or the default parameters will be ideal for all problems or all program representations, practitioners often devote considerable energy to experimentation with alternatives. Attempts to bring choices about operators and parameters under evolutionary control, through self-adaptative algorithms or meta-genetic programming, have been explored in the literature and have produced interesting results. However, no systems based on such principles have yet been demonstrated to have greater practical problem-solving power than the more-standard alternatives. This chapter explores the prospects for extending the practical power of genetic programming through the refinement of an approach called autoconstructive evolution, in which the algorithms used for the reproduction and variation of evolving programs are encoded in the programs themselves, and are thereby subject to variation and evolution in tandem with their problem-solving components. We present the motivation for the autoconstructive evolution approach, show how it can be instantiated using the Push programming language, summarize previous results with the Pushpop system, outline the more recent AutoPush system, and chart a course for future work focused on the production of practical systems that can solve hard problems.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Angeline, Peter J. (1995). Adaptive and self-adaptive evolutionary computations. In Palaniswami, Marimuthu and Attikiouzel, Yianni, editors, Computational Intelligence: A Dynamic Systems Perspective, pages 152–163. IEEE Press.
Angeline, Peter J. (1996). Two self-adaptive crossover operators for genetic programming. In Angeline, Peter J. and Kinnear, Jr., K. E., editors, Advances in Genetic Programming 2, chapter 5, pages 89–110. MIT Press, Cambridge, MA, USA.
Barraclough, Timothy G., Birky, C. William Jr., and Burt, Austin (2003). Diversification in sexual and asexual organisms. Evolution, 57:2166–2172.
Beyer, Hans-Georg and Meyer-Nieberg, Silja (2006). Self-adaptation of evolution strategies under noisy fitness evaluations. Genetic Programming and Evolvable Machines, 7(4):295–328.
Diosan, Laura and Oltean, Mihai (2009). Evolutionary design of evolutionary algorithms. Genetic Programming and Evolvable Machines, 10(3):263–306.
Edmonds, Bruce (2001).Meta-genetic programming:Co-evolving the operators of variation. Elektrik, 9(1):13–29. Turkish JournalElectricalEngineering and Computer Sciences.
Eiben, Agoston Endre, Hinterding, Robert, and Michalewicz, Zbigniew (1999). Parameter control in evolutionary algorithms. IEEE Transations on Evolutionary Computation, 3(2):124–141.
Fodor, Jerry and Piattelli-Palmarini, Massimo (2010). What Darwin got wrong. New York: Farrar, Straus and Giroux.
Fontana, Walter (1992). Algorithmic chemistry. In Langton, C. G., Taylor, C., Farmer, J. D., and Rasmussen, S., editors, Artificial Life II, pages 159–210. Addison-Wesley.
Fry, Rodney, Smith, Stephen L., and Tyrrell, Andy M. (2005). A self-adaptive mate selection model for genetic programming. In Proceedings of the 2005 IEEE Congress on Evolutionary Computation, volume 3, pages 2707–2714, Edinburgh, UK. IEEE Press.
Gerhart, John and Kirschner, Marc (2007). The theory of facilitated variation. Proceedings of the National Academy of Sciences, 104:8582–8589.
Kantschik, Wolfgang, Dittrich, Peter, Brameier, Markus, and Banzhaf, Wolfgang (1999). Meta-evolution in graph GP. In Genetic Programming, Proceedings of EuroGP’99, volume 1598 of LNCS, pages 15–28, Goteborg, Sweden. Springer-Verlag.
Koza, JohnR. (1994). Spontaneous emergence of self-replicating and evolutionarily self-improving computer programs. In Langton, Christopher G., editor, Artificial Life III, volume XVII of SFI Studies in the Sciences of Complexity, pages 225–262. Addison-Wesley, Santa Fe, New Mexico, USA.
Langdon, William B. and Poli, Riccardo (2006). On turing complete T7 and MISC F–4 program fitness landscapes. In Arnold, Dirk V., Jansen, Thomas, Vose, Michael D., and Rowe, Jonathan E., editors, Theory of Evolutionary Algorithms, Dagstuhl, Germany. Internationales Begegnungs- und Forschungszentrum fuer Informatik (IBFI), Schloss Dagstuhl, Germany.
Callum,RobertM.Mac (2003). Introducing a perl genetic programming system: and can meta-evolution solve the bloat problem? In Genetic Programming, Proceedings of EuroGP’2003, volume 2610 of LNCS, pages 364–373, Essex. Springer-Verlag.
Maynard Smith, John and Szathmáry, Eörs (1999). The origins of life. Oxford: Oxford University Press.
Nordin, Peter and Banzhaf, Wolfgang (1995). Evolving turing-complete programs for a register machine with self-modifying code. In Genetic Algorithms: Proceedings of the Sixth International Conference (ICGA95), pages 318–325, Pittsburgh, PA, USA. Morgan Kaufmann.
Ofria, Charles and Wilke, Claus O. (2004). Avida: A software platform for research in computational evolutionary biology. Artificial Life, 10(2):191–229.
Poli, Riccardo, Langdon, William B., and McPhee, Nicholas Freitag (2008). A field guide to genetic programming. http://lulu.com and freely available at http://www.gp-field-guide.org.uk. (With contributions by J. R. Koza).
Ray, Thomas S. (1991). Is it alive or is it GA. In Proceedings of the Fourth International Conference on Genetic Algorithms, pages 527–534, University of California - San Diego, La Jolla, CA, USA. Morgan Kaufmann.
Schmidhuber, Jurgen (1987). Evolutionary principles in self-referential learning. on learning now to learn: The meta-meta-meta…-hook. Diploma thesis, Technische Universitat Munchen, Germany.
Schmidhuber, Jurgen (2006). Gödel machines: Fully self-referential optimal universal self-improvers. In Goertzel, B. and Pennachin, C., editors, Artificial General Intelligence, pages 119–226. Springer.
Silva, Sara and Dignum, Stephen (2009). Extending operator equalisation: Fitness based self adaptive length distribution for bloat free GP. In Proceedings of the 12th European Conference on Genetic Programming, EuroGP 2009, volume 5481 of LNCS, pages 159–170, Tuebingen. Springer.
Sipper, Moshe and Reggia, James A. (2001). Go forth and replicate. Scientific American, 265(2):27–35.
Smits, Guido F., Vladislavleva, Ekaterina, and Kotanchek, Mark E. (2010). Scalable symbolic regression by continuous evolution with very small populations. In Riolo, Rick L., McConaghy, Trent, and Vladislavleva, Ekaterina, editors, Genetic Programming Theory and Practice VIII. Springer.
Spears, William M. (1995). Adapting crossover in evolutionary algorithms. In Proceedings of the Fourth Annual Conference on Evolutionary Programming, pages 367–384. MIT Press.
Spector, Lee (2001). Autoconstructive evolution: Push, pushGP, and pushpop. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2001), pages 137–146, San Francisco, California, USA. Morgan Kaufmann.
Spector, Lee (2002). Adaptive populations of endogenously diversifying pushpop organisms are reliably diverse. In Proceedings of Artificial Life VIII, the 8th International Conference on the Simulation and Synthesis of Living Systems, pages 142–145, University of New South Wales, Sydney, NSW, Australia. The MIT Press.
Spector, Lee, Klein, Jon, and Keijzer, Maarten (2005). The push3 execution stack and the evolution of control. In GECCO 2005: Proceedings of the 2005 conference on Genetic and evolutionary computation, volume 2, pages 1689–1696, Washington DC, USA. ACM Press.
Spector, Lee and Robinson, Alan (2002a). Genetic programming and autoconstructive evolution with the push programming language. Genetic Programming and Evolvable Machines, 3(1):7–40.
Spector, Lee and Robinson, Alan (2002b). Multi-type, self-adaptive genetic programming as an agent creation tool. In GECCO 2002: Proceedings of the Bird of a Feather Workshops, Genetic and Evolutionary Computation Conference, pages 73–80, New York. AAAI.
Suzuki, Hideaki (2004). Design Optimization of Artificial Evolutionary Systems. Doctor of informatics, Graduate School of Informatics, Kyoto University, Japan.
Tavares, Jorge, Machado, Penousal, Cardoso, Amilcar, Pereira, Francisco B., and Costa, Ernesto (2004). On the evolution of evolutionary algorithms. In Genetic Programming 7th European Conference, EuroGP 2004, Proceedings, volume 3003 of LNCS, pages 389–398, Coimbra, Portugal. Springer-Verlag.
Taylor, Timothy John (1999). From Artificial Evolution to Artificial Life. PhD thesis, Division of Informatics, University of Edinburgh, UK.
Teller, Astro (1994). Turing completeness in the language of genetic programming with indexedmemory. In Proceedings of the 1994 IEEE World Congress on Computational Intelligence, volume 1, pages 136–141, Orlando, Florida, USA. IEEE Press.
Vafaee, Fatemeh, Xiao,Weimin, Nelson, Peter C., and Zhou, Chi (2008). Adaptively evolving probabilities of genetic operators. In Seventh International Conference onMachine Learning and Applications, ICMLA ’08, pages 292–299, La Jolla, San Diego, USA. IEEE.
Woodward, John (2003). Evolving turing complete representations. In Proceedings of the 2003 Congress on Evolutionary Computation, pages 830–837, Canberra. IEEE Press.
Yabuki, Taro and Iba, Hitoshi (2004). Genetic programming using a Turing complete representation: recurrent network consisting of trees. In de Castro, Leandro N. and Von Zuben, Fernando J., editors, Recent Developments in Biologically Inspired Computing, chapter 4, pages 61–81. Idea Group Publishing.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Spector, L. (2011). Towards Practical Autoconstructive Evolution: Self-Evolution of Problem-Solving Genetic Programming Systems. In: Riolo, R., McConaghy, T., Vladislavleva, E. (eds) Genetic Programming Theory and Practice VIII. Genetic and Evolutionary Computation, vol 8. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-7747-2_2
Download citation
DOI: https://doi.org/10.1007/978-1-4419-7747-2_2
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4419-7746-5
Online ISBN: 978-1-4419-7747-2
eBook Packages: Computer ScienceComputer Science (R0)