Skip to main content

Fitness Clouds and Problem Hardness in Genetic Programming

  • Conference paper
Genetic and Evolutionary Computation – GECCO 2004 (GECCO 2004)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 3103))

Included in the following conference series:

Abstract

This paper presents an investigation of genetic programming fitness landscapes. We propose a new indicator of problem hardness for tree-based genetic programming, called negative slope coefficient, based on the concept of fitness cloud. The negative slope coefficient is a predictive measure, i.e. it can be calculated without prior knowledge of the global optima. The fitness cloud is generated via a sampling of individuals obtained with the Metropolis-Hastings method. The reliability of the negative slope coefficient is tested on a set of well known and representative genetic programming benchmarks, comprising the binomial-3 problem, the even parity problem and the artificial ant on the Santa Fe trail.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Altenberg, L.: The evolution of evolvability in genetic programming. In: Kinnear, K. (ed.) Advances in Genetic Programming, pp. 47–74. The MIT Press, Cambridge (1994)

    Google Scholar 

  2. Clergue, M., Collard, P., Tomassini, M., Vanneschi, L.: Fitness distance correlation and problem difficulty for genetic programming. In: Langdon, W.B., et al. (eds.) Proceedings of the genetic and evolutionary computation conference GECCO 2002, pp. 724–732. Morgan Kaufmann, San Francisco (2002)

    Google Scholar 

  3. Daida, J.M., Bertram, R., Stanhope, S., Khoo, J., Chaudhary, S., Chaudhary, O.: What makes a problem GP-hard? analysis of a tunably difficult problem in genetic programming. Genetic Programming and Evolvable Machines 2, 165–191 (2001)

    Article  MATH  Google Scholar 

  4. Deb, K., Goldberg, D.E.: Analyzing deception in trap functions. In: Whitley, D. (ed.) Foundations of Genetic Algorithms, 2, pp. 93–108. Morgan Kaufmann, San Francisco (1993)

    Google Scholar 

  5. Forrest, S., Mitchell, M.: What makes a problem hard for a genetic algorithm? some anomalous results and their explanation. Machine Learning 13, 285–319 (1993)

    Article  Google Scholar 

  6. Goldberg, D.E.: Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley, Boston (1989)

    MATH  Google Scholar 

  7. Grefenstette, J.: Predictive models using fitness distributions of genetic operators. In: Whitley, D., Vose, M. (eds.) Foundations of Genetic Algorithms, 3, pp. 139–161. Morgan Kaufmann, San Francisco (1995)

    Google Scholar 

  8. Horn, J., Goldberg, D.E.: Genetic algorithm difficulty and the modality of the fitness landscapes. In: Whitley, D., Vose, M. (eds.) Foundations of Genetic Algorithms, 3, pp. 243–269. Morgan Kaufmann, San Francisco (1995)

    Google Scholar 

  9. Igel, C., Chellapilla, K.: Fitness distributions: Tools for designing efficient evolutionary computations. In: Spector, L., Langdon, W.B., O’Reilly, U.-M., Angeline, P. (eds.) Advances in Genetic Programming 3, pp. 191–216. The MIT Press, Cambridge (1999)

    Google Scholar 

  10. Jones, T.: Evolutionary Algorithms, Fitness Landscapes and Search. PhD thesis, University of New Mexico, Albuquerque (1995)

    Google Scholar 

  11. Kimura, M.: The Neutral Theory of Molecular Evolution. Cambridge University Press, Cambridge (1983)

    Book  Google Scholar 

  12. Kinnear, K.E.: Fitness landscapes and difficulty in genetic programming. In: Proceedings of the First IEEEConference on Evolutionary Computing, pp. 142–147. IEEE Press, Piscataway (1994)

    Google Scholar 

  13. Koza, J.R.: Genetic Programming. The MIT Press, Cambridge (1992)

    MATH  Google Scholar 

  14. Koza, J.R., Streeter, M.J., Keane, M.A.: Genetic Programming IV: Routine Human- Competitive Machine Intelligence. Kluwer Academic Publishers, Boston (2003)

    MATH  Google Scholar 

  15. Langdon, W.B., Poli, R.: Foundations of Genetic Programming. Springer, Berlin (2002)

    MATH  Google Scholar 

  16. Madras, N.: Lectures on Monte Carlo Methods. American Mathematical Society, Providence, Rhode Island (2002)

    MATH  Google Scholar 

  17. Manderick, B., de Weger, M., Spiessens, P.: The genetic algorithm and the structure of the fitness landscape. In: Belew, R.K., Booker, L.B. (eds.) Proceedings of the Fourth International Conference on Genetic Algorithms, pp. 143–150. Morgan Kaufmann, San Francisco (1991)

    Google Scholar 

  18. Mitchell, M., Forrest, S., Holland, J.: The royal road for genetic algorithms: fitness landscapes and ga performance. In: Varela, F.J., Bourgine, P. (eds.) Toward a Practice of Autonomous Systems, Proceedings of the First European Conference on Artificial Life, pp. 245–254. The MIT Press, Cambridge (1992)

    Google Scholar 

  19. Nikolaev, N.I., Slavov, V.: Concepts of inductive genetic programming. In: Banzhaf, W., Poli, R., Schoenauer, M., Fogarty, T.C. (eds.) EuroGP 1998. LNCS, vol. 1391, pp. 49–59. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  20. Rosé, H., Ebeling, W., Asselmeyer, T.: The density of states - a measure of the difficulty of optimisation problems. In: Ebeling, W., Rechenberg, I., Voigt, H.-M., Schwefel, H.-P. (eds.) PPSN 1996. LNCS, vol. 1141, pp. 208–217. Springer, Heidelberg (1996)

    Chapter  Google Scholar 

  21. Smith, Husbands, Layzell, O’Shea: Fitness landscapes and evolvability. Evolutionary Computation 1(10), 1–34 (2001)

    Google Scholar 

  22. Stadler, P.F.: Fitness landscapes. In: Lässig, M., Valleriani (eds.) Biological Evolution and Statistical Physics. Lecture Notes Physics, vol. 585, pp. 187–207. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  23. Vanneschi, L., Tomassini, M., Clergue, M., Collard, P.: Difficulty of unimodal and multimodal landscapes in genetic programming. In: Cantú-Paz, E., Foster, J.A., Deb, K., Davis, L., Roy, R., O’Reilly, U.-M., Beyer, H.-G., Kendall, G., Wilson, S.W., Harman, M., Wegener, J., Dasgupta, D., Potter, M.A., Schultz, A., Dowsland, K.A., Jonoska, N., Miller, J., Standish, R.K. (eds.) GECCO 2003. LNCS, vol. 2724, pp. 1788–1799. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  24. Vanneschi, L., Tomassini, M., Collard, P., Clergue, M.: Fitness distance correlation in structural mutation genetic programming. In: Ryan, C., Soule, T., Keijzer, M., Tsang, E.P.K., Poli, R., Costa, E. (eds.) EuroGP 2003. LNCS, vol. 2610, pp. 455–464. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  25. Vérel, S., Collard, P., Clergue, M.: Where are bottleneck in nk-fitness landscapes? In: CEC 2003: IEEE International Congress on Evolutionary Computation, Canberra, Australia, pp. 273–280. IEEE Press, Piscataway (2003)

    Chapter  Google Scholar 

  26. Weinberger, E.D.: Correlated and uncorrelated fitness landscapes and howto tell the difference. Biol. Cybern. 63, 325–336 (1990)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Vanneschi, L., Clergue, M., Collard, P., Tomassini, M., Vérel, S. (2004). Fitness Clouds and Problem Hardness in Genetic Programming. In: Deb, K. (eds) Genetic and Evolutionary Computation – GECCO 2004. GECCO 2004. Lecture Notes in Computer Science, vol 3103. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24855-2_76

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24855-2_76

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-22343-6

  • Online ISBN: 978-3-540-24855-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics