Skip to main content

Mutation by imitation in boolean evolution strategies

  • Modifications and Extensions of Evolutionary Algorithms Genetic Operators and Problem Representation
  • Conference paper
  • First Online:
Parallel Problem Solving from Nature — PPSN IV (PPSN 1996)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1141))

Included in the following conference series:

Abstract

Adaptive heuristics have been developed in the Evolution Strategy (ES) frame regarding the mutation of real-valued variables. But these heuristics poorly extend to discrete variables: when the rate or variance of mutation gets too small, mutation has no effect any more. To overcome this problem, we propose two mutation operators, that use the worst individuals of the current population as beacons indicating the limits of the current promising region:

Mutation by differentiation drives individuals away from the beacon individuals. Mutation by imitation inversely assumes that beacon-individuals still contain relevant informations, and aims at moving the indiidual at hand nearer to the beacons. Mutation by imitation produces offspring that share the features of several “parents”; but in contrast with classical crossover, it allows one to control the distance between the offspring and the main parent, by fixing the number of bits to mutate. Mutation by imitation thus permits a tunable exchange of informations among individuals.

Both operators have been implemented in a boolean (Μ + λ) ES framework, and experimented on four problems: the Royal Road problem, a GA-deceptive problem, the combinatorial multiple knapsack optimization problem and the Long Path problem. Comparative validation is presented and discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. T. Bäck and M. Schütz. Evolution strategies for mixed-integer optimization of optical multi-layer systems. In J. R. McDonnell, R. G. Reynolds, and D. B. Fogel, editors, Proceedings of the 4 th Annual Conference on Evolutionary Programming. MIT Press, March 1995.

    Google Scholar 

  2. T. Bäck and H.-P. Schwefel. An overview of evolutionary algorithms for parameter optimization. Evolutionary Computation, 1(1):1–23, 1993.

    Google Scholar 

  3. K.A. DeJong. The Analysis of the Behavior of a Class of Genetic Adaptive Systems. PhD thesis, University of Michigan, Ann Harbor, 1975. Dissertation Abstract International, 36(10), 5140B. (University Microfilms No 76-9381).

    Google Scholar 

  4. D. B. Fogel. An analysis of evolutionary programming. In D. B. Fogel and W. Atmar, editors, Proceedings of the 1 st Annual Conference on Evolutionary Programming, pages 43–51. Evolutionary Programming Society, 1992.

    Google Scholar 

  5. D. B. Fogel. Evolutionary Computation. Toward a New Philosophy of Machine Intelligence. IEEE Press, Piscataway, NJ, 1995.

    Google Scholar 

  6. D.B. Fogel and L.C. Stayton. On the effectiveness of crossover in simulated evolutionary optimization. BioSystems, 32:171–182, 1994.

    Article  PubMed  Google Scholar 

  7. L. J. Fogel, A. J. Owens, and M. J. Walsh. Artificial Intelligence through Simulated Evolution. New York: John Wiley, 1966.

    Google Scholar 

  8. S. Forrest and M. Mitchell. What makes a problem hard for a genetic algorithms: Some anomalous results and their explanation. Machine Learning, pages 285–319, 1993.

    Google Scholar 

  9. D. E. Goldberg. Genetic algorithms in search, optimization and machine learning. Addison Wesley, 1989.

    Google Scholar 

  10. J. Holland. Adaptation in natural and artificial systems. University of Michigan Press, Ann Arbor, 1975.

    Google Scholar 

  11. J. Horn, D.E. Goldberg, and K. Deb. Long path problems. In Y. Davidor, H.-P. Schwefel, and R. Manner, editors, Proceedings of the 3rd Conference on Parallel Problems Solving from Nature, page 149:158. Springer Verlag, 1994.

    Google Scholar 

  12. C. Z. Janikow and Z. Michalewicz. An experimental comparison of binary and floating point representations in genetic algorithms. In R. K. Belew and L. B. Booker, editors, Proceedings of ICGA'91, pages 31–36. Morgan Kaufmann, 1991.

    Google Scholar 

  13. T. Jones. Crossover, macromutation and population-based search. In L. J. Eshelman, editor, Proceedings of ICGA '95, pages 73–80. Morgan Kaufmann, 1995.

    Google Scholar 

  14. S. Khuri, T. Bäck, and J. Heitkötter. The 0/1 multiple knapsack problem and genetic algorithms. In Proceedings of the ACM Symposium of Applied Computation, 1994. (http:Ўw-cgi.cs.cmu.edu ⇋sŞ.cmu.edu⌕ojet⇄-repository).

    Google Scholar 

  15. Y. Kodratoff. Introduction to Machine Learning. Pitman Publishing, London, 1988.

    Google Scholar 

  16. Z. Michalewicz. Genetic Algorithms+Data Structures=Evolution Programs. Springer Verlag, New-York, 1996. 3rd edition.

    Google Scholar 

  17. R.S. Michalski. A theory and methodology of inductive learning. In R.S Michalski, J.G. Carbonell, and T.M. Mitchell, editors, Machine Learning: an artificial intelligence approach, volume 1. Morgan Kaufmann, 1983.

    Google Scholar 

  18. M. Mitchell, S. Forrest, and J.H. Holland. The Royal Road for genetic algorithms: Fitness landscapes and GA performance. In F. J. Varela and P. Bourgine, editors, Proceedings of ECAL-93, pages 245–254. MIT Press, 1993.

    Google Scholar 

  19. M. Mitchell and J.H. Holland. When will a genetic algorithm outperform hill climbing ? In S. Forrest, editor, Proceedings of ICGA '93, pages 647–654. Morgan Kaufmann, 1993.

    Google Scholar 

  20. J. Obalek. Rekombinationsoperatoren für Evolutionsstrategieren. PhD thesis, Universität Dortmund, Fachbereich Informatik, 1994.

    Google Scholar 

  21. C.C. Petersen. Computational experience with variants of the Balas algorithm applied to the selection of R & D projects. Management Science, 13:736–750, 1967.

    Google Scholar 

  22. N. J. Radcliffe. Equivalence class analysis of genetic algorithms. Complex Systems, 5:183–20, 1991.

    Google Scholar 

  23. I. Rechenberg. Evolutionstrategie: Optimierung Technisher Systeme nach Prinzipien des Biologischen Evolution. Fromman-Holzboog Verlag, Stuttgart, 1973.

    Google Scholar 

  24. H.-P. Schwefel. Numerical Optimization of Computer Models. John Wiley & Sons, New-York, 1981. 1995 — 2nd edition.

    Google Scholar 

  25. M. Sebag, C. Ravisé, and M. Schoenauer. Controlling evolution by means of machine learning. In L.J. Fogel, P. J. Angeline, and T. Bäck, editors, Proceedings of the 5 th Annual Conference on Evolutionary Programming. MIT Press, 1996.

    Google Scholar 

  26. M. Sebag and M. Schoenauer. Controlling crossover through inductive learning. In Y. Davidor, H.-P. Schwefel, and R. Manner, editors, Proceedings of the 3rd Conference on Parallel Problems Solving from Nature. Springer-Verlag, LNCS 866, 1994.

    Google Scholar 

  27. D. Whitley. Fundamental principles of deception in genetic search. In G. J. E. Rawlins, editor, Foundations of Genetic Algorithms. Morgan Kaufmann, 1991.

    Google Scholar 

  28. D.H. Wolpert and W.G. Macready. No free lunch theorems for search. Technical report, Santa Fe Institute, 1995.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Hans-Michael Voigt Werner Ebeling Ingo Rechenberg Hans-Paul Schwefel

Rights and permissions

Reprints and permissions

Copyright information

© 1996 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sebag, M., Schoenauer, M. (1996). Mutation by imitation in boolean evolution strategies. In: Voigt, HM., Ebeling, W., Rechenberg, I., Schwefel, HP. (eds) Parallel Problem Solving from Nature — PPSN IV. PPSN 1996. Lecture Notes in Computer Science, vol 1141. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-61723-X_1000

Download citation

  • DOI: https://doi.org/10.1007/3-540-61723-X_1000

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-61723-5

  • Online ISBN: 978-3-540-70668-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics