Skip to main content

Bootstrapping Aggregate Fitness Selection with Evolutionary Multi-Objective Optimization

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNTCS,volume 7492)

Abstract

Aggregate fitness selection is known to suffer from the bootstrap problem, which is often viewed as the main inhibitor of the widespread application of aggregate fitness selection in evolutionary robotics. There remains a need to identify methods that overcome it, while requiring the minimum amount of a priori task knowledge from the designer.

We suggest a novel two-phase method. In the first phase, it exploits multi objective optimization to develop a population of controllers that exhibit several desirable behaviors. In the second phase, it applies aggregate selection using the previously obtained population as the seed. The method is assessed by two non-traditional comparison procedures. The proposed approach is demonstrated using simulated coevolution of two robotic soccer players. The multi objective phase is based on adaptation of the well-known NSGA-II algorithm for coevolution. The results demonstrate the potential advantage of the suggested two-phase approach over the conventional one.

Keywords

  • Pareto Front
  • Objective Combination
  • Desirable Behavior
  • Evolutionary Robotic
  • Evolutionary Multi Objective Optimization

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Nelson, A.L., Barlow, G.J., Doitsidis, L.: Fitness functions in evolutionary robotics: A survey and analysis. Robotics and Autonomous Systems 57, 345–370 (2009)

    CrossRef  Google Scholar 

  2. Mouret, J.B., Doncieux, S.: Overcoming the bootstrap problem in evolutionary robotics using behavioral diversity. In: 2009 IEEE Congress on Evolutionary Computation, CEC 2009, pp. 1161–1168 (2009)

    Google Scholar 

  3. Nelson, A.L., Grant, E.: Using direct competition to select for competent controllers in evolutionary robotics. Robotics and Autonomous Systems 54, 840–857 (2006)

    CrossRef  Google Scholar 

  4. Mouret, J.B., Doncieux, S.: Incremental evolution of animats’ behaviors as a multi-objective optimization. From Animals to Animats 10, 210–219 (2008)

    CrossRef  Google Scholar 

  5. Nolfi, S.: Evolutionary robotics: Exploiting the full power of self-organization. Connect. Sci. 10, 167–184 (1998)

    CrossRef  Google Scholar 

  6. Knowles, J.D., Watson, R.A., Corne, D.W.: Reducing Local Optima in Single-Objective Problems by Multi-objectivization. In: Zitzler, E., Deb, K., Thiele, L., Coello Coello, C.A., Corne, D.W. (eds.) EMO 2001. LNCS, vol. 1993, pp. 269–283. Springer, Heidelberg (2001)

    CrossRef  Google Scholar 

  7. Moshaiov, A., Ashram, A.: Multi-objective evolution of robot neuro-controllers. In: 2009 IEEE Congress on Evolutionary Computation, CEC 2009, pp. 1093–1100 (2009)

    Google Scholar 

  8. Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6, 182–197 (2002)

    CrossRef  Google Scholar 

  9. Østergaard, E.H., Hautop Lund, H.: Co-evolving Complex Robot Behavior. In: Tyrrell, A.M., Haddow, P.C., Torresen, J. (eds.) ICES 2003. LNCS, vol. 2606, pp. 308–319. Springer, Heidelberg (2003)

    CrossRef  Google Scholar 

  10. Durillo, J.J., Nebro, A.J., Alba, E.: The jmetal framework for multi-objective optimization: Design and architecture. In: 2010 IEEE Congress on Evolutionary Computation, CEC 2010, pp. 1–8 (2010)

    Google Scholar 

  11. Nolfi, S., Floreano, D.: Coevolving Predator and Prey Robots: Do “Arms Races” Arise in Artificial Evolution? Artif. Life 4, 311–335 (1998)

    CrossRef  Google Scholar 

  12. Stanley, K.O., Miikkulainen, R.: The dominance tournament method of monitoring progress in coevolution. In: GECCO 2002, pp. 242–248 (2002)

    Google Scholar 

  13. Miconi, T.: Why Coevolution Doesn’t “Work”: Superiority and Progress in Coevolution. In: Vanneschi, L., Gustafson, S., Moraglio, A., De Falco, I., Ebner, M. (eds.) EuroGP 2009. LNCS, vol. 5481, pp. 49–60. Springer, Heidelberg (2009)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Israel, S., Moshaiov, A. (2012). Bootstrapping Aggregate Fitness Selection with Evolutionary Multi-Objective Optimization. In: Coello, C.A.C., Cutello, V., Deb, K., Forrest, S., Nicosia, G., Pavone, M. (eds) Parallel Problem Solving from Nature - PPSN XII. PPSN 2012. Lecture Notes in Computer Science, vol 7492. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32964-7_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-32964-7_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-32963-0

  • Online ISBN: 978-3-642-32964-7

  • eBook Packages: Computer ScienceComputer Science (R0)