Skip to main content

Geometric Generalization of the Nelder-Mead Algorithm

  • Conference paper
Evolutionary Computation in Combinatorial Optimization (EvoCOP 2010)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 6022))

Abstract

The Nelder-Mead Algorithm (NMA) is an almost half-century old method for numerical optimization, and it is a close relative of Particle Swarm Optimization (PSO) and Differential Evolution (DE). Geometric Particle Swarm Optimization (GPSO) and Geometric Differential Evolution (GDE) are recently introduced formal generalization of traditional PSO and DE that apply naturally to both continuous and combinatorial spaces. In this paper, we generalize NMA to combinatorial search spaces by naturally extending its geometric interpretation to these spaces, analogously as what was done for the traditional PSO and DE algorithms, obtaining the Geometric Nelder-Mead Algorithm (GNMA).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Kauffman, S.: Origins of order: self-organization and selection in evolution. Oxford University Press, Oxford (1993)

    Google Scholar 

  2. Kennedy, J., Eberhart, R.C.: Swarm Intelligence. Morgan Kaufmann, San Francisco (2001)

    Google Scholar 

  3. Luo, C., Yu, B.: Low dimensional simplex evolution: a hybrid heuristic for global optimization. In: Eighth International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing, vol. 2, pp. 470–474 (2007)

    Google Scholar 

  4. Moraglio, A.: Towards a geometric unification of evolutionary algorithms. PhD thesis, University of Essex (2007)

    Google Scholar 

  5. Moraglio, A., Chio, C.D., Poli, R.: Geometric particle swarm optimization. In: Ebner, M., O’Neill, M., Ekárt, A., Vanneschi, L., Esparcia-Alcázar, A.I. (eds.) EuroGP 2007. LNCS, vol. 4445, pp. 125–136. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  6. Moraglio, A., Chio, C.D., Togelius, J., Poli, R.: Geometric particle swarm optimization. Journal of Artificial Evolution and Applications (2008) Article ID 143624

    Google Scholar 

  7. Moraglio, A., Togelius, J.: Geometric pso for the sudoku puzzle. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 118–125 (2007)

    Google Scholar 

  8. Moraglio, A., Togelius, J.: Geometric differential evolution. In: Proceedings of the 11th Annual conference on Genetic and evolutionary computation, pp. 1705–1712 (2009)

    Google Scholar 

  9. Nelder, J.A., Mead, R.A.: A simplex method for function minimization. Computer Journal 7, 308–313 (1965)

    MATH  Google Scholar 

  10. Pelikan, M.: NK landscape generator and instances provided online

    Google Scholar 

  11. Pelikan, M.: Analysis of estimation of distribution algorithms and genetic algorithms on nk-landscapes. In: Proceedings of the 2008 Genetic and Evolutionary Computation Conference (GECCO 2008), pp. 1033–1040. ACM Press, New York (2008)

    Chapter  Google Scholar 

  12. Price, K.V., Storm, R.M., Lampinen, J.A.: Differential Evolution: A Practical Approach to Global Optimization. Springer, Heidelberg (2005)

    MATH  Google Scholar 

  13. Takahama, T., Sakai, S.: Constrained optimization by applying the α-constrained method to the nonlinear simplex method with mutations. IEEE Transactions on Evolutionary Computation 9(5), 437–451 (2005)

    Article  Google Scholar 

  14. Togelius, J., Nardi, R.D., Moraglio, A.: Geometric pso + gp = particle swarm programming. In: Proceedings of the Congress on Evolutionary Comptutation, CEC (2008)

    Google Scholar 

  15. Wang, F., Qiu, Y.: Empirical study of hybrid particle swarm optimizers with the simplex method operator. In: Proceedings of the 5th International Conference on Intelligent Systems Design and Applications, pp. 308–313 (2005)

    Google Scholar 

  16. Weise, T.: Global Optimization Algorithms - Theory and Application. on-line ebook (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Moraglio, A., Johnson, C.G. (2010). Geometric Generalization of the Nelder-Mead Algorithm. In: Cowling, P., Merz, P. (eds) Evolutionary Computation in Combinatorial Optimization. EvoCOP 2010. Lecture Notes in Computer Science, vol 6022. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12139-5_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-12139-5_17

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-12138-8

  • Online ISBN: 978-3-642-12139-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics