Skip to main content

EC-Star: A Massive-Scale, Hub and Spoke, Distributed Genetic Programming System

  • Chapter
  • First Online:
Genetic Programming Theory and Practice X

Part of the book series: Genetic and Evolutionary Computation ((GEVO))

Abstract

We describe a new Genetic Programming systemnamed EC-Star. It is supported by an open infrastructure, commercial-volunteer-client parallelization framework. The framework enables robust and massive-scale evolution and motivates the hub and spoke network topology of EC-Star’s distributed GP model. In this model an Evolution Coordinator occupies the hub and an Evolutionary Engine occupies each spoke. The Evolution Coordinator uses a layered framework to dispatch high performing, partially evaluated candidate solutions for additional fitness-case exposure, genetic mixing, and evolution to its Evolutionary Engines. It operates asynchronously with each Evolutionary Engine and never blocks waiting for results from an Evolutionary Engine.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The compute resource is commercial-volunteer in the sense that it is doing work on behalf of someone else, but is being paid to do it.

References

  • Anderson D (2004) BOINC: a system for public-resource computing and storage. In: Grid Computing, 2004. Proceedings. Fifth IEEE/ACM International Workshop on, pp 4–10, DOI 10.1109/GRID.2004.14

    Google Scholar 

  • Anderson DP, Cobb J, Korpela E, Lebofsky M, Werthimer D (2002) Seti@home: an experiment in public-resource computing. Commun ACM 45(11):56–61, DOI 10.1145/581571.581573, URL http://doi.acm.org/10.1145/581571.581573

  • Goldberg DE (1989) Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, Reading, Mass.

    Google Scholar 

  • Hornby GS (2006) ALPS: the age-layered population structure for reducing the problem of premature convergence. In: Keijzer M, Cattolico M, Arnold D, Babovic V, Blum C, Bosman P, Butz MV, Coello Coello C, Dasgupta D, Ficici SG, Foster J, Hernandez-Aguirre A, Hornby G, Lipson H, McMinn P, Moore J, Raidl G, Rothlauf F, Ryan C, Thierens D (eds) GECCO 2006: Proceedings of the 8th annual conference on Genetic and evolutionary computation, ACM Press, Seattle, Washington, USA, vol 1, pp 815–822, DOI doi:10.1145/1143997.1144142, URL http://www.cs.bham.ac.uk/~wbl/biblio/gecco2006/docs/p815.pdf

  • Hu J, Goodman ED (2002) The hierarchical fair competition (HFC) model for parallel evolutionary algorithms. In: Fogel DB, El-Sharkawi MA, Yao X, Greenwood G, Iba H, Marrow P, Shackleton M (eds) Proceedings of the 2002 Congress on Evolutionary Computation CEC2002, IEEE Press, pp 49–54, URL http://garage.cse.msu.edu/papers/GARAGe02-05-01.pdf

  • Jong KAD, Spears WM, Gordon DF (1993) Using genetic algorithms for concept learning. Machine Learning 13

    Google Scholar 

  • Urbanowicz RJ, Moore JH (2009) Learning classifier systems: A complete introduction, review, and roadmap. Journal of Artificial Evolution and Applications 2009, URL http://www.hindawi.com/journals/jaea/2009/736398.abs.html, article ID 736398

  • Wilson SW (1995) Classifier fitness based on accuracy. Evolutionary Computation 3(2):149–175, URL http://dx.doi.org/10.1162/evco.1995.3.2.149

Download references

Acknowledgements

The authors acknowledge the generous support of the Li Ka Shing Foundation as well as Kaivan Kamali and Hormoz Shahrzad of Genetic Finance and Kalyan Veeramachaneni of MIT.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mark Wagy .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

O’Reilly, UM., Wagy, M., Hodjat, B. (2013). EC-Star: A Massive-Scale, Hub and Spoke, Distributed Genetic Programming System. In: Riolo, R., Vladislavleva, E., Ritchie, M., Moore, J. (eds) Genetic Programming Theory and Practice X. Genetic and Evolutionary Computation. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-6846-2_6

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-6846-2_6

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-6845-5

  • Online ISBN: 978-1-4614-6846-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics