EC-Star: A Massive-Scale, Hub and Spoke, Distributed Genetic Programming System

Part of the Genetic and Evolutionary Computation book series (GEVO)


We describe a new Genetic Programming systemnamed EC-Star. It is supported by an open infrastructure, commercial-volunteer-client parallelization framework. The framework enables robust and massive-scale evolution and motivates the hub and spoke network topology of EC-Star’s distributed GP model. In this model an Evolution Coordinator occupies the hub and an Evolutionary Engine occupies each spoke. The Evolution Coordinator uses a layered framework to dispatch high performing, partially evaluated candidate solutions for additional fitness-case exposure, genetic mixing, and evolution to its Evolutionary Engines. It operates asynchronously with each Evolutionary Engine and never blocks waiting for results from an Evolutionary Engine.

Key words

Genetic programming Cloud-scale Distributed Learning classifier system 



The authors acknowledge the generous support of the Li Ka Shing Foundation as well as Kaivan Kamali and Hormoz Shahrzad of Genetic Finance and Kalyan Veeramachaneni of MIT.


  1. Anderson D (2004) BOINC: a system for public-resource computing and storage. In: Grid Computing, 2004. Proceedings. Fifth IEEE/ACM International Workshop on, pp 4–10, DOI 10.1109/GRID.2004.14Google Scholar
  2. Anderson DP, Cobb J, Korpela E, Lebofsky M, Werthimer D (2002) Seti@home: an experiment in public-resource computing. Commun ACM 45(11):56–61, DOI 10.1145/581571.581573, URL
  3. Goldberg DE (1989) Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, Reading, Mass.Google Scholar
  4. Hornby GS (2006) ALPS: the age-layered population structure for reducing the problem of premature convergence. In: Keijzer M, Cattolico M, Arnold D, Babovic V, Blum C, Bosman P, Butz MV, Coello Coello C, Dasgupta D, Ficici SG, Foster J, Hernandez-Aguirre A, Hornby G, Lipson H, McMinn P, Moore J, Raidl G, Rothlauf F, Ryan C, Thierens D (eds) GECCO 2006: Proceedings of the 8th annual conference on Genetic and evolutionary computation, ACM Press, Seattle, Washington, USA, vol 1, pp 815–822, DOI doi:10.1145/1143997.1144142, URL
  5. Hu J, Goodman ED (2002) The hierarchical fair competition (HFC) model for parallel evolutionary algorithms. In: Fogel DB, El-Sharkawi MA, Yao X, Greenwood G, Iba H, Marrow P, Shackleton M (eds) Proceedings of the 2002 Congress on Evolutionary Computation CEC2002, IEEE Press, pp 49–54, URL
  6. Jong KAD, Spears WM, Gordon DF (1993) Using genetic algorithms for concept learning. Machine Learning 13Google Scholar
  7. Urbanowicz RJ, Moore JH (2009) Learning classifier systems: A complete introduction, review, and roadmap. Journal of Artificial Evolution and Applications 2009, URL, article ID 736398
  8. Wilson SW (1995) Classifier fitness based on accuracy. Evolutionary Computation 3(2):149–175, URL

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  1. 1.Evolutionary Design and Optimization GroupCSAIL, MITMAUSA
  2. 2.Genetic Finance LLCSan FranciscoUSA

Personalised recommendations