Skip to main content
SpringerLink
Log in
Book cover

Genetic Programming Theory and Practice XII pp 149–166Cite as

Analyzing a Decade of Human-Competitive (“HUMIE”) Winners: What Can We Learn?

  • Chapter
  • First Online:

Part of the book series: Genetic and Evolutionary Computation ((GEVO))

Abstract

Techniques in evolutionary computation (EC) have improved significantly over the years, leading to a substantial increase in the complexity of problems that can be solved by EC-based approaches. The HUMIES awards at the Genetic and Evolutionary Computation Conference are designed to recognize work that has not just solved some problem via techniques from evolutionary computation, but has produced a solution that is demonstrably human-competitive. In this chapter, we take a look across the winners of the past 10 years of the HUMIES awards, and analyze them to determine whether there are specific approaches that consistently show up in the HUMIE winners. We believe that this analysis may lead to interesting insights regarding prospects and strategies for producing further human competitive results.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    see sigevo.org

References

  • Azaria Y, Sipper M (2005a) GP-gammon: genetically programming backgammon players. Genet Program Evol Mach 6(3):283–300. doi:10.1007/s10710-005-2990-0 http://www.cs.bgu.ac.il/sipper/papabs/gpgammon.pdf. Accessed 12 Aug 2005

  • Azaria Y, Sipper M (2005b) Using GP-gammon: using genetic programming to evolve backgammon players. In: Keijzer M, Tettamanzi A, Collet P, van Hemert JI, Tomassini M (eds) Proceedings of the 8th European conference on genetic programming. Lecture notes in computer science, vol 3447. Springer, Lausanne, pp 132–142. doi:10.1007/b107383

    Google Scholar 

  • Barnum H, Bernstein HJ, Spector L (2000) Quantum circuits for OR and AND of ORs. J Phys A: Math Gen 33(45):8047–8057. (http://hampshire.edu/lspector/pubs/jpa.pdf)

  • Benbassat A, Sipper M (2010) Evolving lose-checkers players using genetic programming. In: IEEE conference on computational intelligence and game, IT University of Copenhagen, Denmark, pp 30–37. doi:10.1109/ITW.2010.5593376 http://game.itu.dk/cig2010/proceedings/papers/cig10-005-011.pdf

  • Benbassat A, Elyasaf A, Sipper M (2012) More or less? two approaches to evolving game-playing strategies. In: Riolo R, Vladislavleva E, Ritchie MD, Moore JH (eds) Genetic programming theory and practice X, genetic and evolutionary computation. Springer, Ann Arbor, chap 12, pp 171–185 doi:10.1007/978-1-4614-6846-2-12 http://dx.doi.org/10.1007/978-1-4614-6846-2-12

  • Clark DM (2013) Evolution of algebraic terms 1: term to term operation continuity. Int J Algebra Comput 23(05):1175–1205 doi:10.1142/S0218196713500227 http://www.worldscientific.com/doi/abs/10.1142/S0218196713500227, http://www.worldscientific.com/doi/pdf/10.1142/S0218196713500227

    Article  MATH  Google Scholar 

  • Elyasaf A, Hauptman A, Sipper M (2012) Evolutionary design of FreeCell solvers. IEEE Trans Comput Intell AI Games 4:270–281 doi:10.1109/TCIAIG.2012.2210423 http://ieeexplore.ieee.org/xpls/abs-all.jsp?arnumber=6249736

    Article  Google Scholar 

  • Epstein SL (1999) Game playing: the next moves. In: AAAI/IAAI, pp 987–993

    Google Scholar 

  • Forrest S, Nguyen T, Weimer W, Le Goues C (2009) A genetic programming approach to automated software repair. In: Raidl G, Rothlauf F, Squillero G, Drechsler R, Stuetzle T, Birattari M, Congdon CB, Middendorf M, Blum C, Cotta C, Bosman P, Grahl J, Knowles J, Corne D, Beyer HG, Stanley K, Miller JF, van Hemert J, Lenaerts T, Ebner M, Bacardit J, O’Neill M, Di Penta M, Doerr B, Jansen T, Poli R, Alba E (eds) GECCO '09: Proceedings of the 11th annual conference on genetic and evolutionary computation, ACM, Montreal, pp 947–954 doi:10.1145/1569901.1570031 http://citeseerx.ist.psu.edu/viewdoc/summary? doi:10.1.1.147.7 651, best paper

  • Glazer A, Sipper M (2008) Evolving an automatic defect classification tool. In: Giacobini M, Brabazon A, Cagnoni S, Caro GAD, Drechsler R (eds) Applications of evolutionary computing: proceedings of EvoWorkshops 2008. Lecture notes in computer science, vol 4974. Springer, Heidelberg, pp 194–203

    Google Scholar 

  • Hauptman A, Sipper M (2005a) Analyzing the intelligence of a genetically programmed chess player. In: Rothlauf F (ed) Late breaking paper at Genetic and Evolutionary Computation Conference (GECCO'2005), Washington, DC. http://www.cs.bham.ac.uk/wbl/biblio/gecco2005lbp/papers/21-hauptmann.pdf

  • Hauptman A, Sipper M (2005b) GP-endchess: using genetic programming to evolve chess endgame players. In: Keijzer M, Tettamanzi A, Collet P, van Hemert JI, Tomassini M (eds) Proceedings of the 8th European conference on genetic programming. Lecture notes in computer science, vol 3447. Springer, Lausanne, pp 120–131. doi:10.1007/b107383

    Google Scholar 

  • Hauptman A, Sipper M (2007a) Emergence of complex strategies in the evolution of chess endgame players. Adv Complex Syst 10(Suppl 1):35–59

    Google Scholar 

  • Hauptman A, Sipper M (2007b) Evolution of an efficient search algorithm for the mate-in-N problem in chess. In: Ebner M, O’Neill M, Ekárt A, Vanneschi L, Esparcia-Alcázar AI (eds) Proceedings of the 10th European conference on genetic programming. Lecture notes in computer science, vol 4445. Springer, Valencia, pp 78–89. doi:10.1007/978-3-540-71605-1-8

    Google Scholar 

  • Hauptman A, Elyasaf A, Sipper M, Karmon A (2009) GP-rush: using genetic programming to evolve solvers for the Rush Hour puzzle. In: Raidl G, Rothlauf F, Squillero G, Drechsler R, Stuetzle T, Birattari M, Congdon CB, Middendorf M, Blum C, Cotta C, Bosman P, Grahl J, Knowles J, Corne D, Beyer HG, Stanley K, Miller JF, van Hemert J, Lenaerts T, Ebner M, Bacardit J, O’Neill M, Di Penta M, Doerr B, Jansen T, Poli R, Alba E (eds) GECCO '09: Proceedings of the 11th Annual conference on genetic and evolutionary computation, ACM, Montreal, pp 955–962. doi:10.1145/1569901.1570032 http://dl.acm.org/citation.cfm?id=1570032

  • Koza JR (2008) Human-competitive machine invention by means of genetic programming. Artif Intell Eng Des, Anal Manuf 22(3):185–193. doi:10.1017/S0890060408000127

    Google Scholar 

  • Koza JR (2010) Human-Competitive Awards: HUMIES. http://www.human-competitive.org. Accessed 6 May 2014

  • Koza JR, Keane MA, Streeter MJ, Mydlowec W, Yu J, Lanza G (2003) Genetic programming IV: routine human-competitive machine intelligence. Kluwer Academic. http://www.springer.com/us/book/9780387250670

  • Koza JR, Al-Sakran SH, Jones LW (2005) Cross-domain features of runs of genetic programming used to evolve designs for analog circuits, optical lens systems, controllers, antennas, mechanical systems, and quantum computing circuits. In: Evolvable Hardware, 2005. Proceedings. 2005 NASA/DoD Conference on, IEEE, pp 205–212

    Google Scholar 

  • Letham B, Rudin C, McCormick TH, Madigan D (2012) Building interpretable classifiers with rules using bayesian analysis. Department of Statistics Technical Report tr609, University of Washington

    Google Scholar 

  • Rudin C, Waltz D, Anderson RN, Boulanger A, Salleb-Aouissi A, Chow M, Dutta H, Gross P, Huang B, Ierome S, Isaac D, Kressner A, Passonneau RJ, Radeva A, Wu L (2012) Machine learning for the New York City power grid. IEEE Trans Pattern Anal Mach Intell 34(2):328–345

    Article  Google Scholar 

  • Shichel Y, Ziserman E, Sipper M (2005) GP-robocode: using genetic programming to evolve robocode players. In: Keijzer M, Tettamanzi A, Collet P, van Hemert JI, Tomassini M (eds) Proceedings of the 8th European conference on genetic programming. Lecture notes in computer science, vol 3447. Springer, Lausanne, pp 143–154. doi:10.1007/b107383

    Google Scholar 

  • Sipper M (2002) Machine nature: the coming age of bio-inspired computing. McGraw-Hill, New York

    Google Scholar 

  • Sipper M (2006) Attaining human-competitive game playing with genetic programming. In: El Yacoubi S, Chopard B, Bandini S (eds) Proceedings of the 7th international conference on cellular automata, for research and industry, ACRI. Lecture Notes in computer science, vol 4173. Springer, Perpignan, p 13. doi:10.1007/11861201-4, invited Lectures

    Google Scholar 

  • Sipper M (2011) Evolved to Win. Lulu http://www.lulu.com/. Accessed 6 May 2014

  • Sipper M, Azaria Y, Hauptman A, Shichel Y (2007) Designing an evolutionary strategizing machine for game playing and beyond. IEEE Trans Syste, Man Cybern, Part C: Appl Rev 37(4):583–593. doi:10.1109/TSMCC.2007.897326

    Google Scholar 

  • Spector L (2004) Automatic quantum computer programming: a genetic programming approach, genetic programming, vol 7. Kluwer Academic, Boston. http://www.wkap.nl/prod/b/1-4020-7894-3

  • Spector L, Clark DM, Lindsay I, Barr B, Klein J (2008) Genetic programming for finite algebras. In: Keijzer M, Antoniol G, Congdon CB, Deb K, Doerr B, Hansen N, Holmes JH, Hornby GS, Howard D, Kennedy J, Kumar S, Lobo FG, Miller JF, Moore J, Neumann F, Pelikan M, Pollack J, Sastry K, Stanley K, Stoica A, Talbi EG, Wegener I (eds) GECCO '08: Proceedings of the 10th annual conference on genetic and evolutionary computation, ACM, Atlanta, GA, USA, pp 1291–1298. doi:10.1145/1389095.1389343 http://www.cs.bham.ac.uk/wbl/biblio/gecco2008/docs/p1291.pdf

  • Wagstaff K (2012) Machine learning that matters. arXiv preprint arXiv:12064656

    Google Scholar 

  • Wang T, Rudin C, Wagner D, Sevieri R (2013) Detecting patterns of crime with series finder. In: Proceedings of the European conference on machine learning and principles and practice of knowledge discovery in databases (ECMLPKDD 2013)

    Google Scholar 

Download references

Acknowledgments

This material is based upon work supported by the National Science Foundation under Grants No. 1017817, 1129139, and 1331283. Any opinions, findings, and conclusions or recommendations expressed in this publication are those of the authors and do not necessarily reflect the views of the National Science Foundation.

Author information

Authors and Affiliations

  1. School of Computer Science, University of Massachusetts, Amherst, MA, USA

    Karthik Kannappan & Thomas Helmuth

  2. Cognitive Science, Hampshire College, Amherst, MA, 01002-3359, USA

    Lee Spector, Jake Wisdom & Omri Bernstein

  3. Department of Computer Science, Ben-Gurion University, 84105, Beer-Sheva, Israel

    Moshe Sipper

  4. Department of Mechanical and Industrial Engineering, University of Massachusetts, Amherst, MA, USA

    William La Cava

Authors
  1. Karthik Kannappan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lee Spector
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Moshe Sipper
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Thomas Helmuth
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. William La Cava
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jake Wisdom
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Omri Bernstein
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Karthik Kannappan .

Editor information

Editors and Affiliations

  1. Center for the Study of Complex Systems (CSCS), University of Michigan, Ann Arbor, Michigan, USA

    Rick Riolo

  2. Evolution Enterprises, Milan, Michigan, USA

    William P. Worzel

  3. Evolved Analytics, Midland, Michigan, USA

    Mark Kotanchek

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Kannappan, K. et al. (2015). Analyzing a Decade of Human-Competitive (“HUMIE”) Winners: What Can We Learn?. In: Riolo, R., Worzel, W., Kotanchek, M. (eds) Genetic Programming Theory and Practice XII. Genetic and Evolutionary Computation. Springer, Cham. https://doi.org/10.1007/978-3-319-16030-6_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-16030-6_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-16029-0

  • Online ISBN: 978-3-319-16030-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation