Integrating Feature Selection into Program Learning

  • Ben Goertzel
  • Nil Geisweiller
  • Cassio Pennachin
  • Kaoru Ng
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7999)


In typical practical applications of automated program learning, the scope of potential inputs to the programs being learned are narrowed down during a preliminary “feature selection“ step. However, this approach will not work if one wishes to apply program learning as a key component of an AGI system, because there is no generally applicable feature selection heuristic, and in an AGI context one cannot assume a human cleverly tuning the feature selection heuristics to the problem at hand. A novel technique, LIFES (Learning-Integrated Feature Selection), is introduced here, to address this problem. In LIFES, one integrates feature selection into the learning process, rather than doing feature selection solely as a preliminary stage to learning. LIFES is applicable relatively broadly, and is especially appropriate for any learning problem possessing properties identified here as “data focusable“ and “feature focusable. It is also applicable with a wide variety of learning algorithms, but for concreteness is presented here in the context of the MOSES automated program learning algorithm. To illustrate the general effectiveness of LIFES, example results are given from applying MOSES+LIFES to gene expression classification. Application of LIFES to virtual and robotic agent control is also discussed.


Feature Selection Learning Algorithm Chronic Fatigue Syndrome Deep Learning Program Learning 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Goertzel, B.: Perception processing for general intelligence: Bridging the symbolic/Subsymbolic gap. In: Bach, J., Goertzel, B., Iklé, M. (eds.) AGI 2012. LNCS, vol. 7716, pp. 79–88. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  2. 2.
    Hawkins, J., Blakeslee, S.: On Intelligence. Brown Walker (2006)Google Scholar
  3. 3.
    Arel, I., Rose, D., Coop, R.: Destin: A scalable deep learning architecture with application to high-dimensional robust pattern recognition. In: Proc. AAAI Workshop on Biologically Inspired Cognitive Architectures (2009)Google Scholar
  4. 4.
    Looks, M.: Competent Program Evolution. PhD Thesis, Computer Science Department, Washington University (2006)Google Scholar
  5. 5.
    Goertzel, B., Pennachin, C., et al.: An integrative methodology for teaching embodied non-linguistic agents, applied to virtual animals in second life. In: Proc. of the First Conf. on AGI. IOS Press (2008)Google Scholar
  6. 6.
    Looks, M., Goertzel, B.: Program representation for general intelligence. In: Proc. of AGI 2009 (2009)Google Scholar
  7. 7.
    Looks, M.: Scalable estimation-of-distribution program evolution. In: Genetic and Evolutionary Computation Conference (2007)Google Scholar
  8. 8.
    Goertzel, B., et al.: The cogprime architecture for embodied artificial general intelligence. In: Proceedings of IEEE Symposium on Human-Level AI, Singapore (2013)Google Scholar
  9. 9.
    Reiman, E.M., et al.: Gab2 alleles modify alzheimer’s risk in apoe e4 carriers. Neuron 54(5) (2007)Google Scholar
  10. 10.
    Coelho, L., Goertzel, B., Pennachin, C., Heward, C.: Classifier ensemble based analysis of a genome-wide snp dataset concerning late-onset alzheimer disease. In: Proceedings of 8th IEEE International Conference on Cognitive Informatics (2009)Google Scholar
  11. 11.
    Goertzel, B., Coelho, L., Pennachin, C., Mudada, M.: Identifying Complex Biological Interactions based on Categorical Gene Expression Data. In: Proceedings of Conference on Evolutionary Computing, Vancouver, CA (2006)Google Scholar
  12. 12.
    Goertzel, B., et al.: Combinations of single nucleotide polymorphisms in neuroendocrine effector and receptor genes predict chronic fatigue syndrome. Pharmacogenomics (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Ben Goertzel
    • 1
    • 2
  • Nil Geisweiller
    • 1
  • Cassio Pennachin
    • 1
  • Kaoru Ng
    • 2
  1. 1.Novamente LLCUSA
  2. 2.Biomind LLCUSA

Personalised recommendations