Advertisement

A Statistical Link between Learning and Evolution

  • Brendan Kitts

Abstract

Widely replicated experimental findings show that faced with multiple variable reward outcomes, animals sample each proportional to their mean payoff. This finding is explained computationally using the Holland theorem, in which this style of sampling is optimal given certain assumptions about the distribution. Other adaptive phenomena which seem to be consistent with this law are discussed, and it is suggested that the ‘adaptive problem’ may be broadly similar across different domains.

Keywords

Expected Loss Slot Machine Bandit Problem Adaptive Problem Adaptive Phenomenon 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    Baum, W. (1979), “Matching, undermatching, and overmatching in studies of choice”, Journal of the Experimental Analysis of Behavior, Vol. 32, No. 2, pp. 269–281.PubMedCrossRefGoogle Scholar
  2. [2]
    Grossberg, S. (1976), “On the Development of Feature Detectors in the Visual Cortex with Applications to Learning and Reaction-Diffusion Systems”, Biological Cybernetics, Vol. 21, pp. 145–159.PubMedCrossRefGoogle Scholar
  3. [3]
    Herrnstein, R. (1958), “Some factors influencing behavior in a two-response situation”, Transactions of the New York Academy of Science, Vol. 21, pp. 35–45.CrossRefGoogle Scholar
  4. [4]
    Holland, J. (1992), Adaptation in Natural and Artificial Systems, University of Michigan Press, Ann-Arbor.Google Scholar
  5. [5]
    Levy, W. and Desmond, N. (1985), “The Rules of Elemental Synaptic Plasticity”, from Levy, W., Anderson, J. and Lehmkuhle, S. (eds), Synaptic Modification, Neuron Selectivity, and Nervous System Organisation, Lawrence Erlbaum Associates.Google Scholar
  6. [6]
    Thompson, R. (1993), The Brain, W.H.Freeman and Co., New York.Google Scholar

Copyright information

© Springer Science+Business Media New York 1997

Authors and Affiliations

  • Brendan Kitts
    • 1
  1. 1.Center for Complex SystemsBrandeis UniversityWalthamUSA

Personalised recommendations