Selection of Behavior in Social Situations Application to the Development of Coordinated Movements
The law of effect is a very simple law which relates the probability of emission of a behavior by a living being to the consequences of the emission of this behavior by this living being in the past. As such, this law models very basic learning. This law can be considered as an experimental fact as far as it has been observed for a whole range of living beings including human beings. In this paper, we first show that this general law can be the result of a selection process such as natural selection. Then, we show that the implementation of this law can lead to the design of adaptive systems which can mimic very closely the way a new-born develops coordinated movements. To sum-up, we show that the ability to learn such coordinated movements and exhibit adaptive behaviors can result from a multi-stage process of selection.
KeywordsNatural Selection Reinforcement Learning Adaptive Behavior Social Situation Adaptive System
Unable to display preview. Download preview PDF.
- 1.E.L. Thorndike. Animal intelligence: An experimental study of the associative process in animals. Psychology Monographs, 2, 1898.Google Scholar
- 2.E.L. Thorndike. Animal Intelligence: Experimental Studies. Mac Millan, 1911.Google Scholar
- 3.J.W. Donahoe and D.C. Palmer. Learning and Complex Behavior. Allyn and bacon, 1994.Google Scholar
- 4.J.E.R. Staddon. Adaptive behavior and learning. Cambridge University Press, 1983.Google Scholar
- 6.J.M. Baldwin. A new factor in evolution. The american naturalist, 30, 1896. reprinted in [15, pp. 59–80].Google Scholar
- 8.D. Parisi and S. Nolfi. The influence of learning on evolution. In , pages 419–428.Google Scholar
- 9.S. Delepoulle. Coopération entre agents adaptatifs; étude de la sélection des comportements sociaux, expérimentations et simulations. PhD thesis, Université de Lille 3, URECA, Villeneuve d’Ascq, October 2000. Thèse de doctorat de Psychologie.Google Scholar
- 11.S. Delepoulle, Ph. Preux, and J-C. Darcheville. Learning as a consequence of selection, 2001. (submitted).Google Scholar
- 12.A.G. Barto. Reinforcement learning and adaptive critic methods. In D.A. White and D.A. Sofge, editors, Handbook of intelligent control: neural, fuzzy, and adaptive approach, pages 469–491. Van Nostrand Reinhold, 1992.Google Scholar
- 13.R.S. Sutton and A.G. Barto. Reinforcement learning: an introduction. MIT Press, 1998.Google Scholar
- 14.Ph. Preux, S. Delepoulle, and J-C. Darcheville. Selection of behaviors by their consequences in the human baby, software agents, and robots. In Proc. Computational Biology, Genome Information Systems and Technology, March 2001.Google Scholar
- 15.M. Mitchell and R. Belew, editors. Adaptive Individuals In Evolving Population Models. Santa Fe Institute Studies in the Sciences of Complexity. Addison-Wesley Publishing Company, 1996.Google Scholar