Autonomous Robots

, Volume 7, Issue 1, pp 41–56

Dynamics of a Classical Conditioning Model

  • Christian Balkenius
  • Jan Morén
Article

Abstract

Classical conditioning is a basic learning mechanism in animals and can be found in almost all organisms. If we want to construct robots with abilities matching those of their biological counterparts, this is one of the learning mechanisms that needs to be implemented first. This article describes a computational model of classical conditioning where the goal of learning is assumed to be the prediction of a temporally discounted reward or punishment based on the current stimulus situation.

The model is well suited for robotic implementation as it models a number of classical conditioning paradigms and learning in the model is guaranteed to converge with arbitrarily complex stimulus sequences. This is an essential feature once the step is taken beyond the simple laboratory experiment with two or three stimuli to the real world where no such limitations exist. It is also demonstrated how the model can be included in a more complex system that includes various forms of sensory pre-processing and how it can handle reinforcement learning, timing of responses and function as an adaptive world model.

classical conditioning reinforcement learning biological models 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Kluwer Academic Publishers 1999

Authors and Affiliations

  • Christian Balkenius
    • 1
  • Jan Morén
    • 1
  1. 1.Lund University Cognitive ScienceLundSweden

Personalised recommendations