Skip to main content

Formalisation and Analysis of the Temporal Dynamics of Conditioning

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNPSE,volume 3950)

Abstract

In order to create adaptive Agent Systems with abilities matching those of their biological counterparts, a natural approach is to incorporate classical conditioning mechanisms into such systems. However, existing models for classical conditioning are usually based on differential equations. Since the design of Agent Systems is traditionally based on qualitative conceptual languages, these differential equations are often not directly appropriate to serve as an input for Agent System design. To deal with this problem, this paper explores a formal description and analysis of a conditioning process based on logical specification and analysis methods of dynamic properties of conditioning. Specific types of dynamic properties are global properties, describing properties of the process as a whole, or local properties, describing properties of basic steps in a conditioning process. If the latter type of properties are specified in an executable format, they provide a temporal declarative specification of a simulation model. Global properties can be checked automatically for simulated or other traces. Using these methods the properties of conditioning processes informally expressed by Los and Heuvel [8] have been formalised and verified against a specification of local properties based on Machado [9]’s mathematical model.

Keywords

  • Conditioned Stimulus
  • Unconditioned Stimulus
  • Classical Conditioning
  • Global Property
  • Preceding Trial

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/11752660_5
  • Chapter length: 15 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   64.99
Price excludes VAT (USA)
  • ISBN: 978-3-540-34099-7
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   84.99
Price excludes VAT (USA)

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Balkenius, C., Morén, J.: Dynamics of a classical conditioning model. Autonomous Robots 7, 41–56 (1999)

    CrossRef  Google Scholar 

  2. Bosse, T., Delfos, M.F., Jonker, C.M., Treur, J.: Analysis of Adaptive Dynamical Systems for Eating Regulation Disorders. In: Proc. of the 25th Annual Conf. of the Cognitive Science Society, CogSci 2003, Lawrence Erlbaum Associates, Inc., Mahwah, NJ (2003)

    Google Scholar 

  3. Bosse, T., Jonker, C.M., Treur, J.: Simulation of Conditioning Mechanisms in Agents. In: Balsa, J., Moniz, L., Reis, L.P. (eds.) Proceedings of the Third Workshop on Multi-Agent Systems: Theory and Applications, MASTA 2005 (2005)

    Google Scholar 

  4. Dastani, M., Dignum, F., Meyer, J.-J.C.: 3APL: A Programming Language for Cognitive Agents. ERCIM News, European Research Consortium for Informatics and Mathematics, Special issue on Cognitive Systems (53) (2003)

    Google Scholar 

  5. Gallistel, C.R., Gibbon, J.: Time, rate, and conditioning. Psychological Review 107, 289–344 (2000)

    CrossRef  Google Scholar 

  6. Jonker, C.M., Treur, J.: Compositional Verification of Multi-Agent Systems: a Formal Analysis of Pro-activeness and Reactiveness. International Journal of Cooperative Information Systems 11, 51–92 (2002)

    CrossRef  Google Scholar 

  7. Los, S.A., Knol, D.L., Boers, R.M.: The Foreperiod Effect Revisited: Conditioning as a Basis for Nonspecific Preparation. Acta Psychologica 106, 121–145 (2001)

    CrossRef  Google Scholar 

  8. Los, S.A., van den Heuvel, C.E.: Intentional and Unintentional Contributions to Nonspecific Preparation During Reaction Time Foreperiods. Journal of Experimental Psychology: Human Perception and Performance 27, 370–386 (2001)

    Google Scholar 

  9. Machado, A.: Learning the temporal Dynamics of Behaviour. Psychological Review 104, 241–265 (1997)

    CrossRef  Google Scholar 

  10. Niemi, P., Naatanen, R.: Foreperiod and Simple Reaction Time. Psychological Bulletin 89, 133–162 (1981)

    CrossRef  Google Scholar 

  11. Port, R.F., van Gelder, T.J.: Mind as Motion: Explorations in the Dynamics of Cognition. MIT Press, Cambridge (1995)

    Google Scholar 

  12. Reiter, R.: Knowledge in Action: Logical Foundations for Specifying and Implementing Dynamical Systems. MIT Press, Cambridge (2001)

    MATH  Google Scholar 

  13. Rist, F., Cohen, R.: Sequential effects in the reaction times of schizophrenics: crossover and modality shift effects. In: Steinhauer, E.R., Gruzelier, J.H., Zubin, J. (eds.) Handbook of schizophrenia. Neuropsychology, psychophysiology and information processing, vol. 5, pp. 241–271. Elsevier, Amsterdam (1991)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Bosse, T., Jonker, C.M., Los, S.A., van der Torre, L., Treur, J. (2006). Formalisation and Analysis of the Temporal Dynamics of Conditioning. In: Müller, J.P., Zambonelli, F. (eds) Agent-Oriented Software Engineering VI. AOSE 2005. Lecture Notes in Computer Science, vol 3950. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11752660_5

Download citation

  • DOI: https://doi.org/10.1007/11752660_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-34097-3

  • Online ISBN: 978-3-540-34099-7

  • eBook Packages: Computer ScienceComputer Science (R0)