Skip to main content
View expanded cover

International Workshop on Agent-Oriented Software Engineering

AOSE 2005: Agent-Oriented Software Engineering VI pp 54–68Cite as

Formalisation and Analysis of the Temporal Dynamics of Conditioning

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNPSE,volume 3950)

Abstract

In order to create adaptive Agent Systems with abilities matching those of their biological counterparts, a natural approach is to incorporate classical conditioning mechanisms into such systems. However, existing models for classical conditioning are usually based on differential equations. Since the design of Agent Systems is traditionally based on qualitative conceptual languages, these differential equations are often not directly appropriate to serve as an input for Agent System design. To deal with this problem, this paper explores a formal description and analysis of a conditioning process based on logical specification and analysis methods of dynamic properties of conditioning. Specific types of dynamic properties are global properties, describing properties of the process as a whole, or local properties, describing properties of basic steps in a conditioning process. If the latter type of properties are specified in an executable format, they provide a temporal declarative specification of a simulation model. Global properties can be checked automatically for simulated or other traces. Using these methods the properties of conditioning processes informally expressed by Los and Heuvel [8] have been formalised and verified against a specification of local properties based on Machado [9]’s mathematical model.

Keywords

  • Conditioned Stimulus
  • Unconditioned Stimulus
  • Classical Conditioning
  • Global Property
  • Preceding Trial

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/11752660_5
  • Chapter length: 15 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   64.99
Price excludes VAT (USA)
  • ISBN: 978-3-540-34099-7
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   84.99
Price excludes VAT (USA)
Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Balkenius, C., Morén, J.: Dynamics of a classical conditioning model. Autonomous Robots 7, 41–56 (1999)

    CrossRef  Google Scholar 

  2. Bosse, T., Delfos, M.F., Jonker, C.M., Treur, J.: Analysis of Adaptive Dynamical Systems for Eating Regulation Disorders. In: Proc. of the 25th Annual Conf. of the Cognitive Science Society, CogSci 2003, Lawrence Erlbaum Associates, Inc., Mahwah, NJ (2003)

    Google Scholar 

  3. Bosse, T., Jonker, C.M., Treur, J.: Simulation of Conditioning Mechanisms in Agents. In: Balsa, J., Moniz, L., Reis, L.P. (eds.) Proceedings of the Third Workshop on Multi-Agent Systems: Theory and Applications, MASTA 2005 (2005)

    Google Scholar 

  4. Dastani, M., Dignum, F., Meyer, J.-J.C.: 3APL: A Programming Language for Cognitive Agents. ERCIM News, European Research Consortium for Informatics and Mathematics, Special issue on Cognitive Systems (53) (2003)

    Google Scholar 

  5. Gallistel, C.R., Gibbon, J.: Time, rate, and conditioning. Psychological Review 107, 289–344 (2000)

    CrossRef  Google Scholar 

  6. Jonker, C.M., Treur, J.: Compositional Verification of Multi-Agent Systems: a Formal Analysis of Pro-activeness and Reactiveness. International Journal of Cooperative Information Systems 11, 51–92 (2002)

    CrossRef  Google Scholar 

  7. Los, S.A., Knol, D.L., Boers, R.M.: The Foreperiod Effect Revisited: Conditioning as a Basis for Nonspecific Preparation. Acta Psychologica 106, 121–145 (2001)

    CrossRef  Google Scholar 

  8. Los, S.A., van den Heuvel, C.E.: Intentional and Unintentional Contributions to Nonspecific Preparation During Reaction Time Foreperiods. Journal of Experimental Psychology: Human Perception and Performance 27, 370–386 (2001)

    Google Scholar 

  9. Machado, A.: Learning the temporal Dynamics of Behaviour. Psychological Review 104, 241–265 (1997)

    CrossRef  Google Scholar 

  10. Niemi, P., Naatanen, R.: Foreperiod and Simple Reaction Time. Psychological Bulletin 89, 133–162 (1981)

    CrossRef  Google Scholar 

  11. Port, R.F., van Gelder, T.J.: Mind as Motion: Explorations in the Dynamics of Cognition. MIT Press, Cambridge (1995)

    Google Scholar 

  12. Reiter, R.: Knowledge in Action: Logical Foundations for Specifying and Implementing Dynamical Systems. MIT Press, Cambridge (2001)

    MATH  Google Scholar 

  13. Rist, F., Cohen, R.: Sequential effects in the reaction times of schizophrenics: crossover and modality shift effects. In: Steinhauer, E.R., Gruzelier, J.H., Zubin, J. (eds.) Handbook of schizophrenia. Neuropsychology, psychophysiology and information processing, vol. 5, pp. 241–271. Elsevier, Amsterdam (1991)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Artificial Intelligence, Vrije Universiteit Amsterdam, De Boelelaan 1081a, 1081 HV, Amsterdam, The Netherlands

    Tibor Bosse & Jan Treur

  2. Nijmegen Institute for Cognition and Information, Radboud Universiteit Nijmegen, Montessorilaan 3, 6525 HR, Nijmegen, The Netherlands

    Catholijn M. Jonker

  3. Department of Cognitive Psychology, Vrije Universiteit Amsterdam, Van der Boechorststraat 1, 1081 BT, Amsterdam, The Netherlands

    Sander A. Los

  4. Centrum voor Wiskunde en Informatica, Kruislaan 413, 1098 NL, Amsterdam, The Netherlands

    Leendert van der Torre

  5. Delft University of Technology, Mekelweg 4, 2628 CD, Delft, The Netherlands

    Leendert van der Torre

Authors
  1. Tibor Bosse
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Catholijn M. Jonker
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sander A. Los
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Leendert van der Torre
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jan Treur
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Informatics, Clausthal University of Technology, Julius-Albert-Str. 4, D-38678, Clausthal-Zellerfeld, Germany

    Jörg P. Müller

  2. Dipartimento di Scienze e Metodi dell’Ingegneria, Università di Modena e Reggio Emilia, Via Amendola 2, 42100, Reggio Emilia, Italy

    Franco Zambonelli

Rights and permissions

Reprints and Permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Bosse, T., Jonker, C.M., Los, S.A., van der Torre, L., Treur, J. (2006). Formalisation and Analysis of the Temporal Dynamics of Conditioning. In: Müller, J.P., Zambonelli, F. (eds) Agent-Oriented Software Engineering VI. AOSE 2005. Lecture Notes in Computer Science, vol 3950. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11752660_5

Download citation

  • DOI: https://doi.org/10.1007/11752660_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-34097-3

  • Online ISBN: 978-3-540-34099-7

  • eBook Packages: Computer ScienceComputer Science (R0)