Associative theories of goal-directed behaviour: a case for animal–human translational models
- Sanne de Wit,
- Anthony Dickinson
- … show all 2 hide
Abstract
Associative accounts of goal-directed action, developed in the fields of human ideomotor action and that of animal learning, can capture cognitive belief-desire psychology of human decision-making. Whereas outcome-response accounts can account for the fact that the thought of a goal can call to mind the action that has previously procured this goal, response-outcome accounts capture decision-making processes that start out with the consideration of possible response alternatives followed only in the second instance by evaluation of their consequences. We argue that while the outcome-response mechanism plays a crucial role in response priming effects, the response-outcome mechanism is particularly important for action selection on the basis of current needs and desires. We therefore develop an integrative account that encapsulates these two routes of action selection within the framework of the associative-cybernetic model. This model has the additional benefit of providing mechanisms for the incentive modulation of goal-directed action and for the development of behavioural autonomy, and therefore provides a promising account of the multi-faceted process of animal as well as human instrumental decision-making.
- Adams, CD (1982) Variations in the sensitivity of instrumental responding to reinforcer devaluation. Quarterly Journal of Experimental Psychology 34B: pp. 77-98
- Adams, CD, Dickinson, A (1981) Instrumental responding following reinforcer devaluation. Quarterly Journal of Experimental Psychology 33B: pp. 109-121
- Anderson, JR, Bothell, D, Byrne, MD, Douglas, S, Lebiere, C, Qin, Y (2004) An integrated theory of mind. Psychological Review 111: pp. 1036-1060 CrossRef
- Ansorge, U (2002) Spatial intention-response compatibility. Acta Psychologia 109: pp. 285-299 CrossRef
- Asratyan, EA (1974) Conditional reflex theory and motivated behavior. Acta Neurobiologiae Experimentalis 34: pp. 15-31
- Balleine, B (2005) Neural basis of food-seeking: affect, arousal, and reward in corticostriatolimbic circuits. Physiology and Behavior 86: pp. 717-730 CrossRef
- Balleine, BW, Dickinson, A (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37: pp. 407-419 CrossRef
- Balleine, BW, Dickinson, A (1998) The role of incentive learning in instrumental outcome revaluation by sensory-specific satiety. Animal Learning & Behavior 26: pp. 46-59
- Balleine, BW, Ostlund, SB (2007) Still at the choice-point: action selection and initiation in instrumental conditioning. Annals of the New York Academy of Sciences 1104: pp. 147-171 CrossRef
- Baxter, DJ, Zamble, E (1982) Reinforcer and response specificity in appetitive transfer of control. Animal Learning & Behavior 10: pp. 201-210
- Beckers, T, Houwer, J, Eelen, P (2002) Automatic integration of non-perceptual action effect features: the case of the associative affective Simon effect. Psychological Research 66: pp. 166-173 CrossRef
- Blundell, P, Hall, G, Killcross, S (2001) Lesions of the basolateral amygdala disrupt selective aspects of reinforcer representation in rats. Journal of Neuroscience 21: pp. 9018-9026
- Bray, S, Rangel, A, Shimojo, S, Balleine, B, O’Doherty, JP (2008) The neural mechanisms underlying the influence of Pavlovian cues on human decision making. Journal of Neuroscience 28: pp. 5861-5866 CrossRef
- Carpenter, W. B. (1852). On the influence of suggestion in modifying and directing muscular movement, independently of volition. Proceedings of the Royal Institution, 1, 147–154.
- Chutuape, MAD, Mitchell, SH, Wit, H (1994) Ethano preloads increase ethanol preference under concurrent random-ratio schedules in social drinkers. Experimental and Clinical Psychopharmacology 2: pp. 310-318 CrossRef
- Colwill, RM, Motzkin, DK (1994) Encoding of the Unconditioned Stimulus in Pavlovian Conditioning. Animal Learning & Behavior 22: pp. 384-394
- Colwill, RM, Rescorla, RA (1985) Postconditioning devaluation of a reinforcer affects instrumental responding. Journal of Experimental Psychology: Animal Behavior Processes 11: pp. 120-132 CrossRef
- Colwill, RM, Rescorla, RA (1988) Associations between the discriminative stimulus and the reinforcer in instrumental learning. Journal of Experimental Psychology: Animal Behavior Processes 14: pp. 155-164 CrossRef
- Corbit, LH, Balleine, BW (2003) The role of prelimbic cortex in instrumental conditioning. Behavioural Brain Research 146: pp. 145-157 CrossRef
- Corbit, LH, Janak, PH, Balleine, BW (2007) General and outcome-specific forms of Pavlovian-instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area. The European Journal of Neuroscience 26: pp. 3141-3149 CrossRef
- Corbit, LH, Muir, JL, Balleine, BW (2001) The role of the nucleus accumbens in instrumental conditioning: evidence of a functional dissociation between accumbens core and shell. Journal of Neuroscience 21: pp. 3251-3260
- Corbit, LH, Muir, JL, Balleine, BW (2003) Lesions of mediodorsal thalamus and anterior thalamic nuclei produce dissociable effects on instrumental conditioning in rats. European Journal of Neuroscience 18: pp. 1286-1294 CrossRef
- Daw, ND, Niv, Y, Dayan, P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nature Neuroscience 8: pp. 1704-1711 CrossRef
- Borchgrave, R, Rawlins, JN, Dickinson, A, Balleine, BW (2002) Effects of cytotoxic nucleus accumbens lesions on instrumental conditioning in rats. Experimental Brain Research 144: pp. 50-68 CrossRef
- Wit, S, Niry, D, Wariyar, R, Aitken, MRF, Dickinson, A (2007) Stimulus-outcome interactions during conditional discrimination learning by rats and humans. Journal of Experimental Psychology: Animal Behavior Processes 33: pp. 1-11 CrossRef
- Dickinson, A Instrumental conditioning. In: Mackintosh, NJ eds. (1994) Animal learning and cognition. Academic Press, San Diego, CA, pp. 45-79
- Dickinson, A, Balleine, BW Actions and responses: the dual psychology of behaviour. In: Eilan, N, McCarthy, RA eds. (1993) Spatial representation: problems in philosophy and psychology. Blackwell, Malden, pp. 277-293
- Dickinson, A, Balleine, B (1994) Motivational control of goal-directed action. Animal Learning & Behavior 22: pp. 1-18
- Dickinson, A, Balleine, B The cognitive/motivational interface. In: Kringelbach, ML, Berridge, KC eds. (2008) Pleasures of the brain. The neural basis of taste, smell and other rewards. Oxford University Press, Oxford
- Dickinson, A, Balleine, B, Watt, A, Gonzalez, F, Boakes, R (1995) Motivational control after extended instrumental training. Animal Learning & Behavior 23: pp. 197-206
- Dickinson, A, Campos, J, Varga, ZI, Balleine, B (1996) Bidirectional instrumental conditioning. Quarterly Journal of Experimental Psychology 49B: pp. 289-306
- Dickinson, A, Nicholas, DJ, Adams, CD (1983) The effect of the instrumental training contingency on susceptibility to reinforcer devaluation. Quarterly Journal of Experimental Psychology 35B: pp. 35-51
- Elsner, B, Hommel, B (2001) Effect anticipation and action control. Journal of Experimental Psychology-Human Perception and Performance 27: pp. 229-240 CrossRef
- Elsner, B, Hommel, B (2004) Contiguity and contingency in action-effect learning. Psychological Research 68: pp. 138-154 CrossRef
- Estes, WK (1943) Discriminative conditioning: I. A discriminative property of conditioned anticipation. Journal of Experimental Psychology 32: pp. 150-155 CrossRef
- Estes, WK (1948) Discriminative conditioning: II. Effects of a Pavlovian conditioned stimulus upon a subsequently established operant response. Journal of Experimental Psychology 38: pp. 173-177 CrossRef
- Estes, WK Reinforcement in human learning. In: Tapp, JT eds. (1969) Reinforcement and Behavior. Academic Press, New York, pp. 63-94
- Evans, JSBT (2003) In two minds: dual process accounts of reasoning. Trends in Cognitive Sciences 7: pp. 454-459 CrossRef
- Evans, DW, Lewis, MD, Iobst, E (2004) The role of the orbitofrontal cortex in normally developing compulsive-like behaviors and obsessive-compulsive disorder. Brain and Cognition 55: pp. 220-234 CrossRef
- Everitt, BJ, Dickinson, A, Robbins, TW (2001) The neuropsychological basis of addictive behavior. Brain Research Reviews 36: pp. 129-138 CrossRef
- Everitt, BJ, Robbins, TW (2005) Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nature Neuroscience 8: pp. 1481-1489 CrossRef
- Fagen, JW, Rovee, CK (1976) Effects of quantitative shifts in a visual reinforcer on the instrumental response of infants. Journal of Experimental Child Psychology 21: pp. 349-360 CrossRef
- Fagen, JW, Rovee, CK, Kaplan, MG (1976) Psychophysical scaling of stimulus similarity in 3-month-old infants and adults. Journal of Experimental Child Psychology 22: pp. 272-281 CrossRef
- Garcia, J, Kimeldorf, DJ, Koelling, RA (1955) Conditioned aversion to saccharin resulting from exposure to gamma radiation. Science 122: pp. 157-158
- Gormezano, I, Tait, RW (1976) The Pavlovian analysis of instrumental conditioning. The Pavlovian Journal of Biological Science 11: pp. 37-55
- Greve, W (2001) Traps and gaps in action explanation: theoretical problems of a psychology of human action. Psychological Review 108: pp. 435-451 CrossRef
- Herbart, JF (1825) Psychologie als Wissenschaft neu gegrundet auf Erfahrung, Metaphysik und Mathematik. Zweiter, analytischer Teil. Unzer, Konigsberg
- Hershberger, WA (1986) An approach through the looking glass. Animal Learning & Behavior 14: pp. 443-451
- Heyes, C, Dickinson, A (1990) The intentionality of animal action. Mind and Language 5: pp. 87-104 CrossRef
- Hilario, M. R. F., Clouse, E., Yin, H. H., & Costa, R. M. (2007). Endocannabinoid signaling is critical for habit formation. Frontiers in Integrative Neuroscience, 1.
- Hogarth, L, Dickinson, A, Wright, A, Kouvaraki, M, Duka, T (2007) The role of drug expectancy in the control of human drug seeking. Journal of Experimental Psychology: Animal Behavior Processes 33: pp. 484-496 CrossRef
- Holland, PC (2004) Relations between Pavlovian-instrumental transfer and reinforcer devaluation. Journal of Experimental Psychology: Animal Behavior Processes 30: pp. 104-117 CrossRef
- Hommel, B (1993) The role of attention for the Simon effect. Psychological Research 55: pp. 208-222 CrossRef
- Hommel, B (1996) The cognitive representation of action: automatic integration of perceived action effects. Psychological Research 59: pp. 176-186 CrossRef
- Hommel, B. (2003). Planning and representing intentional action. The Scientific World Journal (3), 593–608.
- Hommel, B, Musseler, J, Aschersleben, G, Prinz, W (2001) The Theory of Event Coding (TEC): a framework for perception and action planning. The Behavioral and Brain Sciences 24: pp. 849-878 CrossRef
- James, W (1890) The principles of psychology. Dover Publications, New York
- Kenward, B., Folke, S., Holmberg, J., Johansson, A., & Gredeback, G. (2009). Goal-directedness and decision-making in infants. Developmental Psychology (in press).
- Killcross, S, Coutureau, E (2003) Coordination of actions and habits in the medial prefrontal cortex of rats. Cerebral Cortex 13: pp. 400-408 CrossRef
- Klossek, U, Russell, J, Dickinson, A (2008) The control of instrumental action following outcome devaluation in young children aged between 1 and 4 years. Journal of Experimental Psychology: General 137: pp. 39-51 CrossRef
- Kruse, JM, Overmier, JB, Konz, WA, Rokke, E (1983) Pavlovian conditioned stimulus effects upon instrumental choice behavior are reinforcer specific. Learning and Motivation 14: pp. 165-181 CrossRef
- Kunde, W, Koch, I, Hoffmann, J (2004) Anticipated action effects affect the selection, initiation, and execution of actions. Quarterly Journal of Experimental Psychology 57A: pp. 87-106
- Lotze, R. H. (1852). Medicinische Psychologie oder die Physiologie der Seele. In Weidmann’sche Buchhandlung. Leipzig.
- Ludwig, AM, Wikler, A, Stark, LH, Lexington, K (1974) The first drink: psychobiological aspects of craving. Archives of General Psychiatry 30: pp. 539-547
- Meck, WH (1985) Postreinforcement signal processing. Journal of Experimental Psychology: Animal Behavior Processes 11: pp. 52-70 CrossRef
- Newell, A (1990) Unified theories of cognition. Harvard University Press, Cambridge, MA
- Pavlov, IP (1927) Conditional reflexes; an investigation of the physiological activity of the cerebral cortex. Oxford University Press, Oxford
- Pavlov, IP (1932) The reply of a physiologist to psychologists. Psychological Review 39: pp. 91-127 CrossRef
- Pithers, RT (1985) The roles of event contingencies and reinforcement in human autoshaping and ommission responding. Learning and Motivation 16: pp. 210-237 CrossRef
- Redish, AD, Jensen, S, Johnson, A (2008) A unified framework for addiction: vulnerabilities in the decision process. Behavioural Brain Science 31: pp. 415-437
- Rescorla, RA (1992) Response outcome versus outcome response associations in instrumental learning. Animal Learning & Behavior 20: pp. 223-232
- Rescorla, RA (1994) Transfer of instrumental control mediated by a devalued outcome. Animal Learning & Behavior 22: pp. 27-33
- Rescorla, RA, Colwill, RM (1989) Associations with anticipated and obtained outcomes in instrumental learning. Animal Learning & Behaviour 17: pp. 291-303
- Rovee-Collier, CK Infants as problem-solvers: a psychobiological perspective. In: Zeiler, MD, Harzem, P eds. (1983) Advances in the analysis of behaviour. Wiley, Oxford, UK
- Sloman, SA (1996) The empirical case for two systems of reasoning. Psychological Bulletin 119: pp. 3-22 CrossRef
- Stewart, J, Wit, H Reinstatement of drug-taking behavior as a method of assessing incentive motivational properties of drugs. In: Bozarth, MA eds. (1987) Methods of assessing the reinforcing properties of abused drugs. Springer, New York, pp. 211-227
- Stock, A, Stock, C (2004) A short history of ideo-motor action. Psychological Research 68: pp. 176-188 CrossRef
- Sutton, RS, Barto, AG (1981) An adaptive network that constructs and uses an internal model of its world. Cognition and Brain Theory 4: pp. 217-246
- Talmi, D, Seymour, B, Dayan, P, Dolan, RJ (2008) Human pavlovian-instrumental transfer. The Journal of Neuroscience 28: pp. 360-368 CrossRef
- Thorndike, EL (1911) Animal intelligence: experimental studies. Macmillan, New York
- Thorndike, EL (1931) Human learning. Century, New York CrossRef
- Trapold, MA, Overmier, JB The second learning process in instrumental learning. In: Black, AH, Prokasy, WF eds. (1972) Classical conditioning ii: Current research and theory. Appleton-Cwntury-Croft, New York, pp. 427-452
- Valentin, VV, Dickinson, A, O’Doherty, JP (2007) Determining the neural substrates of goal-directed learning in the human brain. The Journal of Neuroscience 27: pp. 4019-4026 CrossRef
- Wolpaw, JR (1997) The complex structure of a simple memory. Trends in Neuroscience 20: pp. 588-594 CrossRef
- Wolpert, DM, Ghahramani, Z (2000) Computational principles of movement neuroscience. Nature Neuroscience 3: pp. 1212-1227 CrossRef
- Yin, HH, Knowlton, BJ (2006) The role of the basal ganglia in habit formation. Nature Reviews: Neuroscience 7: pp. 464-476 CrossRef
- Yin, HH, Knowlton, BJ, Balleine, BW (2004) Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. The European Journal of Neuroscience 19: pp. 181-189 CrossRef
- Yin, HH, Ostlund, SB, Knowlton, BJ, Balleine, BW (2005) The role of the dorsomedial striatum in instrumental conditioning. European Journal of Neuroscience 22: pp. 513-523 CrossRef
- Ziessler, M (1998) Response-effect learning as a major component of implicit serial learning. Journal of Experimental Psychology: Learning, Memory and Cognition 24: pp. 962-978 CrossRef
- Ziessler, M, Nattkemper, D (2001) Learning of event sequences is based on response-effect learning: further evidence from a serial reaction task. Journal of Experimental Psychology-Learning. Memoty and Cognition 27: pp. 595-613 CrossRef
- Ziessler, M, Nattkemper, D Effect anticipation in action planning. In: Prinz, W, Hommel, B eds. (2002) Common mechanisms in perception and action:Attention and performance XIX. Oxford University Press, Oxford, pp. 645-672
- Title
- Associative theories of goal-directed behaviour: a case for animal–human translational models
- Open Access
- Available under Open Access This content is freely available online to anyone, anywhere at any time.
- Journal
-
Psychological Research PRPF
Volume 73, Issue 4 , pp 463-476
- Cover Date
- 2009-07-01
- DOI
- 10.1007/s00426-009-0230-6
- Print ISSN
- 0340-0727
- Online ISSN
- 1430-2772
- Publisher
- Springer-Verlag
- Additional Links
- Topics
- Industry Sectors
- Authors
-
-
Sanne de Wit
(1)
- Anthony Dickinson (2)
-
Sanne de Wit
- Author Affiliations
-
- 1. Department of Psychology, Amsterdam Center for the Study of Adaptive Control in Brain and Behavior (Acacia), University of Amsterdam, Amsterdam, The Netherlands
- 2. Department of Experimental Psychology, University of Cambridge, Cambridge, United Kingdom