Skip to main content
SpringerLink
Log in

The Cognitive Control of Goal-Directed Action: How Predictive Learning Affects Choice

  • Conference paper
  • First Online:
Advances in Cognitive Neurodynamics (V)

Part of the book series: Advances in Cognitive Neurodynamics ((ICCN))

Abstract

The cognitive control of action reflects our ability to extract and encode causal relationships from the environment to guide the choice between different courses of action. To investigate this process, at both a psychological and a neural level, we have adopted a model of cognitive control in animals in which the influence of predictive learning on action selection is assessed in an instrumental choice situation: the Pavlovian-instrumental transfer paradigm. Over several years, we have been systematically investigating the core neural systems and cellular circuits that mediate this transfer effect. Here, I describe the background to this research project and some recent findings.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Lezac, M.D.: The problem of assessing executive functions. Int. J. Psychol. 17, 281–297 (1982)

    Article  Google Scholar 

  2. Baddeley, A., Wilson, B.: Frontal amnesia and the dysexecutive syndrome. Brain Cogn. 7(2), 212–230 (1988)

    Article  PubMed  CAS  Google Scholar 

  3. Miller, E.K., Cohen, J.D.: An integrative theory of prefrontal cortex function. Annu. Rev. Neurosci. 24, 167–202 (2001)

    Article  PubMed  CAS  Google Scholar 

  4. Alvarez, J.A., Emory, E.: Executive function and the frontal lobes: a meta-analytic review. Neuropsychol. Rev. 16(1), 17–42 (2006)

    Article  PubMed  Google Scholar 

  5. Balleine, B., O’Doherty, J.: Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35, 48–69 (2010)

    Article  PubMed  PubMed Central  Google Scholar 

  6. Bertran-Gonzalez, J., et al.: Learning-related translocation of delta-opioid receptors on ventral striatal cholinergic interneurons mediates choice between goal-directed actions. J. Neurosci. 33(41), 16060–16071 (2013)

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  7. Colwill, R.M., Rescorla, R.A.: Associations between the discriminative stimulus and the reinforcer in instrumental learning. J. Exp. Psychol. Anim. Behav. Process. 14, 155–164 (1988)

    Article  Google Scholar 

  8. Rescorla, R.A.: Control of instrumental performance by Pavlovian and instrumental stimuli. J. Exp. Psychol. Anim. Behav. Process. 20(1), 44–50 (1994)

    Article  PubMed  CAS  Google Scholar 

  9. Dickinson, A., Balleine, B.W.: The role of learning in the operation of motivational systems. In: Gallistel, C.R. (ed.) Learning, Motivation & Emotion, Volume 3 of Steven’s Handbook of Experimental Psychology, 3rd edn, pp 497–533. Wiley, New York (2002)

    Google Scholar 

  10. Shanks, D.R., Dickinson, A.: Instrumental judgment and performance under variations in action-outcome contingency and contiguity. Memory Cogn. 19, 353–360 (1991)

    Article  CAS  Google Scholar 

  11. Paredes-Olay, C., et al.: Transfer of control between causal predictive judgments and instrumental responding. Anim. Learn Behav. 30(3), 239–248 (2002)

    Article  PubMed  Google Scholar 

  12. Rescorla, R.A.: The role of information about the response-outcome relation in instrumental discrimination learning. J. Exp. Psychol. Anim. Behav. Process. 16(3), 262–270 (1990)

    Article  PubMed  CAS  Google Scholar 

  13. Balleine, B.W., Dickinson, A.: Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37(4–5), 407–419 (1998)

    Article  PubMed  CAS  Google Scholar 

  14. Lee, D.: Decision making: from neuroscience to psychiatry. Neuron 78(2), 233–248 (2013)

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  15. Gurrera, R.J., et al.: Cognitive performance predicts treatment decisional abilities in mild to moderate dementia. Neurology 66(9), 1367–1372 (2006)

    Article  PubMed  CAS  Google Scholar 

  16. Bickel, W.K., et al.: Hypothetical intertemporal choice and real economic behavior: delay discounting predicts voucher redemptions during contingency-management procedures. Exp. Clin. Psychopharmacol. 18(6), 546–552 (2010)

    Article  PubMed  PubMed Central  Google Scholar 

  17. Stacy, A.W., Wiers, R.W.: Implicit cognition and addiction: a tool for explaining paradoxical behavior. Annu. Rev. Clin. Psychol. 6, 551–575 (2010)

    Article  PubMed  PubMed Central  Google Scholar 

  18. Rutledge, R.B., et al.: Dopaminergic drugs modulate learning rates and perseveration in Parkinson’s patients in a dynamic foraging task. J. Neurosci. 29(48), 15104–15114 (2009)

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  19. Bray, S., et al.: The neural mechanisms underlying the influence of pavlovian cues on human decision making. J. Neurosci. 28(22), 5861–5866 (2008)

    Article  PubMed  CAS  Google Scholar 

  20. Corbit, L.H., Muir, J.L., Balleine, B.W.: The role of the nucleus accumbens in instrumental conditioning: evidence of a functional dissociation between accumbens core and shell. J. Neurosci. 21(9), 3251–3260 (2001)

    PubMed  CAS  Google Scholar 

  21. Corbit, L.H., Balleine, B.W.: The general and outcome-specific forms of pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell. J. Neurosci. Official J. Soc. Neurosci. 31(33), 11786–11794 (2011)

    Article  CAS  Google Scholar 

  22. Shiflett, M.W., Balleine, B.W.: At the limbic-motor interface: disconnection of basolateral amygdala from nucleus accumbens core and shell reveals dissociable components of incentive motivation. Eur. J. Neurosci. 32(10), 1735–1743 (2010)

    Article  PubMed  PubMed Central  Google Scholar 

  23. Laurent, V., et al.: mu- and delta-opioid-related processes in the accumbens core and shell differentially mediate the influence of reward-guided and stimulus-guided decisions on choice. J. Neurosci. 32(5), 1875–1883 (2012)

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  24. Cahill, C.M., Holdridge, S.V., Morinville, A.: Trafficking of delta-opioid receptors and other G-protein-coupled receptors: implications for pain and analgesia. Trends Pharmacol. Sci. 28(1), 23–31 (2007)

    Article  PubMed  CAS  Google Scholar 

  25. Brown, M.T., et al.: Ventral tegmental area GABA projections pause accumbal cholinergic interneurons to enhance associative learning. Nature 492(7429), 452–456 (2012)

    Article  PubMed  CAS  Google Scholar 

  26. Bradfield, L.A., et al.: The thalamostriatal pathway and cholinergic control of goal-directed action: interlacing new with existing learning in the striatum. Neuron 79(1), 153–166 (2013)

    Article  PubMed  CAS  Google Scholar 

  27. Pradhan, A.A., et al.: Ligand-directed trafficking of the delta-opioid receptor in vivo: two paths toward analgesic tolerance. J. Neurosci. Official J. Soc. Neurosci. 30(49), 16459–16468 (2010)

    Article  CAS  Google Scholar 

  28. Bie, B., Pan, Z.Z.: Trafficking of central opioid receptors and descending pain inhibition. Mol. Pain 3, 37 (2007)

    Article  PubMed  PubMed Central  Google Scholar 

  29. Bie, B., Zhu, W., Pan, Z.Z.: Rewarding morphine-induced synaptic function of delta-opioid receptors on central glutamate synapses. J. Pharmacol. Exp. Ther. 329(1), 290–296 (2009)

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  30. Laurent, V., et al.: delta-opioid and dopaminergic processes in accumbens shell modulate the cholinergic control of predictive learning and choice. J. Neurosci. 34(4), 1358–1369 (2014)

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  31. Leung, B.K., Balleine, B.W.: The ventral striato-pallidal pathway mediates the effect of predictive learning on choice between goal-directed actions. J. Neurosci. 33(34), 13848–13860 (2013)

    Article  PubMed  CAS  Google Scholar 

  32. Leung, B.K., Balleine, B.W.: Ventral pallidal projections to mediodorsal thalamus and ventral tegmental area play distinct roles in outcome-specific Pavlovian-instrumental transfer. J. Neurosci. 35(12), 4953–4964 (2015)

    Article  PubMed  CAS  Google Scholar 

  33. Ostlund, S.B., Balleine, B.W.: Differential involvement of the basolateral amygdala and mediodorsal thalamus in instrumental action selection. J. Neurosci. 28(17), 4398–4405 (2008)

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  34. Ostlund, S.B., Balleine, B.W.: The contribution of orbitofrontal cortex to action selection. Ann. N. Y. Acad. Sci. 1121, 174–192 (2007)

    Article  PubMed  Google Scholar 

  35. Ostlund, S.B., Balleine, B.W.: Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning. J. Neurosci. 27(18), 4819–4825 (2007)

    Article  PubMed  CAS  Google Scholar 

  36. Balleine, B.W., Morris, R.W., Leung, B.K.: Thalamocortical integration of instrumental learning and performance and their disintegration in addiction. Brain Res. (2014)

    Google Scholar 

Download references

Acknowledgments

BWB is supported by an NHMRC Senior Principal Research Fellowship.

Author information

Authors and Affiliations

  1. Brain and Mind Centre, University of Sydney, Camperdown, NSW, 2015, Australia

    Bernard W. Balleine

Authors
  1. Bernard W. Balleine
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bernard W. Balleine .

Editor information

Editors and Affiliations

  1. Inst for Cognitive Neurodynamics, East China Univ of Sci and Tech, Shanghai, China

    Rubin Wang

  2. Inst for Cognitive Neurodynamics, East China Univ of Sci and Tech, Shanghai, China

    Xiaochuan Pan

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer Science+Business Media Singapore

About this paper

Cite this paper

Balleine, B.W. (2016). The Cognitive Control of Goal-Directed Action: How Predictive Learning Affects Choice. In: Wang, R., Pan, X. (eds) Advances in Cognitive Neurodynamics (V). Advances in Cognitive Neurodynamics. Springer, Singapore. https://doi.org/10.1007/978-981-10-0207-6_5

Download citation

Publish with us

Policies and ethics

Search

Navigation