Skip to main content
Log in

Neurophysiology of Motivated Learning: Adaptive Mechanisms Underlying Cognitive Bias in Depression

  • Original Article
  • Published:
Cognitive Therapy and Research Aims and scope Submit manuscript

Abstract

Cognitive Behavior Therapy for depression focuses on changing cognitive appraisals of the self and life events. This approach contrasts with behaviorist approaches to clinical disorders, which focused on elementary learning explanations and assumed that cognitive mediation is irrelevant. A better integration of behavioral analysis with cognitive therapy could be facilitated by the theoretical advances in animal learning theory over the last several decades. Animals have been found to respond to events in relation to mental representations of the reward value of those events. The evidence now shows that learning in mammals cannot be explained by passive behaviorist association principles, but requires a theoretical understanding of the animal’s hedonic expectancies and its adaptive response to discrepancies from those expectancies. The mechanisms of cognitive representation and information handling that are implied by modern learning theory have presented clear and specific challenges to neurophysiological theories of motivational control of learning and memory. The mechanisms of human motivational control appear to be similar to those of other mammals, suggesting that progress with understanding neurophysiological mechanisms of hedonic evaluation, frustration, and action regulation will soon provide the opportunity for a comprehensive neuropsychological model to guide diagnosis and treatment of depressive disorders.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Amsel, A. (1992). Frustration theory: An analysis of dispositional learning and memory. New York: Cambridge University Press.

    Google Scholar 

  • Amsel, A., & Stanton, M. (1980). Ontogeny and phylogeny of paradoxical reward effects. Advances in the Study of Behavior, 11, 227–274

    Google Scholar 

  • Balsam, P. D. (1985). The functions of context in learning and performance. In P. D. Balsam & A. Tomie (Eds.), Context and learning (pp. 1–22). Hillsdale: Lawrence Earlbaum.

    Google Scholar 

  • Bargh, J. A., & Tota, M. E. (1988). Context-dependent automatic processing in depression: Accessibility of negative constructs with regard to self but not others. Journal of Personality and Social Psychology, 54, 925–939.

    Article  PubMed  Google Scholar 

  • Bates, A. T., Kiehl, K. A., Laurens, K. R., & Liddle, P. F. (2002). Error-related negativity and correct response negativity in schizophrenia. Clinical Neurophysiology, 113, 1454–1463.

    Article  PubMed  Google Scholar 

  • Beck, A. T., Rush, J. A., Shaw, B. F., & Emery, G. (1979). Cognitive therapy of depression. New York: Guilford Press.

    Google Scholar 

  • Brody, A. L., Saxena, S., Mandelkern, M. A., Fairbanks, L. A., Ho, M. L., & Baxter, L. R. (2001). Brain metabolic changes associated with symptom factor improvement in major depressive disorder. Biological Psychiatry, 50, 171–178.

    Article  PubMed  Google Scholar 

  • Brázdil, M., Roman, R., Falkenstein, M., Daniel, P., Jurák, P., & Rektor, I. (2002). Error processing: Evidence from intracerebral erp recordings. Experimental Brain Research, 146, 460–466.

    Article  Google Scholar 

  • Bush, G., Vogt, B. A., Holmes, J., Dale, A. M., Greve, D., Jenike, M. A., et al. (2002). Dorsal anterior cingulate cortex: A role in reward-based decision making. Proceedings of the National Academy of Sciences, 99, 523–528.

    Article  Google Scholar 

  • Bussey, T. J., Wise, S. P., & Murray, E. A. (2001). The role of ventral and orbital prefrontal cortex in conditional visuomotor learning and strategy use in rhesus monkeys (macaca mulatta). Behavioral Neuroscience, 115, 971–982.

    Article  PubMed  Google Scholar 

  • Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., & Cohen, J. D. (1998). Anterior cingulate cortex, error detection, and the online monitoring of performance. Science, 280, 747–749.

    Article  PubMed  Google Scholar 

  • Chung, G., Tucker, D. M., West, P., Potts, G., Liotti, M., Luu, P., et al. (1996). Emotional expectancy: Brain electrical activity associated with an emotional bias in interpreting life events. Psychophysiology, 33, 218–233.

    Article  PubMed  Google Scholar 

  • Crowne, D. P., & Radcliffe, D. D. (1975). Some characteristics and functional relations of the electrical activity of the primate hippocampus and a hypothesis of hippocampal function. In R. L. Isaacson, & K. H. Pribram (Eds.), The hippocampus: Neurophysiology and behavior (Vol. 2, pp. 185–206). New York: Plenum.

    Google Scholar 

  • Dehaene, S., Posner, M. I., & Tucker, D. M. (1994). Localization of a neural system for error detection and compensation. Psychological Science, 5, 303–305.

    Article  Google Scholar 

  • Dent, J., & Teasdale, J. D. (1988). Negative cognition and the persistence of depression. Journal of Abnormal Psychology, 97, 29–34.

    Article  PubMed  Google Scholar 

  • Falkenstein, M., Hohnsbein, J., Hoormann, J., & Blanke, L. (1991). Effects of crossmodal divided attention on late erp components. Ii. Error processing in choice reaction tasks. Electroencephalography and clinical Neurophysiology, 78, 447–455.

    Article  PubMed  Google Scholar 

  • Falkenstein, M., Hoorman, J., Christ, S., & Hohnbein, J. (2000). Erp components on reaction errors and their functional significance: A tutorial. Biological Psychology, 51, 87–107.

    Article  PubMed  Google Scholar 

  • Foltz, E., & White, L. E. (1962). Pain “relief” by frontal cingulotomy. Journal of Neurosurgery, 19, 89–100.

    PubMed  Google Scholar 

  • Foote, S. L., & Morrison, J. H. (1987). Extrathalamic modulation of cortical function. Annual Review of Neuroscience, 10, 67–95.

    Article  PubMed  Google Scholar 

  • Gabriel, M. (1990). Functions of anterior and posterior cingulate cortex during avoidance learning in rabbits. Progress In Brain Research, 85, 467–483.

    Article  PubMed  Google Scholar 

  • Garber, J., & Hollon, S. D. (1980). Universal versus personal helplessness in depression: Belief in uncontrollability or incompetence? Journal of Abnormal Psychology, 89, 56–66.

    Article  PubMed  Google Scholar 

  • Gehring, W. J., Goss, B., Coles, M. G. H., Meyer, D. E., & Donchin, E. (1993). A neural system for error detection and compensation. Psychological Science, 4, 385–390.

    Article  Google Scholar 

  • Gehring, W. J., Himle, J., & Nisenson, L. G. (2000). Action monitoring dysfunction in obsessive-compulsive disorder. Psychological Science, 11, 1–6.

    Article  PubMed  Google Scholar 

  • Geisser, M. E., Robinson, M. E., Keefe, F. J., & Weiner, M. L. (1994). Catastrophizing, depression, and the sensory, affective and evaluative aspects of chronic pain. Pain, 59, 79–83.

    Article  PubMed  Google Scholar 

  • Goldberg, G. (1985). Supplementary motor area structure and function: Review and hypotheses. The Behavioral and Brain Sciences, 8, 567–615.

    Article  Google Scholar 

  • Gotlib, I. H. (1992). Interpersonal and cognitive aspects of depression. Current Direction in Psychological Science, 1(5), 149–154.

    Article  Google Scholar 

  • Gotlib, I. H., & McCann, D. C. (1984). Construct accessibility and depression: An examination of cognitive and affective factors. Journal of Personality and Social Psychology, 47, 427–439.

    Article  PubMed  Google Scholar 

  • Gray, J. A. (1982). Precis of the neuropsychology of anxiety: An inquiry into the functions of the septo-hippocampal system. Behavioral and Brain Sciences, 5, 469–534.

    Google Scholar 

  • Hendler, J. A. (1995). Types of planning: Can artificial intelligence yield insights into prefrontal function? In J. Grafman, K. J. Holyoak, & F. Boller (Eds.), Structure and functions of the human prefrontal cortex (Vol. 769, pp. 265–276). New York: New York Academy of Sciences.

    Google Scholar 

  • Holroyd, C. B., Nieuwenhuis, S., Yeung, N., & Cohen, J. D. (2003). Errors in reward prediction are reflected in the event-related brain potential. Neuroreport, 14, 2481–2484.

    Article  PubMed  Google Scholar 

  • Johannes, S., Wieringa, B. M., Nager, W., Dengler, R., & Münte, T. F. (2001). Oxazepam alters action monitoring. Psychopharmacology, 155, 100–106.

    Article  PubMed  Google Scholar 

  • Keefe, F. J., Wilkins, R. H., Cook, W. A., Crisson, J. E., & Muhlbaier, L. (1986). Depression, pain, and pain behavior. Journal of Consulting and Clinical Psychology, 54, 665–669.

    Article  PubMed  Google Scholar 

  • Kuiper, N. A. (1977). Depression and the causal attributions for success and failure. Journal of Personality and Social Psychology, 36, 236–246.

    Article  Google Scholar 

  • Laurens, K. R., Ngan, E. T. C., Bates, A. T., Kiehl, K. A., & Liddle, P. F. (2003). Rostral anterior cingulate cortex dysfunction during error processing in schizophrenia. Brain, 126, 610–622.

    Article  PubMed  Google Scholar 

  • Lewinsohn, P. M., Steinmetz, J. L., Larson, D. W., & Franklin, J. F. (1981). Depression-related cognitions: Antecedents or consequence? Journal of Abnormal Psychology, 90, 213–219.

    Article  PubMed  Google Scholar 

  • Liotti, M., & Mayberg, H. S. (2001). The role of functional neuroimaging in the neuropsychology of depression. Journal of Clinical and Experimental Neuropsychology, 23, 121–136.

    Article  PubMed  Google Scholar 

  • Luu, P., Collins, P., & Tucker, D. M. (2000). Mood, personality, and self-monitoring: Negative affect and emotionality in relation to frontal lobe mechanisms of error monitoring. Journal of Experimental Psychology: General, 129, 43–60.

    Article  Google Scholar 

  • Luu, P., & Pederson, S. M. (2004). The anterior cingulate cortex: Regulating actions in context. In M. I. Posner (Ed.), Cognitive neuroscience of attention. New York: Guilford Publication, Inc.

    Google Scholar 

  • Luu, P., & Tucker, D. M. (2001). Regulating action: Alternating activation of human prefrontal and motor cortical networks. Clinical Neurophysiology, 112, 1295–1306.

    Article  PubMed  Google Scholar 

  • Luu, P., & Tucker, D. M. (2003a). Self-regulation and the executive functions: Electrophysiological clues. In A. Zani, & A. M. Preverbio (Eds.), The cognitive electrophysiology of mind and brain (pp. 199–223). San Diego: Academic Press.

    Google Scholar 

  • Luu, P., & Tucker, D. M. (2003b). Self-regulation by the medial frontal cortex: Limbic representation of motive set-points. In M. Beauregard (Eds.), Consciousness, emotional self-regulation and the brain. Amsterdam: John Benjamins.

    Google Scholar 

  • Luu, P., Tucker, D. M., Derryberry, D., Reed, M., & Poulsen, C. (2003). Electrophysiological responses to errors and feedback in the process of action regulation. Psychological Science, 14, 47–53.

    Article  PubMed  Google Scholar 

  • Luu, P., Tucker, D. M., & Makeig, S. (2004). Frontal midline theta and the error-related negativity: Neurophysiological mechanisms of action regulation. Clinical Neurophysiology, 115(8), 1821–1835.

    Article  PubMed  Google Scholar 

  • Mayberg, H. S., Brannan, S. K., Tekell, J. L., Silva, J. A., Mahurin, R. K., McGinnis, S., et al. (2000). Regional metabolic effects of fluoxetine in major depression: Serial changes and relationship to clinical response. Biological Psychiatry, 48, 830–843.

    Article  PubMed  Google Scholar 

  • Mayberg, H. S., Liotti, M., Brannan, S. K., McGinnis, S., Mahurin, R. K., Jerabek, P. A., et al. (1999). Reciprocal limbic-cortical function and negative mood: Converging pet findings in depression and normal sadness. American Journal of Psychiatry, 156, 675–682.

    PubMed  Google Scholar 

  • Moore, R. Y., & Bloom, F. E. (1978). Central catecholamine neuronal systems: Anatomy and physiology of the dopamine systems. Annual Review of Neuroscience, 1, 129–169.

    Article  PubMed  Google Scholar 

  • Nadel, L., Willner, J., & Kurz, E. M. (1985). Cognitive maps and environmental context. In P. D. Balsam, & A. Tomie (Eds.), Context and learnin (pp. 385–406). Hillsdale: Lawrence Earlbaum Associates.

    Google Scholar 

  • Neafsey, E. J. (1990). Prefrontal cortical control of the autonomic nervous system: Anatomical and physiological observations. In H. B. M. Uylings, C. G. Van Eden, J. P. C. De Bruin, M. A. Corner, & M. G. P. Feenstra (Eds.), The prefrontal cortex: Its structure, function and pathology (pp. 147–166). New York: Elsevier.

    Google Scholar 

  • Overmier, J. B., & Seligman, M. E. P. (1967). Effects of inescapable shock upon subsequent escape and avoidance responding. Journal of Comparative and Physiological Psychology, 63, 28–33.

    Article  PubMed  Google Scholar 

  • Pailing, P. E., & Segalowitz, S. J. (2004). The error-related negativity (ern/ne) as a state and trait measure: Motivation, personality, and erps in response to errors. Psychophysiology, 40, 84–95.

    Article  Google Scholar 

  • Pandya, D. N., Seltzer, B., & Barbas, H. (1988). Input–output organization of the primate cerebral cortex. Comparative Primate Biology, 4, 39–80.

    Google Scholar 

  • Papini, M. R. (2003). Comparative psychology of surprising nonreward. Brain, Behavior and Evolution, 62, 83–95.

    Article  PubMed  Google Scholar 

  • Passingham, R. E. (1987). Two cortical systems for directing movement. In Ciba Foundation (Eds.), Motor areas of the cerebral cortex (pp. 151–164). New York: John Wiley and sons.

  • Pietromonaco, P. R., & Markus, H. (1985). The nature of negative thoughts in depression. Journal of Personality and Social Psychology, 48, 799–807.

    Article  PubMed  Google Scholar 

  • Rainville, P., Duncan, G. H., Price, D. D., Carrier, B., & Bushnell, C. M. (1997). Pain affect encoded in human anterior cingulate but not somatosensory cortex. Science, 277, 968–971.

    Article  PubMed  Google Scholar 

  • Rescorla, R. A. (1988). Pavlovian conditioning: It’s not what you think it is. American Psychologist, 43, 151–160.

    Article  PubMed  Google Scholar 

  • Rescorla, R. A., & Wagner, A. R. (1972). A theory of pavlovian conditioning: Variations in the effectiveness of reinforcement, nonreinforcement. In A. H. Black, & W. F. Prokasy (Eds.), Classical conditioning ii: Current research and theory (pp. 64–99). New York: Appleton-Century-Corfts.

    Google Scholar 

  • Schoenbaum, G., & Roesch, M. (2005). Orbitofrontal cortex, associative learning, and expectancies. Neuron, 47, 633–636.

    Article  PubMed  Google Scholar 

  • Segal, Z. V., & Vella, D. D. (1990). Self-schema in major depression: Replication and extension of a priming methodology. Cognitive Therapy and Research, 14, 161–176.

    Article  Google Scholar 

  • Shima, K., & Tanji, J. (1998). Role for cingulate motor area cells in voluntary movement selection based on reward. Science, 282, 1335–1338.

    Article  PubMed  Google Scholar 

  • Simons, A. D., Garfield, S. L., & Murphy, G. E. (1984). The process of change in cognitive therapy and pharmacotherapy for depression: Changes in mood and cognition. Archives of General Psychiatry, 41, 45–51.

    PubMed  Google Scholar 

  • Teasdale, J. D., Taylor, M., Cooper, Z., Hayhurst, H., & Paykel, E. S. (1995). Depressive thinking: Shifts in construct accessibility or in schematic mental models? Journal of Abnormal Psychology, 104, 500–507.

    Article  PubMed  Google Scholar 

  • Tellegen, A., & Waller, N. G. (1996). Exploring personality through test construction: Development of the multidimensional personality questionnaire. In S. R. Brigg, & J. M. Cheek (Eds.), Personality measures: Development and evaluation (pp. 133–161). Greenwich: JAI Press.

    Google Scholar 

  • Thayer, R. E. (1978). Factor analytic and reliability studies on the activation-deactivation adjective check list. Psychological Reports, 42, 747–756.

    PubMed  Google Scholar 

  • Tucker, D. M. (2001). Motivated anatomy: A core-and-shell model of corticolimbic architecture. In G. Gainotti (Ed.), Handbook of neuropsychology: Emotional behavior and its disorders (2nd ed., Vol. 5, pp. 125–160). Amsterdam: Elsevier.

  • Tucker, D. M., & Derryberry, D. (1992). Motivated attention: Anxiety and the frontal executive functions. Neuropsychiatry, Neuropsychology, and Behavioral Neurology, 5, 233–252.

    Google Scholar 

  • Tucker, D. M., Hartry-Speiser, A., McDougal, L., Luu, P., & de Grandpre, D. (1999). Mood and spatial memory: Emotion and the right hemisphere contribution to spatial cognition. Biological Psychology, 50, 103–125.

    Article  PubMed  Google Scholar 

  • Tucker, D. M., Luu, P., Frishkoff, G., Quiring, J., & Poulsen, C. (2003). Frontolimbic response to negative feedback in clinical depression. Journal of Abnormal Psychology, 112, 667–678.

    Article  PubMed  Google Scholar 

  • Tucker, D. M., & Williamson, P. A. (1984). Asymmetric neural control systems in human self-regulation. Psychol Rev, 91(2), 185–215.

    Article  PubMed  Google Scholar 

  • Ullsperger, M., & von Cramon, D. Y. (2001). Subprocesses of performance monitoring: A dissociation of error processing and response competition revealed by event-related fmri and erps. Neuroimage, 14, 1387–1401.

    Article  PubMed  Google Scholar 

  • Vidal, F., Hasbroucq, T., Grapperon, J., & Bonnet, M. (2000). Is the “error negativity’ specific to errors? Biological Psychology, 51, 109–128.

    Article  PubMed  Google Scholar 

  • Vogt, B. A., Sikes, R. W., & Vogt, L. J. (1993). Anterior cingulate cortex and the medial pain system. In B. A. Vogt, & M. Gabriel (Eds.), Neurobiology of the cingulate cortex and limbic thalamus (pp. 314–344). Boston: Birkhäuser.

    Google Scholar 

  • Wamsley, J. K., Zarbin, M. A., Young, W. S., & Kuhar, M. J. (1982). Distribution of opiate receptors in the monkey brain: An autoradiographic study. Neuroscience, 3, 595–613.

    Article  Google Scholar 

  • Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The panas scales. Journal of Personality and Social Psychology, 54, 1063–1070.

    Article  PubMed  Google Scholar 

  • Watson, D., & Pennebaker, J. W. (1989). Health complaints, stress, and distress: Exploring the central role of negative affectivity. Psychological Review, 96, 234–254.

    Article  PubMed  Google Scholar 

  • Williams, Z. M., Bush, G., Rauch, S. L., Cosgrove, G. R., & Eskander, E. N. (2004). Human anterior cingulate neurons and the integration of monetary reward with motor responses. Nature Neuroscience, 7, 1370–1375.

    Article  PubMed  Google Scholar 

  • Wood, M., Daniel, A. M., & Papini, M. R. (2005). Selective effects of the ∂-opiod receptor agonist dpdpe on consumatory successive negative contrast. Behavioral Neuroscience, 119, 446–454.

    Article  PubMed  Google Scholar 

  • Zubieta, J. K., Heitzeg, M. M., Smith, Y. R., Bueller, J. A., Xu, K., Xu, Y., et al. (2003a). Comt val158 met genotype affects μ-opiod neurotransmitter responses to a pain stressor. Science, 299, 1240–1243.

    Article  Google Scholar 

  • Zubieta, J. K., Ketter, T. A., Bueller, J. A., Xu, Y., Kilbourn, M. R., Young, E. A., et al. (2003b). Regulation of human affective responses by anterior cingulate and limbic μ-opioid neurotransmission. Archives of General Psychiatry, 60, 1145–1153.

    Article  Google Scholar 

  • Zubieta, J. K., Smith, Y. R., Bueller, J. A., Xu, Y., Kilbourn, M. R., Jewett, D. M., et al. (2001). Regional mu opioid receptor regulation of sensory and affective dimensions of pain. Science, 293, 311–315.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

We are grateful to Steve Keele for pointing out the importance of modern learning theory for understanding cognitive self-regulation. This research was supported by grants from the National Institute of Mental Health (MH42129 and MH70911) and the Defense Advanced Research Projects Agency (Augmented Cognition Program).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Don M. Tucker.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tucker, D.M., Luu, P. Neurophysiology of Motivated Learning: Adaptive Mechanisms Underlying Cognitive Bias in Depression. Cogn Ther Res 31, 189–209 (2007). https://doi.org/10.1007/s10608-006-9115-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10608-006-9115-9

Keywords

Navigation