Abnormal approach-related motivation but spared reinforcement learning in MDD: Evidence from fronto-midline Theta oscillations and frontal Alpha asymmetry
- 69 Downloads
Major depression is characterized by abnormal reward processing and reinforcement learning (RL). This impairment might stem from deficient motivation processes, in addition to reduced reward sensitivity. In this study, we recorded 64-channel EEG in a large cohort of major depressive disorder (MDD) patients and matched healthy controls (HC) while they performed a standard RL task. Participants were asked to discover, by trial and error, several hidden stimulus-response associations having different reward probabilities, as enforced using evaluative feedback. We extracted induced fronto-midline Theta (FMT) power time-locked to the response and feedback as neurophysiological index of RL. Furthermore, we assessed approach-related motivation by measuring frontal alpha asymmetry concurrently. At the behavioral level, MDD patients and HCs showed comparable RL. At the EEG level, FMT power systematically varied as a function of reward probability, with opposing effects found at the response and feedback levels. Although this global pattern was spared in MDD, at the feedback level these patients showed however a steep FMT power decrease across trials when reward probability was low. Moreover, they showed impaired approach-related motivation during task execution, as reflected by frontal Alpha asymmetry. These results suggest a dissociation between (globally spared) RL and (impaired) approach motivation in MDD.
KeywordsAnhedonia Reinforcement learning Fronto-midline Theta Medial frontal cortex Reward prediction error
The authors thank Ivan Grahek for the guidance in performing and reporting the BMLM statistical analysis and Ladislas Nalborczyk for further support with its implementation.
RDR, CB, and GP are funded by a Concerted Research Action Grant from Ghent University. GP is supported by a 2015 NARSAD Independent Investigator Grant from the Brain & Behavior Research Foundation and by the Research Foundation Flanders (FWO, grant number 3G024716).
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study.
- Barch, D. M., Carter, C. S., Gold, J. M., Johnson, S. L., Kring, A. M., MacDonald, A. W., … Strauss, M. E. (2017). Explicit and implicit reinforcement learning across the psychosis spectrum. Journal of Abnormal Psychology, 126(5), 694–711. https://doi.org/10.1037/abn0000259
- Beck, A., Steer, R., & Brown, G. (1996). Beck Depression Inventory-II (BDI-II). Beck Depression Inventory-II. Retrieved from http://www.pearsonclinical.com/psychology/products/100000159/beck-depression-inventoryii-bdi-ii.html?Pid=015-8018-370
- Bernat, E. M., Nelson, L. D., Steele, V. R., Gehring, W. J., & Patrick, C. J. (2011). Externalizing psychopathology and gain/loss feedback in a simulated gambling task: Dissociable components of brain response revealed by time-frequency analysis. Journal of Abnormal Psychology, 120(2), 352–364. https://doi.org/10.1037/a0022124 Google Scholar
- Cohen, M. X. (2014). Analyzing neural time series data: Theory and practice. MIT Press, Cambrigde.Google Scholar
- Collins, A. G. E., Albrecht, M. A., Waltz, J. A., Gold, J. M., & Frank, M. J. (2017). Interactions among working memory, reinforcement learning, and effort in value-based choice: A new paradigm and selective deficits in schizophrenia. Biological Psychiatry, 82(6), 431–439. https://doi.org/10.1016/j.biopsych.2017.05.017 Google Scholar
- De Raedt, R., Vanderhasselt, M. A., & Baeken, C. (2015). Neurostimulation as an intervention for treatment resistant depression: From research on mechanisms towards targeted neurocognitive strategies. Clinical Psychology Review https://doi.org/10.1016/j.cpr.2014.10.006
- Donner, T. H., & Siegel, M. (2011). A framework for local cortical oscillation patterns. Trends in Cognitive Sciences https://doi.org/10.1016/j.tics.2011.03.007
- Duprat, R., Desmyter, S., Rudi, D. R., Van Heeringen, K., Van Den Abbeele, D., Tandt, H., … Baeken, C. (2016). Accelerated intermittent theta burst stimulation treatment in medication-resistant major depression: A fast road to remission? Journal of Affective Disorders, 200(June), 6–14. https://doi.org/10.1016/j.jad.2016.04.015
- Eppinger, B., Kray, J., Mock, B., & Mecklinger, A. (2008). Better or worse than expected? Aging, learning, and the ERN. Neuropsychologia, 46(2), 521–539. https://doi.org/10.1016/j.neuropsychologia.2007.09.001 Google Scholar
- Fava, M. (2003). Diagnosis and definition of treatment-resistant depression. Biological Psychiatry https://doi.org/10.1016/S0006-3223(03)00231-2
- Foti, D., Weinberg, A., Bernat, E. M., & Proudfit, G. H. (2015). Anterior cingulate activity to monetary loss and basal ganglia activity to monetary gain uniquely contribute to the feedback negativity. Clinical Neurophysiology, 126(7), 1338–1347. https://doi.org/10.1016/j.clinph.2014.08.025 Google Scholar
- Fox, M. D., Buckner, R. L., White, M. P., Greicius, M. D., & Pascual-Leone, A. (2012). Efficacy of transcranial magnetic stimulation targets for depression is related to intrinsic functional connectivity with the subgenual cingulate. Biological Psychiatry, 72(7), 595–603. https://doi.org/10.1016/j.biopsych.2012.04.028 Google Scholar
- Gheza, D., De Raedt, R., Baeken, C., & Pourtois, G. (2018). Integration of reward with cost anticipation during performance monitoring revealed by ERPs and EEG spectral perturbations. NeuroImage, 173. https://doi.org/10.1016/j.neuroimage.2018.02.049
- Hamilton, M. (1980). Rating depressive patients. Journal of Clinical Psychiatry, 41(12 II), 21–24.Google Scholar
- Harmon-Jones, E., & Gable, P. A. (2017). On the role of asymmetric frontal cortical activity in approach and withdrawal motivation: An updated review of the evidence. Psychophysiology, (December 2016). https://doi.org/10.1111/psyp.12879
- Hasler, G., Drevets, W. C., Manji, H. K., & Charney, D. S. (2004). Discovering endophenotypes for major depression. Neuropsychopharmacology https://doi.org/10.1038/sj.npp.1300506
- Kessler, R. C., & Bromet, E. J. (2013). The epidemiology of depression across cultures. Annual Review of Public Health, 34(1), 119–138. https://doi.org/10.1146/annurev-publhealth-031912-114409 Google Scholar
- Kunisato, Y., Okamoto, Y., Ueda, K., Onoda, K., Okada, G., Yoshimura, S., … Yamawaki, S. (2012). Effects of depression on reward-based decision making and variability of action in probabilistic learning. Journal of Behavior Therapy and Experimental Psychiatry, 43(4), 1088–1094. https://doi.org/10.1016/j.jbtep.2012.05.007
- Miller, G. A., Crocker, L. D., Spielberg, J. M., Infantolino, Z. P., & Heller, W. (2013). Issues in localization of brain function: The case of lateralized frontal cortex in cognition, emotion, and psychopathology. Frontiers in Integrative Neuroscience, 7(January), 1–9. https://doi.org/10.3389/fnint.2013.00002 Google Scholar
- Moscovitch, D. A., Santesso, D. L., Miskovic, V., McCabe, R. E., Antony, M. M., & Schmidt, L. A. (2011). Frontal EEG asymmetry and symptom response to cognitive behavioral therapy in patients with social anxiety disorder. Biological Psychology, 87(3), 379–385. https://doi.org/10.1016/j.biopsycho.2011.04.009 Google Scholar
- Nalborczyk, L., Batailler, C., Loevenbruck, H., Vilain, A., & Bürkner, P. C. (in press). An Introduction to Bayesian Multilevel Models Using brms: A Case Study of Gender Effects on Vowel Variability in Standard Indonesian. Journal of Speech, Language, and Hearing Research, (in press).Google Scholar
- Nelson, B. D., Kessel, E. M., Klein, D. N., & Shankman, S. A. (2017). Depression symptom dimensions and asymmetrical frontal cortical activity while anticipating reward. Psychophysiology, (April 2017), 1–14. https://doi.org/10.1111/psyp.12892
- Nusslock, R., Walden, K., & Harmon-Jones, E. (2015). Asymmetrical frontal cortical activity associated with differential risk for mood and anxiety disorder symptoms: An RDoC perspective. International Journal of Psychophysiology, 98(2), 249–261. https://doi.org/10.1016/j.ijpsycho.2015.06.004 Google Scholar
- Pizzagalli, D. A. (2014). Depression, Stress, and Anhedonia: Toward a Synthesis and Integrated Model. Annual Review of Clinical Psychology, 10(1), 393–423. https://doi.org/10.1146/annurev-clinpsy-050212-185606 Google Scholar
- R Core Team. (2017). R. R Core Team. https://doi.org/3-900051-14-3
- Rush, A. J., Thase, M. E., & Dubé, S. (2003). Research issues in the study of difficult-to-treat depression. Biological Psychiatry https://doi.org/10.1016/S0006-3223(03)00088-X
- Rutledge, R. B., Moutoussis, M., Smittenaar, P., Zeidman, P., Taylor, T., Hrynkiewicz, L., … Dolan, R. J. (2017). Association of neural and emotional impacts of reward prediction errors with major depression. JAMA Psychiatry, 74(8), 790. https://doi.org/10.1001/jamapsychiatry.2017.1713
- Smith, E. E., Cavanagh, J. F., & Allen, J. J. B. (2017). Intracranial source activity (eLORETA) related to scalp-level asymmetry scores and depression status. Psychophysiology, (July 2017), 1–16. https://doi.org/10.1111/psyp.13019
- Smith, E. E., Reznik, S. J., Stewart, J. L., & Allen, J. J. B. (2017). Assessing and conceptualizing frontal EEG asymmetry: An updated primer on recording, processing, analyzing, and interpreting frontal alpha asymmetry. International Journal of Psychophysiology, 111, 98–114. https://doi.org/10.1016/j.ijpsycho.2016.11.005 Google Scholar
- Smith, E. H., Banks, G. P., Mikell, C. B., Cash, S. S., Patel, S. R., Eskandar, E. N., & Sheth, S. A. (2015). Frequency-dependent representation of reinforcement-related information in the human medial and lateral prefrontal cortex. Journal of Neuroscience, 35(48), 15827–15836. https://doi.org/10.1523/JNEUROSCI.1864-15.2015 Google Scholar
- Stewart, J. L., Bismark, A. W., Towers, D. N., Coan, J. A., & Allen, J. J. B. (2010). Resting frontal EEG asymmetry as an endophenotype for depression risk: Sex-specific patterns of frontal brain asymmetry. Journal of Abnormal Psychology, 119(3), 502–512. https://doi.org/10.1037/a0019196 Google Scholar
- Stewart, J. L., Coan, J. A., Towers, D. N., & Allen, J. J. B. (2011). Frontal EEG asymmetry during emotional challenge differentiates individuals with and without lifetime major depressive disorder. Journal of Affective Disorders, 129(1–3), 167–174. https://doi.org/10.1016/j.jad.2010.08.029 Google Scholar
- The MathWorks Inc. (2013). MATLAB. Natick, MA, USA. https://doi.org/10.1201/9781420034950
- van de Vijver, I., Cohen, M. X., & Ridderinkhof, K. R. (2014). Aging affects medial but not anterior frontal learning-related theta oscillations. Neurobiology of Aging, 35(3), 692–704. https://doi.org/10.1016/j.neurobiolaging.2013.09.006 Google Scholar
- Vrieze, E., Pizzagalli, D. A., Demyttenaere, K., Hompes, T., Sienaert, P., De Boer, P., … Claes, S. (2013). Reduced reward learning predicts outcome in major depressive disorder. Biological Psychiatry, 73(7), 639–645. https://doi.org/10.1016/j.biopsych.2012.10.014
- Weinberg, A., & Shankman, S. A. (2016). Blunted reward processing in remitted melancholic depression. Clinical Psychological Science, 2167702616633158. https://doi.org/10.1177/2167702616633158
- Whitton, A. E., Kakani, P., Foti, D., Van’t Veer, A., Haile, A., Crowley, D. J., & Pizzagalli, D. A. (2016). Blunted neural responses to reward in remitted major depression: A high-density event-related potential study. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 1(1), 87–95. https://doi.org/10.1016/j.bpsc.2015.09.007 Google Scholar