Abstract
The reward after-effect of effort expenditure refers to the phenomenon that previous effort investment changes the subjective value of rewards when obtained. However, the neural mechanisms underlying the after-effects of effort exertion are still not fully understood. We investigated the modulation of reward after-effects by effort type (cognitive vs. physical) through the lens of neural dynamics. Thirty-two participants performed a physically or cognitively demanding task during an effort phase and then played a simple gambling game during a subsequent reward phase to earn monetary rewards while their electroencephalogram (EEG) was recorded. We found that previous effort expenditure decreased electrocortical activity during feedback evaluation. Importantly, this effort effect occurred in a domain-general manner during the early stage (as indexed by the reward positivity) but in a domain-specific manner during the later and more elaborative stage (as indexed by the P3 and delta oscillation) of reward evaluation. Additionally, effort expenditure enhanced P3 sensitivity to feedback valence regardless of effort type. Our findings suggest that cognitive and physical effort, although bearing some surface resemblance to each other, may have dissociable neural influences on the reward after-effects.
Similar content being viewed by others
Data availability
Data are not openly available; however, EEG scripts can be made available upon request. This study was not preregistered.
Notes
A repeated-measures ANOVA with effort type and effort level as within-subjects factors revealed that failed trials were significantly more in the high-effort condition than the low-effort condition, F(1, 31) = 129.00, p < .001, ηp2 = .81, and in the cognitive task than in the physical task, F(1, 31) = 34.36, p < .001, ηp2 = .53. A significant interaction between effort type and effort level, F(1, 31) = 8.60, p = .006, ηp2 = .22, revealed that increased failed trials as a function of effort level was more pronounced in the cognitive task, t(32) = 10.72, p < .001, Cohen’s d = 1.57, than in the physical task, t(32) = 5.39, p < .001, Cohen’s d = 0.90.
Because the two tasks were different and the difficulty was not equated, we standardized the RT data across high and low effort trials within participants for each task and then analyzed the standardized data by using an Effort Type × Effort Level ANOVA. Like the subtraction approach, the interaction between effort type and effort level remained significant, F(1, 31) = 54.90, p < .001, ηp2 = .64. We also analyzed RT data accumulated across successful and failed trials using an Effort Type × Effort Level ANOVA. Results revealed that RTs were significantly slower in the high-effort condition than the low-effort condition, F(1, 31) = 462.46, p < .001, ηp2 = .94. However, neither the main effect of effort type, F(1, 31) = 0.47, p = .498, ηp2 = .01, nor the interaction between effort type and effort level, F(1, 31) = 1.25, p = .271, ηp2 = .04, reached significance. These results suggest that participants invested comparable amounts of time into the cognitive and physical tasks.
References
Ait Oumeziane, B., Jones, O., Foti, D. (2019). Neural sensitivity to social and monetary reward in depression: Clarifying general and domain-specific deficits. Frontiers in Behavioral Neuroscience, 13. https://doi.org/10.3389/fnbeh.2019.00199
Arkes, H., Joyner, C., Pezzo, M., & Nash, J. (1994). The psychology of windfall gains. Organizational Behavior and Human Decision Processes, 59, 331–347. https://doi.org/10.1006/obhd.1994.1063
Aronson, E., & Mills, J. (1959). The effect of severity of initiation on liking for a group. The Journal of Abnormal and Social Psychology, 59(2), 177–181. https://doi.org/10.1037/h0047195
Atkins, K. J., Andrews, S. C., Stout, J. C., & Chong, T. T. (2020). Dissociable motivational deficits in pre-manifest huntington's disease. Cell Reports Medicine, 1(9), 100152. https://doi.org/10.1016/j.xcrm.2020.100152
Becker, M., Nitsch, A., Miltner, W., & Straube, T. (2014). A single-trial estimation of the feedback-related negativity and its relation to BOLD responses in a time-estimation task. The Journal of Neuroscience, 34, 3005–3012. https://doi.org/10.1523/JNEUROSCI.3684-13.2014
Bernat, E., Nelson, L., Baskin-Sommers, A. (2015). Time-frequency theta and delta measures index separable components of feedback processing in a gambling task. Psychophysiology, 52. https://doi.org/10.1111/psyp.12390
Bogdanov, M., Renault, H., LoParco, S., Weinberg, A., & Otto, A. R. (2022). Cognitive effort exertion enhances electrophysiological responses to rewarding outcomes. Cereb Cortex, 32(19), 4255–4270. https://doi.org/10.1093/cercor/bhab480
Botvinick, M., Huffstetler, S., & McGuire, J. (2009). Effort discounting in human nucleus accumbens. Cognitive Affective & Behavioral Neuroscience, 9(1), 16–27. https://doi.org/10.3758/CABN.9.1.16
Bowyer, C., Brush, C., Threadgill, H., Harmon-Jones, E., Treadway, M., Patrick, C., & Hajcak, G. (2021). The effort-doors task: Examining the temporal dynamics of effort-based reward processing using ERPs. NeuroImage, 228, 117656. https://doi.org/10.1016/j.neuroimage.2020.117656
Carlson, J., Foti, D., Mujica-Parodi, L., Harmon-Jones, E., & Hajcak, G. (2011). Ventral striatal and medial prefrontal BOLD activation is correlated with reward-related electrocortical activity: A combined ERP and fMRI study. NeuroImage, 57, 1608–1616. https://doi.org/10.1016/j.neuroimage.2011.05.037
Cavanagh, J., Frank, M. (2014). Frontal theta as a mechanism for cognitive control. Trends in Cognitive Sciences, 18. https://doi.org/10.1016/j.tics.2014.04.012
Cavanagh, J. (2015). Cortical delta activity reflects reward prediction error and related behavioral adjustments, but at different times. NeuroImage, 110. https://doi.org/10.1016/j.neuroimage.2015.02.007
Chong, T., Bonnelle, V., & Husain, M. (2016). Quantifying motivation with effort-based decision-making paradigms in health and disease. Progress in Brain Research, 229, 71–100. https://doi.org/10.1016/bs.pbr.2016.05.002
Chong, T., Apps, M., Giehl, K., Sillence, A., Grima, L., & Husain, M. (2017). Neurocomputational mechanisms underlying subjective valuation of effort costs. Plos Biology, 15(2), e1002598. https://doi.org/10.1371/journal.pbio.1002598
Croxson, P., Walton, M., O'Reilly, J., Behrens, T., & Rushworth, M. (2009). Effort-based cost-benefit valuation and the human brain. The Journal of Neuroscience, 29(14), 4531–4541. https://doi.org/10.1523/JNEUROSCI.4515-08.2009
Culbreth, A. J., Dershwitz, S. D., Barch, D. M., & Moran, E. K. (2023). Associations between cognitive and physical effort-based decision making in people with schizophrenia and healthy control subjects. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 8(7), 695–702. https://doi.org/10.1016/j.bpsc.2023.02.003
Delorme, A., & Makeig, S. (2004). EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of Neuroscience Methods, 134(1), 9–21. https://doi.org/10.1016/j.jneumeth.2003.10.009
Dobryakova, E., Jessup, R., & Tricomi, E. (2017). Modulation of ventral striatal activity by cognitive effort. NeuroImage, 147, 330–338. https://doi.org/10.1016/j.neuroimage.2016.12.029
Ethridge, P., Kujawa, A., Dirks, M., Arfer, K., Kessel, E., Klein, D., Weinberg, A. (2017). Neural responses to social and monetary reward in early adolescence and emerging adulthood. Psychophysiology, 54. https://doi.org/10.1111/psyp.12957
Faul, F., Erdfelder, E., Lang, A. G., & Buchner, A. (2007). G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191. https://doi.org/10.3758/bf03193146
Gheza, D., De Raedt, R., Baeken, C., Pourtois, G. (2018). Integration of reward with cost anticipation during performance monitoring revealed by ERPs and EEG spectral perturbations. NeuroImage, 173. https://doi.org/10.1016/j.neuroimage.2018.02.049
Hajcak, G., Moser, J. S., Holroyd, C. B., & Simons, R. F. (2006). The feedback-related negativity reflects the binary evaluation of good versus bad outcomes. Biological Psychology, 71(2), 148–154. https://doi.org/10.1016/j.biopsycho.2005.04.001
Harmon-Jones, E., Clarke, D., Paul, K., & Harmon-Jones, C. (2020). The effect of perceived effort on reward valuation: Taking the reward positivity (RewP) to dissonance theory. Frontiers in Human Neuroscience, 14, 157. https://doi.org/10.3389/fnhum.2020.00157
Harmon-Jones, E., Willoughby, C., Paul, K., & Harmon-Jones, C. (2020). The effect of perceived effort and perceived control on reward valuation: Using the reward positivity to test a dissonance theory prediction. Biological Psychology, 154, 107910. https://doi.org/10.1016/j.biopsycho.2020.107910
Hernandez Lallement, J., Kuss, K., Trautner, P., Weber, B., Falk, A., & Fliessbach, K. (2014). Effort increases sensitivity to reward and loss magnitude in the human brain. Social Cognitive and Affective Neuroscience, 9(3), 342–349. https://doi.org/10.1093/scan/nss147
Holroyd, C. B., & Coles, M. G. H. (2002). The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109(4), 679–709. https://doi.org/10.1037//0033-295x.109.4.679
Holroyd, C. B., & Umemoto, A. (2016). The research domain criteria framework: The case for anterior cingulate cortex. Neuroscience & Biobehavioral Reviews, 71, 418–443. https://doi.org/10.1016/j.neubiorev.2016.09.021
Hosking, J., Floresco, S., & Winstanley, C. (2015). Dopamine antagonism decreases willingness to expend physical, but not cognitive, effort: A comparison of two rodent cost/benefit decision-making tasks. Neuropsychopharmacology, 40(4), 1005–1015. https://doi.org/10.1038/npp.2014.285
Hull, C. Leonard. (1943). Principles of behavior: An introduction to behavior theory. The Journal of Abnormal and Social Psychology, 377-380. https://doi.org/10.1037/h0051597
Husain, M., & Roiser, J. P. (2018). Neuroscience of apathy and anhedonia: A transdiagnostic approach. Nature Reviews Neuroscience, 19(8), 470–484. https://doi.org/10.1038/s41583-018-0029-9
Inzlicht, M., Shenhav, A., & Olivola, C. (2018). The effort paradox: Effort is both costly and valued. Trends in Cognitive Sciences, 22(4), 337–349. https://doi.org/10.1016/j.tics.2018.01.007
Kool, W., & Botvinick, M. (2018). Mental labour. Nature Human Behaviour, 2(12), 899–908. https://doi.org/10.1038/s41562-018-0401-9
Kool, W., McGuire, J., Rosen, Z., & Botvinick, M. (2010). Decision making and the avoidance of cognitive demand. Journal of Experimental Psychology General, 139(4), 665–682. https://doi.org/10.1037/a0020198
Kurniawan, I., Guitart-Masip, M., Dayan, P., & Dolan, R. (2013). Effort and valuation in the brain: The effects of anticipation and execution. The Journal of Neuroscience, 33(14), 6160–6169. https://doi.org/10.1523/JNEUROSCI.4777-12.2013
Levy, D. J., & Glimcher, P. W. (2012). The root of all value: A neural common currency for choice. Current Opinion in Neurobiology, 22(6), 1027–1038. https://doi.org/10.1016/j.conb.2012.06.001
Lopez-Gamundi, P., & Wardle, M. (2018). The cognitive effort expenditure for rewards task (C-EEfRT): A novel measure of willingness to expend cognitive effort. Psychological Assessment, 30(9), 1237–1248. https://doi.org/10.1037/pas0000563
Lopez-Gamundi, P., Yao, Y.-W., Chong, T., Heekeren, H., Mas-Herrero, E., & Marco-Pallarés, J. (2021). The neural basis of effort valuation: A meta-analysis of functional magnetic resonance imaging studies. Neuroscience & Biobehavioral Reviews, 131, 1275–1287. https://doi.org/10.1016/j.neubiorev.2021.10.024
Luck, S., Gaspelin, N. (2017). How to get statistically significant effects in any ERP experiment (and why you shouldn’t). Psychophysiology, 54. https://doi.org/10.1111/psyp.12639
Ma, Q., Meng, L., Wang, L., & Shen, Q. (2014). I endeavor to make it: Effort increases valuation of subsequent monetary reward. Behavioural Brain Research, 261, 1–7. https://doi.org/10.1016/j.bbr.2013.11.045
Marco-Pallares, J., Cucurell, D., Munte, T. F., Strien, N., & Rodriguez-Fornells, A. (2011). On the number of trials needed for a stable feedback-related negativity. Psychophysiology, 48(6), 852–860. https://doi.org/10.1111/j.1469-8986.2010.01152.x
Meyer, G., Marco-Pallarés, J., Boulinguez, P., & Sescousse, G. (2021). Electrophysiological underpinnings of reward processing: Are we exploiting the full potential of EEG? NeuroImage, 242, 118478. https://doi.org/10.1016/j.neuroimage.2021.118478
Milyavskaya, M., Inzlicht, M., Johnson, T., & Larson, M. J. (2019). Reward sensitivity following boredom and cognitive effort: A high-powered neurophysiological investigation. Neuropsychologia, 123, 159–168. https://doi.org/10.1016/j.neuropsychologia.2018.03.033
Monsell, S. (2003). Task switching. Trends in Cognitive Sciences, 7(3), 134–140. https://doi.org/10.1016/s1364-6613(03)00028-7
Morsella, E., Feinberg, G., Cigarchi, S., Newton, J., & Williams, L. (2011). Sources of avoidance motivation: Valence effects from physical effort and mental rotation. Motivation and Emotion, 35, 296–305. https://doi.org/10.1007/s11031-010-9172-y
Muehlbacher, S., & Kirchler, E. (2009). Origin of endowments in public good games: The impact of effort on contributions. Journal of Neuroscience, Psychology, and Economics, 2(1), 59–67. https://doi.org/10.1037/a0015458
Nieuwenhuis, S., Aston-Jones, G., & Cohen, J. D. (2005). Decision making, the P3, and the locus coeruleus-norepinephrine system. Psychological Bulletin, 131(4), 510–532. https://doi.org/10.1037/0033-2909.131.4.510
Norton, M., & Mochon, D. (2012). The IKEA effect: When labor leads to love. Journal of Consumer Psychology, 22, 453–460. https://doi.org/10.1016/j.jcps.2011.08.002
Palidis, D. J., & Gribble, P. L. (2020). EEG correlates of physical effort and reward processing during reinforcement learning. Journal of Neurophysiology, 124(2), 610–622. https://doi.org/10.1152/jn.00370.2020
Pion-Tonachini, L., Kreutz-Delgado, K., & Makeig, S. (2019). ICLabel: An automated electroencephalographic independent component classifier, dataset, and website. NeuroImage, 198, 181–197. https://doi.org/10.1016/j.neuroimage.2019.05.026
Proudfit, G. H. (2015). The reward positivity: From basic research on reward to a biomarker for depression. Psychophysiology, 52(4), 449–459. https://doi.org/10.1111/psyp.12370
Reddy, L. F., Horan, W. P., Barch, D. M., Buchanan, R. W., Gold, J. M., Marder, S. R., ..., & Green, M. F. (2017). Understanding the association between negative symptoms and performance on effort-based decision-making tasks: The importance of defeatist performance beliefs. Schizophrenia Bulletin, 44(6), 1217–1226. https://doi.org/10.1093/schbul/sbx156
Schmidt, L., Lebreton, M., Clery-Melin, M. L., Daunizeau, J., & Pessiglione, M. (2012). Neural mechanisms underlying motivation of mental versus physical effort. Plos Biology, 10(2), e1001266. https://doi.org/10.1371/journal.pbio.1001266
Schmidt, B., Mussel, P., Osinsky, R., Rasch, B., Debener, S., & Hewig, J. (2017). Work first then play: Prior task difficulty increases motivation-related brain responses in a risk game. Biological Psychology, 126, 82–88. https://doi.org/10.1016/j.biopsycho.2017.04.010
Shenhav, A., Botvinick, M., & Cohen, J. (2013). The expected value of control: An integrative theory of anterior cingulate cortex function. Neuron, 79, 217–240. https://doi.org/10.1016/j.neuron.2013.07.007
Soutschek, A., Tobler, P. (2018). Motivation for the greater good: Neural mechanisms of overcoming costs. Current Opinion in Behavioral Sciences, 22. https://doi.org/10.1016/j.cobeha.2018.01.025
Tran, T., Hagen, A. E. F., Hollenstein, T., & Bowie, C. R. (2021). Physical- and cognitive-effort-based decision-making in depression: Relationships to symptoms and functioning. Clinical Psychological Science, 9(1), 53–67. https://doi.org/10.1177/2167702620949236
Treadway, M. T., Buckholtz, J. W., Schwartzman, A. N., Lambert, W. E., & Zald, D. H. (2009). Worth the "EEfRT"? The effort expenditure for rewards task as an objective measure of motivation and anhedonia. Plos One, 4(8), e6598. https://doi.org/10.1371/journal.pone.0006598
Umemoto, A., Lin, H., Holroyd, C. B. (2022). Electrophysiological measures of conflict and reward processing are associated with decisions to engage in physical effort. Psychophysiology, e14176. https://doi.org/10.1111/psyp.14176
Walsh, M. M., & Anderson, J. R. (2012). Learning from experience: Event-related potential correlates of reward processing, neural adaptation, and behavioral choice. Neuroscience & Biobehavioral Reviews, 36(8), 1870–1884. https://doi.org/10.1016/j.neubiorev.2012.05.008
Walton, M. E., Kennerley, S. W., Bannerman, D. M., Phillips, P. E. M., & Rushworth, M. F. S. (2006). Weighing up the benefits of work: Behavioral and neural analyses of effort-related decision making. Neural Networks, 19(8), 1302–1314. https://doi.org/10.1016/j.neunet.2006.03.005
Westbrook, A., & Braver, T. S. (2015). Cognitive effort: A neuroeconomic approach. Cognitive Affective & Behavioral Neuroscience, 15(2), 395–415. https://doi.org/10.3758/s13415-015-0334-y
Westbrook, A., Kester, D., & Braver, T. (2013). What is the subjective cost of cognitive effort? Load, trait, and aging effects revealed by economic preference. Plos One, 8(7), e68210. https://doi.org/10.1371/journal.pone.0068210
Westbrook, A., Lamichhane, B., & Braver, T. (2019). The subjective value of cognitive effort is encoded by a domain-general valuation network. The Journal of Neuroscience, 39(20), 3934–3947. https://doi.org/10.1523/JNEUROSCI.3071-18.2019
Wu, M., Zheng, Y. (2023). Physical effort paradox during reward evaluation and links to perceived control. Cerebral Cortex. https://doi.org/10.1093/cercor/bhad207
Yi, W., Mei, S., Zhang, M., & Zheng, Y. (2020). Decomposing the effort paradox in reward processing: Time matters. Neuropsychologia, 137, 107311. https://doi.org/10.1016/j.neuropsychologia.2019.107311
Zentall, T. R. (2010). Justification of effort by humans and pigeons: Cognitive dissonance or contrast? Current Directions in Psychological Science, 19(5), 296–300. https://doi.org/10.1177/0963721410383381
Funding
This work was supported by the National Natural Science Foundation of China (31971027).
Author information
Authors and Affiliations
Contributions
Huiping Jiang: Data curation; formal analysis; investigation; methodology; visualization; writing—original draft. Ya Zheng: Conceptualization; funding acquisition; supervision; writing—review and editing.
Corresponding author
Ethics declarations
Conflicts of interests
The authors declare no conflicts of interests.
Ethics approval
Ethics approval was awarded by the Institutional Review Board of Dalian Medical University.
Consent to participate
Informed consent was obtained from all individual participants included in the study.
Consent to publication
Participants consented for anonymized data to be available on online repositories and to be published in peer-reviewed journals.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Jiang, H., Zheng, Y. Dissociable neural after-effects of cognitive and physical effort expenditure during reward evaluation. Cogn Affect Behav Neurosci 23, 1500–1512 (2023). https://doi.org/10.3758/s13415-023-01131-2
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3758/s13415-023-01131-2