Abstract
The motivation to strive for and consume primary rewards such as palatable food is bound by devaluation mechanisms, yet secondary rewards such as money may not be bound by these regulatory mechanisms. The present study therefore aimed at determining diverging devaluation trajectories for primary (chocolate milk) and secondary (money) reinforcers on the behavioral and neural level. Devaluation procedures with repeated exposure to reward combined with a choice (Experiment 1) and an incentive delay (Experiment 2) paradigm consistently revealed decreasing hedonic value for the primary reward as reflected by decreasing hedonic evaluation and choice preference with repeated receipt, while hedonic value and preferences for the secondary reward increased. Concomitantly acquired functional near-infrared spectroscopy (fNIRS) data during the incentive delay paradigm revealed that increasing value of the secondary reward was accompanied by increasing anticipatory activation in the lateral orbitofrontal cortex, while during the consummatory phase the secondary reinforcer associated with higher medial orbitofrontal activity irrespective of devaluation stage. Overall, the findings suggest that—in contrast to primary reinforcers—secondary reinforcers, i.e. money, can acquire progressively enhanced incentive motivation with repeated receipt, suggesting a mechanism which could promote escalating striving to obtain secondary rewards.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data and code availability
The neuroimaging data analyzed during the current study are available in the Open Science Framework, (https://osf.io/ney35/, https://doi.org/10.17605/OSF.IO/NEY35).
References
Ahmed SH, Koob GF (1998) Transition from moderate to excessive drug intake: change in hedonic set point. Science 282:298–300. https://doi.org/10.1126/science.282.5387.298
Alonso-Alonso M et al (2015) Food reward system: current perspectives and future research needs. Nutr Rev 73:296–307. https://doi.org/10.1093/nutrit/nuv002
Al-Shargie F, Tang TB, Kiguchi M (2017) Stress assessment based on decision fusion of EEG and fNIRS signals. IEEE Access 5:19889–19896. https://doi.org/10.1109/ACCESS.2017.2754325
Balleine BW, Dickinson A (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37:407–419. https://doi.org/10.1016/s0028-3908(98)00033-1
Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Roy Stat Soc: Ser B (methodol) 57:289–300. https://doi.org/10.1111/j.2517-6161.1995.tb02031.x
Berridge KC, Robinson TE (2016) Liking, wanting, and the incentive-sensitization theory of addiction. Am Psychol 71:670–679. https://doi.org/10.1037/amp0000059
Bradfield LA, Hart G (2020) Rodent medial and lateral orbitofrontal cortices represent unique components of cognitive maps of task space. Neurosci Biobehav Rev 108:287–294. https://doi.org/10.1016/j.neubiorev.2019.11.009
Chaput JP, Klingenberg L, Astrup A, Sjödin AM (2011) Modern sedentary activities promote overconsumption of food in our current obesogenic environment. Obes Rev 12:e12-20. https://doi.org/10.1111/j.1467-789X.2010.00772.x
Chudasama Y, Robbins TW (2003) Dissociable contributions of the orbitofrontal and infralimbic cortex to pavlovian autoshaping and discrimination reversal learning: further evidence for the functional heterogeneity of the rodent frontal cortex. J Neurosci 23:8771–8780. https://doi.org/10.1523/jneurosci.23-25-08771.2003
Crossley M, Staras K, Kemenes G (2016) A two-neuron system for adaptive goal-directed decision-making in Lymnaea. Nat Commun 7:11793. https://doi.org/10.1038/ncomms11793
de Araujo IE, Kringelbach ML, Rolls ET, McGlone F (2003a) Human cortical responses to water in the mouth, and the effects of thirst. J Neurophysiol 90:1865–1876. https://doi.org/10.1152/jn.00297.2003
de Araujo IE, Rolls ET, Kringelbach ML, McGlone F, Phillips N (2003b) Taste-olfactory convergence, and the representation of the pleasantness of flavour, in the human brain. Eur J Neurosci 18:2059–2068. https://doi.org/10.1046/j.1460-9568.2003.02915.x
Deco G, Rolls ET, Albantakis L, Romo R (2013) Brain mechanisms for perceptual and reward-related decision-making. Prog Neurobiol 103:194–213. https://doi.org/10.1016/j.pneurobio.2012.01.010
Delpy DT, Cope M, Pvd Z, Arridge S, Wray S, Wyatt J (1988) Estimation of optical pathlength through tissue from direct time of flight measurement. Phys Med Biol 33:1433–1442. https://doi.org/10.1088/0031-9155/33/12/008
Dhingra I et al (2020) The effects of age on reward magnitude processing in the monetary incentive delay task. Neuroimage 207:116368. https://doi.org/10.1016/j.neuroimage.2019.116368
Diekhof EK, Kaps L, Falkai P, Gruber O (2012) The role of the human ventral striatum and the medial orbitofrontal cortex in the representation of reward magnitude—an activation likelihood estimation meta-analysis of neuroimaging studies of passive reward expectancy and outcome processing. Neuropsychologia 50:1252–1266. https://doi.org/10.1016/j.neuropsychologia.2012.02.007
DiLeone RJ (2009) The influence of leptin on the dopamine system and implications for ingestive behavior. Int J Obes (lond) 33(Suppl 2):S25-29. https://doi.org/10.1038/ijo.2009.68
Elliott R, Agnew Z, Deakin JF (2008) Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans. Eur J Neurosci 27:2213–2218. https://doi.org/10.1111/j.1460-9568.2008.06202.x
Freckmann G et al (2010) System accuracy evaluation of 27 blood glucose monitoring systems according to DIN EN ISO 15197. Diabetes Technol Ther 12:221–231. https://doi.org/10.1089/dia.2009.0128
Friston KJ, Holmes AP, Worsley KJ, Poline J-P, Frith CD, Frackowiak RSJ (1994) Statistical parametric maps in functional imaging: a general linear approach. Hum Brain Mapp 2:189–210. https://doi.org/10.1002/hbm.460020402
Friston KJ, Josephs O, Zarahn E, Holmes AP, Rouquette S, Poline J (2000) To smooth or not to smooth? Bias and efficiency in fMRI time-series analysis. Neuroimage 12:196–208. https://doi.org/10.1006/nimg.2000.0609
Haber SN (2016) Corticostriatal circuitry. Dialogues Clin Neurosci 18:7–21. https://doi.org/10.31887/DCNS.2016.18.1/shaber
Hahn C, Wilson TD, McRae K, Gilbert DT (2013) “Show me the money”: vulnerability to gambling moderates the attractiveness of money versus suspense. Pers Soc Psychol Bull 39:1259–1267. https://doi.org/10.1177/0146167213492431
Hervig ME et al (2020) Dissociable and paradoxical roles of rat medial and lateral orbitofrontal cortex in visual serial reversal learning. Cereb Cortex 30:1016–1029. https://doi.org/10.1093/cercor/bhz144
Horstmann A, Dietrich A, Mathar D, Pössel M, Villringer A, Neumann J (2015) Slave to habit? Obesity is associated with decreased behavioural sensitivity to reward devaluation. Appetite 87:175–183. https://doi.org/10.1016/j.appet.2014.12.212
Howard JD, Kahnt T (2017) Identity-specific reward representations in orbitofrontal cortex are modulated by selective devaluation. J Neurosci 37:2627–2638. https://doi.org/10.1523/jneurosci.3473-16.2017
Izquierdo A (2017) Functional heterogeneity within rat orbitofrontal cortex in reward learning and decision making. J Neurosci 37:10529–10540. https://doi.org/10.1523/jneurosci.1678-17.2017
Jasper H (1958) Report of the committee on methods of clinical examination in electroencephalography. Electroencephalogr Clin Neurophysiol 10:370–375
Kim HY, Seo K, Jeon HJ, Lee U, Lee H (2017) Application of functional near-infrared spectroscopy to the study of brain function in humans and animal models. Mol Cells 40:523–532. https://doi.org/10.14348/molcells.2017.0153
Kringelbach ML, O’Doherty J, Rolls ET, Andrews C (2003) Activation of the human orbitofrontal cortex to a liquid food stimulus is correlated with its subjective pleasantness. Cereb Cortex 13:1064–1071. https://doi.org/10.1093/cercor/13.10.1064
Lea SE, Webley P (2006) Money as tool, money as drug: the biological psychology of a strong incentive. Behav Brain Sci 29:161–176. https://doi.org/10.1017/s0140525x06009046 (discussion 176–209)
Leyton M, Boileau I, Benkelfat C, Diksic M, Baker G, Dagher A (2002) Amphetamine-induced increases in extracellular dopamine, drug wanting, and novelty seeking: a PET/[11C] raclopride study in healthy men. Neuropsychopharmacology 27:1027–1035. https://doi.org/10.1016/s0893-133x(02)00366-4
Li K et al (2019a) Functional near-infrared spectroscopy-informed neurofeedback: regional-specific modulation of lateral orbitofrontal activation and cognitive flexibility. Neurophotonics 6:025011. https://doi.org/10.1117/1.NPh.6.2.025011
Li LP, Liu ZG, Zhu HY, Zhu L, Huang YC (2019b) Functional near-infrared spectroscopy in the evaluation of urban rail transit drivers’ mental workload under simulated driving conditions. Ergonomics 62:406–419. https://doi.org/10.1080/00140139.2018.1535093
Linnet J, Peterson E, Doudet DJ, Gjedde A, Møller A (2010) Dopamine release in ventral striatum of pathological gamblers losing money. Acta Psychiatr Scand 122:326–333. https://doi.org/10.1111/j.1600-0447.2010.01591.x
Lloyd-Fox S, Blasi A, Elwell CE (2010) Illuminating the developing brain: the past, present and future of functional near infrared spectroscopy. Neurosci Biobehav Rev 34:269–284. https://doi.org/10.1016/j.neubiorev.2009.07.008
Martin-Soelch C et al (2011) Lateralization and gender differences in the dopaminergic response to unpredictable reward in the human ventral striatum. Eur J Neurosci 33:1706–1715. https://doi.org/10.1111/j.1460-9568.2011.07642.x
Minematsu Y, Ueji K, Yamamoto T (2018) Activity of frontal pole cortex reflecting hedonic tone of food and drink: fNIRS study in humans. Sci Rep 8:16197. https://doi.org/10.1038/s41598-018-34690-3
Mohanty A, Gitelman DR, Small DM, Mesulam MM (2008) The spatial attention network interacts with limbic and monoaminergic systems to modulate motivation-induced attention shifts. Cereb Cortex 18:2604–2613. https://doi.org/10.1093/cercor/bhn021
Murray EA, Moylan EJ, Saleem KS, Basile BM, Turchi J (2015) Specialized areas for value updating and goal selection in the primate orbitofrontal cortex. Elife. https://doi.org/10.7554/eLife.11695
Nogueira R, Abolafia JM, Drugowitsch J, Balaguer-Ballester E, Sanchez-Vives MV, Moreno-Bote R (2017) Lateral orbitofrontal cortex anticipates choices and integrates prior with current information. Nat Commun 8:14823. https://doi.org/10.1038/ncomms14823
Noonan MP, Mars RB, Rushworth MF (2011) Distinct roles of three frontal cortical areas in reward-guided behavior. J Neurosci 31:14399–14412. https://doi.org/10.1523/jneurosci.6456-10.2011
Noonan MP, Kolling N, Walton ME, Rushworth MF (2012) Re-evaluating the role of the orbitofrontal cortex in reward and reinforcement. Eur J Neurosci 35:997–1010. https://doi.org/10.1111/j.1460-9568.2012.08023.x
Noonan MP, Chau BKH, Rushworth MFS, Fellows LK (2017) Contrasting effects of medial and lateral orbitofrontal cortex lesions on credit assignment and decision-making in humans. J Neurosci 37:7023–7035. https://doi.org/10.1523/jneurosci.0692-17.2017
O’Doherty J et al (2000) Sensory-specific satiety-related olfactory activation of the human orbitofrontal cortex. NeuroReport 11:893–897. https://doi.org/10.1097/00001756-200003200-00046
O’Doherty J, Kringelbach ML, Rolls ET, Hornak J, Andrews C (2001) Abstract reward and punishment representations in the human orbitofrontal cortex. Nat Neurosci 4:95–102. https://doi.org/10.1038/82959
Okamoto M et al (2004) Three-dimensional probabilistic anatomical cranio-cerebral correlation via the international 10–20 system oriented for transcranial functional brain mapping. Neuroimage 21:99–111. https://doi.org/10.1016/j.neuroimage.2003.08.026
Oldham S, Murawski C, Fornito A, Youssef G, Yücel M, Lorenzetti V (2018) The anticipation and outcome phases of reward and loss processing: a neuroimaging meta-analysis of the monetary incentive delay task. Hum Brain Mapp 39:3398–3418. https://doi.org/10.1002/hbm.24184
Panayi MC, Killcross S (2018) Functional heterogeneity within the rodent lateral orbitofrontal cortex dissociates outcome devaluation and reversal learning deficits. Elife. https://doi.org/10.7554/eLife.37357
Petrovic P, Castellanos FX (2016) Top-down dysregulation-from ADHD to emotional instability. Front Behav Neurosci 10:70. https://doi.org/10.3389/fnbeh.2016.00070
Plata-Salamán CR (1991) Regulation of hunger and satiety in man. Dig Dis 9:253–268. https://doi.org/10.1159/000171310
Reichelt AC, Morris MJ, Westbrook RF (2014) Cafeteria diet impairs expression of sensory-specific satiety and stimulus-outcome learning. Front Psychol 5:852. https://doi.org/10.3389/fpsyg.2014.00852
Riveros ME, Forray MI, Torrealba F, Valdés JL (2019) Effort displayed during appetitive phase of feeding behavior requires infralimbic cortex activity and histamine H1 receptor signaling. Front Neurosci 13:577. https://doi.org/10.3389/fnins.2019.00577
Rolls BJ (1986) Sensory-specific satiety. Nutr Rev 44:93–101. https://doi.org/10.1111/j.1753-4887.1986.tb07593.x
Rolls BJ, Rolls ET, Rowe EA, Sweeney K (1981) Sensory specific satiety in man. Physiol Behav 27:137–142. https://doi.org/10.1016/0031-9384(81)90310-3
Rolls ET, Kringelbach ML, de Araujo IE (2003) Different representations of pleasant and unpleasant odours in the human brain. Eur J Neurosci 18:695–703. https://doi.org/10.1046/j.1460-9568.2003.02779.x
Rudebeck PH, Rich EL (2018) Orbitofrontal cortex. Curr Biol 28:R1083–R1088. https://doi.org/10.1016/j.cub.2018.07.018
Rudebeck PH, Saunders RC, Lundgren DA, Murray EA (2017) Specialized representations of value in the orbital and ventrolateral prefrontal cortex: desirability versus availability of outcomes. Neuron 95:1208-1220.e1205. https://doi.org/10.1016/j.neuron.2017.07.042
Salimpoor VN, Benovoy M, Larcher K, Dagher A, Zatorre RJ (2011) Anatomically distinct dopamine release during anticipation and experience of peak emotion to music. Nat Neurosci 14:257–262. https://doi.org/10.1038/nn.2726
Saper CB, Chou TC, Elmquist JK (2002) The need to feed: homeostatic and hedonic control of eating. Neuron 36:199–211. https://doi.org/10.1016/s0896-6273(02)00969-8
Scarapicchia V, Brown C, Mayo C, Gawryluk JR (2017) Functional magnetic resonance imaging and functional near-infrared spectroscopy: insights from combined recording studies. Front Hum Neurosci 11:419. https://doi.org/10.3389/fnhum.2017.00419
Scholkmann F, Spichtig S, Muehlemann T, Wolf M (2010) How to detect and reduce movement artifacts in near-infrared imaging using moving standard deviation and spline interpolation. Physiol Meas 31:649–662. https://doi.org/10.1088/0967-3334/31/5/004
Schultz W (2015) Neuronal reward and decision signals: from theories to data. Physiol Rev 95:853–951. https://doi.org/10.1152/physrev.00023.2014
Sescousse G, Redouté J, Dreher JC (2010) The architecture of reward value coding in the human orbitofrontal cortex. J Neurosci 30:13095–13104. https://doi.org/10.1523/jneurosci.3501-10.2010
Sescousse G, Caldú X, Segura B, Dreher JC (2013) Processing of primary and secondary rewards: a quantitative meta-analysis and review of human functional neuroimaging studies. Neurosci Biobehav Rev 37:681–696. https://doi.org/10.1016/j.neubiorev.2013.02.002
Simon JJ et al (2015) Neural dissociation of food- and money-related reward processing using an abstract incentive delay task. Soc Cogn Affect Neurosci 10:1113–1120. https://doi.org/10.1093/scan/nsu162
Simon JJ et al (2017) Integration of homeostatic signaling and food reward processing in the human brain. JCI Insight. https://doi.org/10.1172/jci.insight.92970
Strangman G, Culver JP, Thompson JH, Boas DA (2002) A quantitative comparison of simultaneous BOLD fMRI and NIRS recordings during functional brain activation. Neuroimage 17:719–731. https://doi.org/10.1006/nimg.2002.1227
Suzuki S, Cross L, O’Doherty JP (2017) Elucidating the underlying components of food valuation in the human orbitofrontal cortex. Nat Neurosci 20:1780–1786. https://doi.org/10.1038/s41593-017-0008-x
Tack C, Pohlmeier H, Behnke T, Schmid V, Grenningloh M, Forst T, Pfützner A (2012) Accuracy evaluation of five blood glucose monitoring systems obtained from the pharmacy: a European multicenter study with 453 subjects. Diabetes Technol Ther 14:330–337. https://doi.org/10.1089/dia.2011.0170
Tak S, Uga M, Flandin G, Dan I, Penny WD (2016) Sensor space group analysis for fNIRS data. J Neurosci Methods 264:103–112. https://doi.org/10.1016/j.jneumeth.2016.03.003
Volkow ND et al (2007) Profound decreases in dopamine release in striatum in detoxified alcoholics: possible orbitofrontal involvement. J Neurosci 27:12700–12706. https://doi.org/10.1523/jneurosci.3371-07.2007
Wang H, Chen Y, Li X, Wang J, Zhou Y, Zhou C (2019) Moderate-intensity aerobic exercise restores appetite and prefrontal brain activity to images of food among persons dependent on methamphetamine: a functional near-infrared spectroscopy study. Front Hum Neurosci 13:400. https://doi.org/10.3389/fnhum.2019.00400
Westbrook A, van den Bosch R, Määttä JI, Hofmans L, Papadopetraki D, Cools R, Frank MJ (2020) Dopamine promotes cognitive effort by biasing the benefits versus costs of cognitive work. Science 367:1362–1366. https://doi.org/10.1126/science.aaz5891
Wise SP (2008) Forward frontal fields: phylogeny and fundamental function. Trends Neurosci 31:599–608. https://doi.org/10.1016/j.tins.2008.08.008
Yamamoto T, Kato T (2002) Paradoxical correlation between signal in functional magnetic resonance imaging and deoxygenated haemoglobin content in capillaries: a new theoretical explanation. Phys Med Biol 47:1121–1141. https://doi.org/10.1088/0031-9155/47/7/309
Yousuf M, Heldmann M, Göttlich M, Münte TF, Doñamayor N (2018) Neural processing of food and monetary rewards is modulated by metabolic state. Brain Imaging Behav 12:1379–1392. https://doi.org/10.1007/s11682-017-9811-y
Zhou X et al (2019) Cue reactivity in the ventral striatum characterizes heavy cannabis use, whereas reactivity in the dorsal striatum mediates dependent use. Biol Psychiatry Cogn Neurosci Neuroimaging 4:751–762. https://doi.org/10.1016/j.bpsc.2019.04.006
Acknowledgements
This work was supported by the National Key Research and Development Program of China (Grant No. 2018YFA0701400), National Natural Science Foundation of China (NSFC No. 31700998, 31530032).
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of interest
All authors approved the final version of the manuscript. The authors declare no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Yang, X., Liu, X., Zeng, Y. et al. Secondary rewards acquire enhanced incentive motivation via increasing anticipatory activity of the lateral orbitofrontal cortex. Brain Struct Funct 226, 2339–2355 (2021). https://doi.org/10.1007/s00429-021-02333-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00429-021-02333-5