Abstract
Deficits in reward and motivation are common symptoms characterizing several psychiatric and neurological disorders. Such deficits may include anhedonia, defined as loss of pleasure, as well as impairments in anticipatory pleasure, reward valuation, motivation/effort, and reward learning. This chapter describes recent advances in the development of behavioral tasks used to assess different aspects of reward processing in both humans and non-human animals. While earlier tasks were generally developed independently with limited cross-species correspondence, a newer generation of translational tasks has emerged that are theoretically and procedurally analogous across species and allow parallel testing, data analyses, and interpretation between human and rodent behaviors. Such enhanced conformity between cross-species tasks will facilitate investigation of the neurobiological mechanisms underlying discrete reward and motivated behaviors and is expected to improve our understanding and treatment of neuropsychiatric disorders characterized by reward and motivation deficits.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aberman JE, Ward SJ, Salamone JD (1998) Effects of dopamine antagonists and accumbens dopamine depletions on time-constrained progressive-ratio performance. Pharmacol Biochem Behav 61(4):341–348
Adams CD, Dickinson A (1981) Instrumental responding following reinforcer devaluation. Q J Exp Psychol B 33(May):109–121
Ahnallen CG, Liverant GI, Gregor KL, Kamholz BW, Levitt JJ, Gulliver SB et al (2012) The relationship between reward-based learning and nicotine dependence in smokers with schizophrenia. Psychiatry Res 196(1):9–14
American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders: DSM-V. American Psychiatric Association, Washington, DC
Anderson MH, Hardcastle C, Munafo MR, Robinson ES (2012) Evaluation of a novel translational task for assessing emotional biases in different species. Cogn Affect Behav Neurosci 12(2):373–381
Balleine B, Dickinson A (1992) Signalling and incentive processes in instrumental reinforcer devaluation. Q J Exp Psychol B 45(4):285–301
Balleine BW, Dickinson A (1998) Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37(4–5):407–419
Balleine BW, O’Doherty JP (2010) Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35(1):48–69
Barbano MF, Cador M (2006) Differential regulation of the consummatory, motivational and anticipatory aspects of feeding behavior by dopaminergic and opioidergic drugs. Neuropsychopharmacology 31(7):1371–1381
Barbano MF, Cador M (2007) Opioids for hedonic experience and dopamine to get ready for it. Psychopharmacology 191(3):497–506
Barch DM, Dowd EC (2010) Goal representations and motivational drive in schizophrenia: the role of prefrontal-striatal interactions. Schizophr Bull 36(5):919–934
Barch DM, Treadway MT, Schoen N (2014) Effort, anhedonia, and function in schizophrenia: reduced effort allocation predicts amotivation and functional impairment. J Abnorm Psychol 123(2):387–397
Barch DM, Pagliaccio D, Luking K (2015) Mechanisms underlying motivational deficits in psychopathology: similarities and differences in depression and schizophrenia. Curr Top Behav Neurosci May 31. [Epub ahead of print]
Bardgett ME, Depenbrock M, Downs N, Points M, Green L (2009) Dopamine modulates effort-based decision making in rats. Behav Neurosci 123(2):242–251
Barnes SA, Der-Avakian A, Markou A (2014) Anhedonia, avolition, and anticipatory deficits: assessments in animals with relevance to the negative symptoms of schizophrenia. Eur Neuropsychopharmacol 24(5):744–758
Barr AM, Phillips AG (1998) Chronic mild stress has no effect on responding by rats for sucrose under a progressive ratio schedule. Physiol Behav 64(5):591–597
Barr AM, Phillips AG (1999) Withdrawal following repeated exposure to d-amphetamine decreases responding for a sucrose solution as measured by a progressive ratio schedule of reinforcement. Psychopharmacology 141(1):99–106
Barr AM, Phillips AG (2002) Increased successive negative contrast in rats withdrawn from an escalating-dose schedule of D-amphetamine. Pharmacol Biochem Behav 71(1–2):293–299
Barr AM, Fiorino DF, Phillips AG (1999) Effects of withdrawal from an escalating dose schedule of d-amphetamine on sexual behavior in the male rat. Pharmacol Biochem Behav 64(3):597–604
Barr RS, Pizzagalli DA, Culhane MA, Goff DC, Evins AE (2008) A single dose of nicotine enhances reward responsiveness in nonsmokers: implications for development of dependence. Biol Psychiatry 63(11):1061–1065
Barrett SP, Pihl RO, Benkelfat C, Brunelle C, Young SN, Leyton M (2008) The role of dopamine in alcohol self-administration in humans: individual differences. Eur Neuropsychopharmacol 18(6):439–447
Bentosela M, Jakovcevic A, Elgier AM, Mustaca AE, Papini MR (2009) Incentive contrast in domestic dogs (Canis familiaris). J Comp Psychol 123(2):125–130
Berghorst LH, Bogdan R, Frank MJ, Pizzagalli DA (2013) Acute stress selectively reduces reward sensitivity. Front Hum Neurosci 7:133
Berlin I, Givry-Steiner L, Lecrubier Y, Puech AJ (1998) Measures of anhedonia and hedonic responses to sucrose in depressive and schizophrenic patients in comparison with healthy subjects. Eur Psychiatry 13(6):303–309
Berridge KC, Robinson TE (2003) Parsing reward. Trends Neurosci 26(9):507–513
Bogdan R, Pizzagalli DA (2006) Acute stress reduces reward responsiveness: implications for depression. Biol Psychiatry 60(10):1147–1154
Brebion G, Bressan RA, Pilowsky LS, David AS (2009) Depression, avolition, and attention disorders in patients with schizophrenia: associations with verbal memory efficiency. J Neuropsychiatry Clin Neurosci 21(2):206–215
Brenes JC, Schwarting RK (2015). Individual differences in anticipatory activity to food rewards predict cue-induced appetitive 50-kHz calls in rats. Physiol Behav 149:107–118
Buck CL, Malavar JC, George O, Koob GF, Vendruscolo LF (2014a) Anticipatory 50 kHz ultrasonic vocalizations are associated with escalated alcohol intake in dependent rats. Behav Brain Res 271:171–176
Buck CL, Vendruscolo LF, Koob GF, George O (2014b) Dopamine D1 and mu-opioid receptor antagonism blocks anticipatory 50 kHz ultrasonic vocalizations induced by palatable food cues in Wistar rats. Psychopharmacology 231(5):929–937
Burke SN, Thome A, Plange K, Engle JR, Trouard TP, Gothard KM et al (2014) Orbitofrontal cortex volume in area 11/13 predicts reward devaluation, but not reversal learning performance, in young and aged monkeys. J Neurosci 34(30):9905–9916
Carroll ME, Lac ST (1987) Cocaine withdrawal produces behavioral disruptions in rats. Life Sci 40(22):2183–2190
Carver CS, White TL (1994) Behavioral-inhibition, behavioral activation, and affective responses to impending reward and punishment—the Bis Bas scales. J Pers Soc Psychol 67(2):319–333
Catanese F, Freidin E, Cuello MI, Distel RA (2011) Devaluation of low-quality food during early experience by sheep. Animal 5(6):938–942
Cawley EI, Park S, aan het Rot M, Sancton K, Benkelfat C, Young SN et al (2013) Dopamine and light: dissecting effects on mood and motivational states in women with subsyndromal seasonal affective disorder. J Psychiatry Neurosci 38(6):388–397
Chapman LJ, Chapman JP, Raulin ML (1976) Scales for Physical and Social Anhedonia. J Abnorm Psychol 85(4):374–382
Chevallier C, Grezes J, Molesworth C, Berthoz S, Happe F (2012) Brief report: selective social anhedonia in high functioning autism. J Autism Dev Disord 42(7):1504–1509
Corbit LH, Balleine BW (2003) The role of prelimbic cortex in instrumental conditioning. Behav Brain Res 146(1–2):145–157
Corbit LH, Balleine BW (2005) Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer. J Neurosci 25(4):962–970
Corbit LH, Muir JL, Balleine BW (2001) The role of the nucleus accumbens in instrumental conditioning: Evidence of a functional dissociation between accumbens core and shell. J Neurosci 21(9):3251–3260
Couvillon PA, Bitterman ME (1984) The overlearning-extinction effect and successive negative contrast in honeybees (Apis-Mellifera). J Comp Psychol 98(1):100–109
Crombag HS, Johnson AW, Zimmer AM, Zimmer A, Holland PC (2010) Deficits in sensory-specific devaluation task performance following genetic deletions of cannabinoid (CB1) receptor. Learn Mem 17(1):18–22
Damiano CR, Aloi J, Treadway M, Bodfish JW, Dichter GS (2012) Adults with autism spectrum disorders exhibit decreased sensitivity to reward parameters when making effort-based decisions. J Neurodev Disord 4:13
Damiano CR, Aloi J, Burrus C, Garbutt JC, Kampov-Polevoy AB, Dichter GS (2014) Intact hedonic responses to sweet tastes in autism spectrum disorder. Res Autism Spectr Disord 8(3):230–236
Davis C, Woodside DB (2002) Sensitivity to the rewarding effects of food and exercise in the eating disorders. Compr Psychiatry 43(3):189–194
de Wit S, Corlett PR, Aitken MR, Dickinson A, Fletcher PC (2009) Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans. J Neurosci 29(36):11330–11338
de Wit S, Barker RA, Dickinson AD, Cools R (2011) Habitual versus goal-directed action control in parkinson disease. J Cognitive Neurosci 23(5):1218–1229
de Wit S, Watson P, Harsay HA, Cohen MX, van de Vijver I, Ridderinkhof KR (2012) Corticostriatal connectivity underlies individual differences in the balance between habitual and goal-directed action control. J Neurosci 32(35):12066–12075
Der-Avakian A, Markou A (2010) Withdrawal from chronic exposure to amphetamine, but not nicotine, leads to an immediate and enduring deficit in motivated behavior without affecting social interaction in rats. Behav Pharmacol 21(4):359–368
Der-Avakian A, Markou A (2012) The neurobiology of anhedonia and other reward-related deficits. Trends Neurosci 35(1):68–77
Der-Avakian A, D’Souza MS, Pizzagalli DA, Markou A (2013) Assessment of reward responsiveness in the response bias probabilistic reward task in rats: implications for cross-species translational research. Transl Psychiatry 3:e297
Dias-Ferreira E, Sousa JC, Melo I, Morgado P, Mesquita AR, Cerqueira JJ et al (2009) Chronic stress causes frontostriatal reorganization and affects decision-making. Science 325(5940):621–625
Dichter GS, Smoski MJ, Kampov-Polevoy AB, Gallop R, Garbutt JC (2010) Unipolar depression does not moderate responses to the Sweet Taste Test. Depress Anxiety 27(9):859–863
Fawcett J, Clark DC, Scheftner WA, Gibbons RD (1983) Assessing anhedonia in psychiatric-patients—the pleasure scale. Arch Gen Psychiat 40(1):79–84
Fervaha G, Graff-Guerrero A, Zakzanis KK, Foussias G, Agid O, Remington G (2013) Incentive motivation deficits in schizophrenia reflect effort computation impairments during cost-benefit decision-making. J Psychiatr Res 47(11):1590–1596
Fletcher PJ, Grottick AJ, Higgins GA (2002) Differential effects of the 5-HT(2A) receptor antagonist M100907 and the 5-HT(2C) receptor antagonist SB242084 on cocaine-induced locomotor activity, cocaine self-administration and cocaine-induced reinstatement of responding. Neuropsychopharmacology 27(4):576–586
Fletcher PJ, Rizos Z, Noble K, Soko AD, Silenieks LB, Le AD et al (2012) Effects of the 5-HT2C receptor agonist Ro60-0175 and the 5-HT2A receptor antagonist M100907 on nicotine self-administration and reinstatement. Neuropharmacology 62(7):2288–2298
Forbes NF, Stewart CA, Matthews K, Reid IC (1996) Chronic mild stress and sucrose consumption: validity as a model of depression. Physiol Behav 60(6):1481–1484
Frank MJ, Claus ED (2006) Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol Rev 113(2):300–326
Frank MJ, Seeberger LC, O’Reilly RC (2004) By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306(5703):1940–1943
Frank MJ, Samanta J, Moustafa AA, Sherman SJ (2007) Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonism. Science 318(5854):1309–1312
Gard DE, Gard MG, Kring AM, John OP (2006) Anticipatory and consummatory components of the experience of pleasure: a scale development study. J Res Pers 40(6):1086–1102
Gard DE, Kring AM, Gard MG, Horan WP, Green MF (2007) Anhedonia in schizophrenia: distinctions between anticipatory and consummatory pleasure. Schizophr Res 93(1–3):253–260
Geyer MA, Markou A (2002) The role of preclinical models in the development of psychotropic drugs. In: Davis KL, Charney D, Coyle JT, Nemeroff CB (eds) Neuropsychopharmacology: the fifth generation of progress. Lippincott Williams & Wilkins, pp 445–455
Glover AC, Roane HS, Kadey HJ, Grow LL (2008) Preference for reinforcers under progressive- and fixed-ratio schedules: a comparison of single and concurrent arrangements. J Appl Behav Anal 41(2):163–176
Gold JM, Waltz JA, Prentice KJ, Morris SE, Heerey EA (2008) Reward processing in schizophrenia: a deficit in the representation of value. Schizophr Bull 34(5):835–847
Gold JM, Strauss GP, Waltz JA, Robinson BM, Brown JK, Frank MJ (2013) Negative symptoms of schizophrenia are associated with abnormal effort-cost computations. Biol Psychiatry 74(2):130–136
Gooding DC, Pflum MJ (2014a) The assessment of interpersonal pleasure: introduction of the Anticipatory and Consummatory Interpersonal Pleasure Scale (ACIPS) and preliminary findings. Psychiatry Res 215(1):237–243
Gooding DC, Pflum MJ (2014b) Further validation of the ACIPS as a measure of social hedonic response. Psychiatry Res 215(3):771–777
Hamill S, Trevitt JT, Nowend KL, Carlson BB, Salamone JD (1999) Nucleus accumbens dopamine depletions and time-constrained progressive ratio performance: effects of different ratio requirements. Pharmacol Biochem Behav 64(1):21–27
Harris RB, Zhou J, Youngblood BD, Smagin GN, Ryan DH (1997) Failure to change exploration or saccharin preference in rats exposed to chronic mild stress. Physiol Behav 63(1):91–100
Haslam J (1809) Observations on madness and melancholy; including practical remarks on those diseases, together with cases, and an account of the morbid appearances on dissection, 2nd edn. Callow, London, vii, 345 pp
Heerey EA, Gold JM (2007) Patients with schizophrenia demonstrate dissociation between affective experience and motivated behavior. J Abnorm Psychol 116(2):268–278
Heerey EA, Bell-Warren KR, Gold JM (2008) Decision-making impairments in the context of intact reward sensitivity in schizophrenia. Biol Psychiatry 64(1):62–69
Hilario MR, Clouse E, Yin HH, Costa RM (2007) Endocannabinoid signaling is critical for habit formation. Front Integr Neurosci 1:6
Hodos W (1961) Progressive ratio as a measure of reward strength. Science 134(3483):943–944
Hodos W, Kalman G (1963) Effects of increment size and reinforcer volume on progressive ratio performance. J Exp Anal Behav 6:387–392
Hogarth L, Attwood AS, Bate HA, Munafo MR (2012) Acute alcohol impairs human goal-directed action. Biol Psychol 90(2):154–160
Holroyd CB, Coles MG (2002) The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol Rev 109(4):679–709
Hsu CT, Patton DF, Mistlberger RE, Steele AD (2010) Palatable meal anticipation in mice. Plos One 5(9):e12903
Hyman SE (2012). Revolution stalled. Sci Transl Med 4(155):155cm111
Hyman SE, Fenton WS (2003) Medicine. What are the right targets for psychopharmacology? Science 299(5605):350–351
Insel T, Cuthbert B, Garvey M, Heinssen R, Pine DS, Quinn K et al (2010) Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am J Psychiatry 167(7):748–751
Insel TR, Voon V, Nye JS, Brown VJ, Altevogt BM, Bullmore ET et al (2013) Innovative solutions to novel drug development in mental health. Neurosci Biobehav Rev 37(10 Pt 1):2438–2444
Isella V, Iurlaro S, Piolti R, Ferrarese C, Frattola L, Appollonio I et al (2003) Physical anhedonia in Parkinson’s disease. J Neurol Neurosurg Psychiatry 74(9):1308–1311
Jilge B (1992) Restricted feeding—a nonphotic zeitgeber in the rabbit. Physiol Behav 51(1):157–166
Jocham G, Klein TA, Ullsperger M (2011) Dopamine-mediated reinforcement learning signals in the striatum and ventromedial prefrontal cortex underlie value-based choices. J Neurosci 31(5):1606–1613
Jocham G, Klein TA, Ullsperger M (2014) Differential modulation of reinforcement learning by D2 dopamine and NMDA glutamate receptor antagonism. J Neurosci 34(39):13151–13162
Kamal A, Van der Harst JE, Kapteijn CM, Baars AJ, Spruijt BM, Ramakers GM (2010) Announced reward counteracts the effects of chronic social stress on anticipatory behavior and hippocampal synaptic plasticity in rats. Exp Brain Res 201(4):641–651
Kasch KL, Rottenberg J, Arnow BA, Gotlib IH (2002) Behavioral activation and inhibition systems and the severity and course of depression. J Abnorm Psychol 111(4):589–597
Killcross S, Coutureau E (2003) Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb Cortex 13(4):400–408
Klein DF (1974) Endogenomorphic depression—conceptual and terminological revision. Arch Gen Psychiatry 31(4):447–454
Klossek UMH, Russell J, Dickinson A (2008) The control of instrumental action following outcome devaluation in young children aged between 1 and 4 years. J Exp Psychol-Gen 137(1):39–51
Knutson B, Burgdorf J, Panksepp J (2002) Ultrasonic vocalizations as indices of affective states in rats. Psychol Bull 128(6):961–977
Kraepelin E (1921) Dementia praecox and paraphrenia. J Nerv Ment Dis 54(4):384
Kuczenski R, Segal DS, Aizenstein ML (1991) Amphetamine, cocaine, and fencamfamine: relationship between locomotor and stereotypy response profiles and caudate and accumbens dopamine dynamics. J Neurosci 11(9):2703–2712
Leboyer M, Bellivier F, Nosten-Bertrand M, Jouvent R, Pauls D, Mallet J (1998) Psychiatric genetics: search for phenotypes. Trends Neurosci 21(3):102–105
Leibenluft E, Charney DS, Pine DS (2003) Researching the pathophysiology of pediatric bipolar disorder. Biol Psychiatry 53(11):1009–1020
LeSage MG, Burroughs D, Pentel PR (2006) Effects of nicotine withdrawal on performance under a progressive-ratio schedule of sucrose pellet delivery in rats. Pharmacol Biochem Behav 83(4):585–591
Li FZ (1999) The exercise motivation scale: Its multifaceted structure and construct validity. J Appl Sport Psychol 11(1):97–115
Llerena K, Park SG, McCarthy JM, Couture SM, Bennett ME, Blanchard JJ (2013) The motivation and pleasure scale-self-report (MAP-SR): reliability and validity of a self-report measure of negative symptoms. Compr Psychiat 54(5):568–574
Loas G, Duru C, Godefroy O, Krystkowiak P (2014) Hedonic deficits in Parkinson’s disease: is consummatory anhedonia specific? Front Neurol 5:24
Ma ST, Maier EY, Ahrens AM, Schallert T, Duvauchelle CL (2010) Repeated intravenous cocaine experience: development and escalation of pre-drug anticipatory 50-kHz ultrasonic vocalizations in rats. Behav Brain Res 212(1):109–114
Markou A, Kosten TR, Koob GF (1998) Neurobiological similarities in depression and drug dependence: a self-medication hypothesis. Neuropsychopharmacology 18(3):135–174
Markou A, Chiamulera C, Geyer MA, Tricklebank M, Steckler T (2009) Removing obstacles in neuroscience drug discovery: the future path for animal models. Neuropsychopharmacology 34(1):74–89
Markou A, Salamone JD, Bussey TJ, Mar AC, Brunner D, Gilmour G et al (2013) Measuring reinforcement learning and motivation constructs in experimental animals: relevance to the negative symptoms of schizophrenia. Neurosci Biobehav Rev 37(9 Pt B):2149–2165
Matthews K, Forbes N, Reid IC (1995) Sucrose consumption as an hedonic measure following chronic unpredictable mild stress. Physiol Behav 57(2):241–248
McFarland BR, Shankman SA, Tenke CE, Bruder GE, Klein DN (2006) Behavioral activation system deficits predict the six-month course of depression. J Affect Disorders 91(2–3):229–234
Meehl PE (1962) Schizotaxia, schizotypy, schizophrenia. Am Psychol 17(12):827–838
Mendelson SD, Pfaus JG (1989) Level searching: a new assay of sexual motivation in the male rat. Physiol Behav 45(2):337–341
Mendoza J, Angeles-Castellanos M, Escobar C (2005) Entrainment by a palatable meal induces food-anticipatory activity and c-Fos expression in reward-related areas of the brain. Neuroscience 133(1):293–303
Meyer B, Johnson SL, Carver CS (1999) Exploring behavioral activation and inhibition sensitivities among college students at risk for bipolar spectrum symptomatology. J Psychopathol Behav 21(4):275–292
Meyer-Lindenberg A, Weinberger DR (2006) Intermediate phenotypes and genetic mechanisms of psychiatric disorders. Nat Rev Neurosci 7(10):818–827
Mistlberger RE (1994) Circadian food-anticipatory activity: formal models and physiological mechanisms. Neurosci Biobehav Rev 18(2):171–195
Moore D, Siegfried D, Wilson R, Rankin MA (1989) The influence of time of day on the foraging behavior of the honeybee, Apis mellifera. J Biol Rhythms 4(3):305–325
Mote J, Minzenberg MJ, Carter CS, Kring AM (2014) Deficits in anticipatory but not consummatory pleasure in people with recent-onset schizophrenia spectrum disorders. Schizophr Res 159(1):76–79
Nawijn L, van Zuiden M, Frijling JL, Koch SB, Veltman DJ, Olff M (2015) Reward functioning in PTSD: a systematic review exploring the mechanisms underlying anhedonia. Neurosci Biobehav Rev 51:189–204
Nelson A, Killcross S (2006) Amphetamine exposure enhances habit formation. J Neurosci 26(14):3805–3812
Nestler EJ, Hyman SE (2010) Animal models of neuropsychiatric disorders. Nat Neurosci 13(10):1161–1169
O’Doherty J, Dayan P, Schultz J, Deichmann R, Friston K, Dolan RJ (2004) Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science 304(5669):452–454
Opiol H, Pavlovski I, Michalik M, Mistlberger RE (2015) Ultrasonic vocalizations in rats anticipating circadian feeding schedules. Behav Brain Res 284:42–50
Paul IA, English JA, Halaris A (2000) Sucrose and quinine intake by maternally-deprived and control rhesus monkeys. Behav Brain Res 112(1–2):127–134
Pechtel P, Pizzagalli DA (2013) Disrupted reinforcement learning and maladaptive behavior in women with a history of childhood sexual abuse: a high-density event-related potential study. JAMA Psychiatry 70(5):499–507
Pechtel P, Dutra SJ, Goetz EL, Pizzagalli DA (2013) Blunted reward responsiveness in remitted depression. J Psychiatr Res 47(12):1864–1869
Pelletier LG, Tuson KM, Fortier MS, Vallerand RJ, Briere NM, Blais MR (1995) Toward a new measure of intrinsic motivation, extrinsic motivation, and amotivation in sports—the Sport Motivation Scale (Sms). J Sport Exerc Psychol 17(1):35–53
Penrod B, Wallace MD, Dyer EJ (2008) Assessing potency of high- and low-preference reinforcers with respect to response rate and response patterns. J Appl Behav Anal 41(2):177–188
Pergadia ML, Der-Avakian A, D’Souza MS, Madden PA, Heath AC, Shiffman S et al (2014) Association between nicotine withdrawal and reward responsiveness in humans and rats. JAMA Psychiatry 71(11):1238–1245
Pfaus JG, Phillips AG (1991) Role of dopamine in anticipatory and consummatory aspects of sexual behavior in the male rat. Behav Neurosci 105(5):727–743
Phelps CE, Mitchell EN, Nutt DJ, Marston HM, Robinson ES (2015) Psychopharmacological characterisation of the successive negative contrast effect in rats. Psychopharmacology (Berl) 232:2697–2709
Pizzagalli DA, Jahn AL, O’Shea JP (2005) Toward an objective characterization of an anhedonic phenotype: a signal-detection approach. Biol Psychiatry 57(4):319–327
Pizzagalli DA, Bogdan R, Ratner KG, Jahn AL (2007) Increased perceived stress is associated with blunted hedonic capacity: potential implications for depression research. Behav Res Ther 45(11):2742–2753
Pizzagalli DA, Evins AE, Schetter EC, Frank MJ, Pajtas PE, Santesso DL et al (2008a) Single dose of a dopamine agonist impairs reinforcement learning in humans: behavioral evidence from a laboratory-based measure of reward responsiveness. Psychopharmacology 196(2):221–232
Pizzagalli DA, Goetz E, Ostacher M, Iosifescu DV, Perlis RH (2008b) Euthymic patients with bipolar disorder show decreased reward learning in a probabilistic reward task. Biol Psychiatry 64(2):162–168
Pizzagalli DA, Iosifescu D, Hallett LA, Ratner KG, Fava M (2008c) Reduced hedonic capacity in major depressive disorder: evidence from a probabilistic reward task. J Psychiatr Res 43(1):76–87
Reid I, Forbes N, Stewart C, Matthews K (1997) Chronic mild stress and depressive disorder: a useful new model? Psychopharmacology (Berl) 134(4):365–367; discussion 371–367
Ribot T (1896) La psychologie des sentiments. F. Alcan, Paris, xi, 443 pp
Roane HS, Lerman DC, Vorndran CM (2001) Assessing reinforcers under progressive schedule requirements. J Appl Behav Anal 34(2):145–166
Roberts DC (1989) Breaking points on a progressive ratio schedule reinforced by intravenous apomorphine increase daily following 6-hydroxydopamine lesions of the nucleus accumbens. Pharmacol Biochem Behav 32(1):43–47
Rodriguez JS, Morris SM, Hotchkiss CE, Doerge DR, Allen RR, Mattison DR et al (2010) The effects of chronic methylphenidate administration on operant test battery performance in juvenile rhesus monkeys. Neurotoxicol Teratol 32(2):142–151
Rorie AE, Gao J, McClelland JL, Newsome WT (2010) Integration of sensory and reward information during perceptual decision-making in lateral intraparietal cortex (LIP) of the macaque monkey. PLoS ONE 5(2):e9308
Salamone JD, Steinpreis RE, McCullough LD, Smith P, Grebel D, Mahan K (1991) Haloperidol and nucleus accumbens dopamine depletion suppress lever pressing for food but increase free food consumption in a novel food choice procedure. Psychopharmacology 104(4):515–521
Salamone JD, Cousins MS, Bucher S (1994) Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure. Behav Brain Res 65(2):221–229
Salamone JD, Cousins MS, Snyder BJ (1997) Behavioral functions of nucleus accumbens dopamine: empirical and conceptual problems with the anhedonia hypothesis. Neurosci Biobehav Rev 21(3):341–359
Salamone JD, Correa M, Farrar A, Mingote SM (2007) Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology 191(3):461–482
Salamone JD, Correa M, Farrar AM, Nunes EJ, Pardo M (2009) Dopamine, behavioral economics, and effort. Front Behav Neurosci 3:13
Samejima K, Ueda Y, Doya K, Kimura M (2005) Representation of action-specific reward values in the striatum. Science 310(5752):1337–1340
Santesso DL, Dillon DG, Birk JL, Holmes AJ, Goetz E, Bogdan R et al (2008) Individual differences in reinforcement learning: behavioral, electrophysiological, and neuroimaging correlates. Neuroimage 42(2):807–816
Santesso DL, Evins AE, Frank MJ, Schetter EC, Bogdan R, Pizzagalli DA (2009) Single dose of a dopamine agonist impairs reinforcement learning in humans: evidence from event-related potentials and computational modeling of striatal-cortical function. Hum Brain Mapp 30(7):1963–1976
Schultz W (2002) Getting formal with dopamine and reward. Neuron 36(2):241–263
Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275(5306):1593–1599
Schwabe L, Wolf OT (2010) Socially evaluated cold pressor stress after instrumental learning favors habits over goal-directed action. Psychoneuroendocrinology 35(7):977–986
Shalev U, Kafkafi N (2002) Repeated maternal separation does not alter sucrose-reinforced and open-field behaviors. Pharmacol Biochem Behav 73(1):115–122
Sherdell L, Waugh CE, Gotlib IH (2012) Anticipatory pleasure predicts motivation for reward in major depression. J Abnorm Psychol 121(1):51–60
Simpson EH, Waltz JA, Kellendonk C, Balsam PD (2012) Schizophrenia in translation: dissecting motivation in schizophrenia and rodents. Schizophr Bull 38(6):1111–1117
Snaith RP, Hamilton M, Morley S, Humayan A, Hargreaves D, Trigwell P (1995) A scale for the assessment of hedonic tone—the Snaith-Hamilton Pleasure Scale. Br J Psychiatry 167:99–103
Soares JM, Sampaio A, Ferreira LM, Santos NC, Marques F, Palha JA et al (2012) Stress-induced changes in human decision-making are reversible. Transl Psychiatry 2:e131
Specht SM, Twining RC (1999) Human taste contrast and self-reported measures of anxiety. Percept Mot Skills 88(2):384–386
Starkstein SE, Jorge R, Mizrahi R, Robinson RG (2005) The construct of minor and major depression in Alzheimer’s disease. Am J Psychiatry 162(11):2086–2093
Stoops WW (2008) Reinforcing effects of stimulants in humans: sensitivity of progressive-ratio schedules. Exp Clin Psychopharmacol 16(6):503–512
Stoops WW, Bennett JA, Lile JA, Sevak RJ, Rush CR (2013) Influence of aripiprazole pretreatment on the reinforcing effects of methamphetamine in humans. Prog Neuropsychopharmacol Biol Psychiatry 47:111–117
Sulzman FM, Fuller CA, Mooreede MC (1977) Feeding time synchronizes primate circadian-rhythms. Physiol Behav 18(5):775–779
Treadway MT, Buckholtz JW, Schwartzman AN, Lambert WE, Zald DH (2009) Worth the ‘EEfRT’? The effort expenditure for rewards task as an objective measure of motivation and anhedonia. PLoS ONE 4(8):e6598
Treadway MT, Bossaller NA, Shelton RC, Zald DH (2012a) Effort-based decision-making in major depressive disorder: a translational model of motivational anhedonia. J Abnorm Psychol 121(3):553–558
Treadway MT, Buckholtz JW, Cowan RL, Woodward ND, Li R, Ansari MS et al (2012b) Dopaminergic mechanisms of individual differences in human effort-based decision-making. J Neurosci 32(18):6170–6176
Treadway MT, Peterman JS, Zald DH, Park S (2015) Impaired effort allocation in patients with schizophrenia. Schizophr Res 161(2–3):382–385
Trecker A, Robbins TW, Mar AC (eds) (2012) Development of a visual-guided probabilistic selection task for rats. In: Proceedings of measuring behavior 2012, 28–31 Aug 2012, Utrecht, The Netherlands
Tripp G, Alsop B (1999) Sensitivity to reward frequency in boys with attention deficit hyperactivity disorder. J Clin Child Psychol 28(3):366–375
Trosclair-Lasserre NM, Lerman DC, Call NA, Addison LR, Kodak T (2008) Reinforcement magnitude: an evaluation of preference and reinforcer efficacy. J Appl Behav Anal 41(2):203–220
Valentin VV, Dickinson A, O’Doherty JP (2007) Determining the neural substrates of goal-directed learning in the human brain. J Neurosci 27(15):4019–4026
Vallerand RJ, Pelletier LG, Blais MR, Briere NM, Senecal C, Vallieres EF (1992) The academic motivation scale—a measure of intrinsic, extrinsic, and amotivation in education. Educ Psychol Meas 52(4):1003–1017
van der Harst JE, Baars AM, Spruijt BM (2005) Announced rewards counteract the impairment of anticipatory behaviour in socially stressed rats. Behav Brain Res 161(2):183–189
Venugopalan VV, Casey KF, O’Hara C, O’Loughlin J, Benkelfat C, Fellows LK et al (2011) Acute phenylalanine/tyrosine depletion reduces motivation to smoke cigarettes across stages of addiction. Neuropsychopharmacology 36(12):2469–2476
Vollmayr B, Bachteler D, Vengeliene V, Gass P, Spanagel R, Henn F (2004) Rats with congenital learned helplessness respond less to sucrose but show no deficits in activity or learning. Behav Brain Res 150(1–2):217–221
Von Huben SN, Davis SA, Lay CC, Katner SN, Crean RD, Taffe MA (2006) Differential contributions of dopaminergic D1- and D2-like receptors to cognitive function in rhesus monkeys. Psychopharmacology 188(4):586–596
Vrieze E, Ceccarini J, Pizzagalli DA, Bormans G, Vandenbulcke M, Demyttenaere K et al (2013a) Measuring extrastriatal dopamine release during a reward learning task. Hum Brain Mapp 34(3):575–586
Vrieze E, Pizzagalli DA, Demyttenaere K, Hompes T, Sienaert P, de Boer P et al (2013b) Reduced reward learning predicts outcome in major depressive disorder. Biol Psychiatry 73(7):639–645
Waltz JA, Frank MJ, Robinson BM, Gold JM (2007) Selective reinforcement learning deficits in schizophrenia support predictions from computational models of striatal-cortical dysfunction. Biol Psychiatry 62(7):756–764
Wang AY, Miura K, Uchida N (2013) The dorsomedial striatum encodes net expected return, critical for energizing performance vigor. Nat Neurosci 16(5):639–647
Ward RD, Simpson EH, Richards VL, Deo G, Taylor K, Glendinning JI et al (2012) Dissociation of hedonic reaction to reward and incentive motivation in an animal model of the negative symptoms of schizophrenia. Neuropsychopharmacology 37(7):1699–1707
Wardle MC, Treadway MT, Mayo LM, Zald DH, de Wit H (2011) Amping up effort: effects of d-amphetamine on human effort-based decision-making. J Neurosci 31(46):16597–16602
Watson D, Clark LA, Tellegen A (1988) Development and validation of brief measures of positive and negative affect—the Panas Scales. J Pers Soc Psychol 54(6):1063–1070
Weber DN, Spieler RE (1987) Effects of the light-dark cycle and scheduled feeding on behavioral and reproductive rhythms of the cyprinodont fish, Medaka, Oryzias-Latipes. Experientia 43(6):621–624
Wenger D, Biebach H, Krebs JR (1991) Free-running circadian-rhythm of a learned feeding pattern in starlings. Naturwissenschaften 78(2):87–89
West EA, DesJardin JT, Gale K, Malkova L (2011) Transient inactivation of orbitofrontal cortex blocks reinforcer devaluation in macaques. J Neurosci 31(42):15128–15135
Whitton AE, Treadway MT, Pizzagalli DA (2015) Reward processing dysfunction in major depression, bipolar disorder and schizophrenia. Curr Opin Psychiatry 28(1):7–12
Whitton AE, Kakani P, Foti D, Van’t Veer A, Haile A, Crowley DJ et al. (2016). Blunted neural responses to reward in remitted Major Depression: A high-density event-related potential study. BP:CNNI 1(1):87–95
Willey AR, Spear LP (2012) Development of anticipatory 50 kHz USV production to a social stimuli in adolescent and adult male Sprague-Dawley rats. Behav Brain Res 226(2):613–618
Willner P (2005) Chronic mild stress (CMS) revisited: consistency and behavioural-neurobiological concordance in the effects of CMS. Neuropsychobiology 52(2):90–110
Willner P, Towell A, Sampson D, Sophokleous S, Muscat R (1987) Reduction of sucrose preference by chronic unpredictable mild stress, and its restoration by a tricyclic antidepressant. Psychopharmacology 93(3):358–364
Willner P, Muscat R, Papp M (1992) Chronic mild stress-induced anhedonia: a realistic animal model of depression. Neurosci Biobehav Rev 16(4):525–534
Wolf DH, Satterthwaite TD, Kantrowitz JJ, Katchmar N, Vandekar L, Elliott MA et al (2014) Amotivation in schizophrenia: integrated assessment with behavioral, clinical, and imaging measures. Schizophr Bull 40(6):1328–1337
World Health Organization (1992) The ICD-10 classification of mental and behavioural disorders: clinical descriptions and diagnostic guidelines. World Health Organization, Geneva, xii, 362Â pp
Yin HH, Knowlton BJ, Balleine BW (2005a) Blockade of NMDA receptors in the dorsomedial striatum prevents action-outcome learning in instrumental conditioning. Eur J Neurosci 22(2):505–512
Yin HH, Ostlund SB, Knowlton BJ, Balleine BW (2005b) The role of the dorsomedial striatum in instrumental conditioning. Eur J Neurosci 22(2):513–523
Yohn SE, Santerre JL, Nunes EJ, Kozak R, Podurgiel SJ, Correa M et al (2015) The role of dopamine D1 receptor transmission in effort-related choice behavior: effects of D1 agonists. Pharmacol Biochem Behav 135:217–226
Zhang D, Zhou X, Wang X, Xiang X, Chen H, Hao W (2007) Morphine withdrawal decreases responding reinforced by sucrose self-administration in progressive ratio. Addict Biol 12(2):152–157
Acknowledgments
AM was partially supported by RO1MH087989 and R56DA011946. DAP was partially supported by R01 MH068376 and R01 MH101521.
Disclosures
Over the past three years, Dr. Markou received contract research support from Astra-Zeneca and Forest Laboratories, and honorarium/consulting fee from AbbVie, Germany for activities unrelated to this chapter. Over the past three years, Dr. Pizzagalli has received honoraria/consulting fees Otsuka America Pharmaceutical and Pfizer for activities unrelated to this chapter. Drs. Der-Avakian and Barnes have no financial disclosures to report.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Der-Avakian, A., Barnes, S.A., Markou, A., Pizzagalli, D.A. (2015). Translational Assessment of Reward and Motivational Deficits in Psychiatric Disorders. In: Robbins, T.W., Sahakian, B.J. (eds) Translational Neuropsychopharmacology. Current Topics in Behavioral Neurosciences, vol 28. Springer, Cham. https://doi.org/10.1007/7854_2015_5004
Download citation
DOI: https://doi.org/10.1007/7854_2015_5004
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-33911-5
Online ISBN: 978-3-319-33913-9
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)