1932

Abstract

Abnormal reward processing is a prominent transdiagnostic feature of psychopathology. The present review provides a framework for considering the different aspects of reward processing and their assessment, and highlights recent insights from the field of neuroeconomics that may aid in understanding these processes. Although altered reward processing in psychopathology has often been treated as a general hypo- or hyperresponsivity to reward, increasing data indicate that a comprehensive understanding of reward dysfunction requires characterization within more specific reward-processing domains, including subjective valuation, discounting, hedonics, reward anticipation and facilitation, and reinforcement learning. As such, more nuanced models of the nature of these abnormalities are needed. We describe several processing abnormalities capable of producing the types of selective alterations in reward-related behavior observed in different forms of psychopathology, including (mal)adaptive scaling and anchoring, dysfunctional weighting of reward and cost variables, competition between valuation systems, and reward prediction error signaling.

Loading

Article metrics loading...

/content/journals/10.1146/annurev-clinpsy-032816-044957
2017-05-08
2024-04-18
Loading full text...

Full text loading...

/deliver/fulltext/clinpsy/13/1/annurev-clinpsy-032816-044957.html?itemId=/content/journals/10.1146/annurev-clinpsy-032816-044957&mimeType=html&fmt=ahah

Literature Cited

  1. Alloy LB, Nusslock R, Boland EM. 2015. The development and course of bipolar spectrum disorders: An integrated reward and circadian rhythm dysregulation model. Annu. Rev. Clin. Psychol. 11:213–50 [Google Scholar]
  2. Am. Psychiatry Assoc. 2013. Diagnostic and Statistical Manual of Mental Disorders. Washington, DC: Am. Psychiatric Publ. 5th ed.
  3. Antonini A, Leenders KL. 1993. Dopamine D2 receptors in normal human brain: effect of age measured by positron emission tomography (PET) and [11C]-raclopride. Ann. N.Y. Acad. Sci. 695:81–85 [Google Scholar]
  4. Ariely D, Norton MI. 2008. How actions create—not just reveal—preferences. Trends Cogn. Sci. 12:13–16 [Google Scholar]
  5. Baker TB, Morse E, Sherman JE. 1986. The motivation to use drugs: a psychobiological analysis of urges. Neb. Symp. Motiv. 34:257–323 [Google Scholar]
  6. Barch DM, Dowd EC. 2010. Goal representations and motivational drive in schizophrenia: the role of prefrontal-striatal interactions. Schizophr. Bull. 36:919–34 [Google Scholar]
  7. Barch DM, Treadway MT, Schoen N. 2014. Effort, anhedonia, and function in schizophrenia: Reduced effort allocation predicts amotivation and functional impairment. J. Abnorm. Psychol. 123:387–97 [Google Scholar]
  8. Barkley RA, Edwards G, Laneri M, Fletcher K, Metevia L. 2001. Executive functioning, temporal discounting, and sense of time in adolescents with attention deficit hyperactivity disorder (ADHD) and oppositional defiant disorder (ODD). J. Abnorm. Child Psychol. 29:541–56 [Google Scholar]
  9. Becker GM, DeGroot MH, Marschak J. 1964. Measuring utility by a single-response sequential method. Behav. Sci. 9:226–32 [Google Scholar]
  10. Benningfield MM, Blackford JU, Ellsworth ME, Samanez-Larkin GR, Martin PR. et al. 2014. Caudate responses to reward anticipation associated with delay discounting behavior in healthy youth. Dev. Cogn. Neurosci. 7:43–52 [Google Scholar]
  11. Berridge KC, Kringelbach ML. 2008. Affective neuroscience of pleasure: reward in humans and animals. Psychopharmacology 199:457–80 [Google Scholar]
  12. Berridge KC, Robinson TE. 1998. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience. Brain Res. Brain Res. Rev. 28:309–69 [Google Scholar]
  13. Berridge KC, Robinson TE. 2003. Parsing reward. Trends Neurosci 26:507–13 [Google Scholar]
  14. Bickel WK, Marsch LA. 2001. Toward a behavioral economic understanding of drug dependence: delay discounting processes. Addiction 96:73–86 [Google Scholar]
  15. Bjork JM, Chen G, Smith AR, Hommer DW. 2010. Incentive-elicited mesolimbic activation and externalizing symptomatology in adolescents. J. Child Psychol. Psychiatry 51:827–37 [Google Scholar]
  16. Blazer DG, Wu L-T. 2009. The epidemiology of substance use and disorders among middle aged and elderly community adults: national survey on drug use and health. Am. J. Geriatr. Psychiatry 17:237–45 [Google Scholar]
  17. Blum K, Cull JG, Braverman ER, Comings DE. 1996. Reward deficiency syndrome. Am. Sci. 84:132–45 [Google Scholar]
  18. Blum K, Gardner E, Oscar-Berman M, Gold M. 2012. “Liking” and “wanting” linked to Reward Deficiency Syndrome (RDS): hypothesizing differential responsivity in brain reward circuitry. Curr. Pharm. Des. 18:113–18 [Google Scholar]
  19. Bogdan R, Santesso DL, Fagerness J, Perlis RH, Pizzagalli DA. 2011. Corticotropin-releasing hormone receptor type 1 (CRHR1) genetic variation and stress interact to influence reward learning. J. Neurosci. 31:13246–54 [Google Scholar]
  20. Brandon TH, Wetter DW, Baker TB. 1996. Affect, expectancies, urges, and smoking: Do they conform to models of drug motivation and relapse?. Exp. Clin. Psychopharmacol. 4:29–36 [Google Scholar]
  21. Brown JK, Waltz JA, Strauss GP, McMahon RP, Frank MJ, Gold JM. 2013. Hypothetical decision making in schizophrenia: the role of expected value computation and “irrational” biases. Psychiatry Res 209:142–49 [Google Scholar]
  22. Buckholtz JW, Treadway MT, Cowan RL, Woodward ND, Benning SD. et al. 2010. Mesolimbic dopamine reward system hypersensitivity in individuals with psychopathic traits. Nat. Neurosci. 13:419–21 [Google Scholar]
  23. Bylsma LM, Morris BH, Rottenberg J. 2008. A meta-analysis of emotional reactivity in major depressive disorder. Clin. Psychol. Rev. 28:676–91 [Google Scholar]
  24. Cacioppo J, Berntson C, Larsen J, Poehlmann K, Ito T. 2000. The psychophysiology of emotion. Handbook of Emotions M Lewis, JM Haviland 173–91 New York: Guilford, 2nd ed.. [Google Scholar]
  25. Capuron L, Pagnoni G, Drake DF, Woolwine BJ, Spivey JR. et al. 2012. Dopaminergic mechanisms of reduced basal ganglia responses to hedonic reward during interferon alfa administration. Arch. Gen. Psychiatry 69:1044–53 [Google Scholar]
  26. Carver CS, White TL. 1994. Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: the BIS/BAS scales. J. Personal. Soc. Psychol. 67:319–33 [Google Scholar]
  27. Cavanagh JF, Frank MJ, Allen JJ. 2011. Social stress reactivity alters reward and punishment learning. Soc. Cogn. Affect. Neurosci. 6:311–20 [Google Scholar]
  28. Chapman LJ, Chapman JP, Raulin ML. 1976. Scales for physical and social anhedonia. J. Abnorm. Psychol. 85:374–82 [Google Scholar]
  29. Clery-Melin ML, Schmidt L, Lafargue G, Baup N, Fossati P, Pessiglione M. 2011. Why don't you try harder? An investigation of effort production in major depression. PLOS ONE 6:e23178 [Google Scholar]
  30. Collins AG, Frank MJ. 2016. Surprise! Dopamine signals mix action, value and error. Nat. Neurosci. 19:3–5 [Google Scholar]
  31. Comings DE, Blum K. 2000. Reward deficiency syndrome: genetic aspects of behavioral disorders. Prog. Brain Res. 126:325–41 [Google Scholar]
  32. Dagher A, Robbins TW. 2009. Personality, addiction, dopamine: insights from Parkinson's disease. Neuron 61:502–10 [Google Scholar]
  33. Dalley JW, Mar AC, Economidou D, Robbins TW. 2008. Neurobehavioral mechanisms of impulsivity: fronto-striatal systems and functional neurochemistry. Pharmacol. Biochem. Behav. 90:250–60 [Google Scholar]
  34. Damiano CR, Aloi J, Treadway M, Bodfish JW, Dichter GS. 2012. Adults with autism spectrum disorders exhibit decreased sensitivity to reward parameters when making effort-based decisions. J. Neurodev. Disord. 4:13 [Google Scholar]
  35. Dawe S, Gullo MJ, Loxton NJ. 2004. Reward drive and rash impulsiveness as dimensions of impulsivity: implications for substance misuse. Addict. Behav. 29:1389–405 [Google Scholar]
  36. Delgado MR, Nystrom LE, Fissell C, Noll DC, Fiez JA. 2000. Tracking the hemodynamic responses to reward and punishment in the striatum. J. Neurophysiol. 84:3072–77 [Google Scholar]
  37. Dias-Ferreira E, Sousa JC, Melo I, Morgado P, Mesquita AR. et al. 2009. Chronic stress causes frontostriatal reorganization and affects decision-making. Science 325:621–25 [Google Scholar]
  38. Dimidjian S, Hollon SD, Dobson KS, Schmaling KB, Kohlenberg RJ. et al. 2006. Randomized trial of behavioral activation, cognitive therapy, and antidepressant medication in the acute treatment of adults with major depression. J. Consult. Clin. Psychol. 74:658–70 [Google Scholar]
  39. Douglas V. 1989. Can Skinnerian theory explain attention deficit disorder? A reply to Barkley. Attention Deficit Disorder: Current Concepts and Emerging Trends in Attentional and Behavioural Disorders of Childhood LM Bloomingdale, J Swanson 235–54 Oxford: Pergamon [Google Scholar]
  40. Elster J. 1998. Emotions and economic theory. J. Econ. Lit. 36:47–74 [Google Scholar]
  41. Fawcett J, Clark DC, Scheftner WA, Hedeker D. 1983. Differences between anhedonic and normally hedonic depressive states. Am. J. Psychiatry 140:1027–30 [Google Scholar]
  42. Feighner JP, Robins E, Guze SB, Woodruff RA, Winokur G, Munoz R. 1972. Diagnostic criteria for use in psychiatric research. Arch. Gen. Psychiatry 26:57–63 [Google Scholar]
  43. Ferenczi EA, Zalocusky KA, Liston C, Grosenick L, Warden MR. et al. 2016. Prefrontal cortical regulation of brainwide circuit dynamics and reward-related behavior. Science 351:aac9698 [Google Scholar]
  44. Ferster CB, Skinner BF. 1957. Schedules of Reinforcement. New York: Appleton-Century-Crofts
  45. Fiorillo CD, Tobler PN, Schultz W. 2003. Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898–902 [Google Scholar]
  46. Flannery B, Volpicelli J, Pettinati H. 1999. Psychometric properties of the Penn Alcohol Craving Scale. Alcohol. Clin. Exp. Res. 23:1289–95 [Google Scholar]
  47. Floresco SB, St Onge JR, Ghods-Sharifi S, Winstanley CA. 2008. Cortico-limbic-striatal circuits subserving different forms of cost-benefit decision making. Cogn. Affect. Behav. Neurosci. 8:375–89 [Google Scholar]
  48. Frank MJ, Seeberger LC, O'Reilly RC. 2004. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306:1940–43 [Google Scholar]
  49. Fusar-Poli P, Meyer-Lindenberg A. 2013. Striatal presynaptic dopamine in schizophrenia, Part II: meta-analysis of [18F/11C]-DOPA PET studies. Schizophr. Bull 39:33–42 [Google Scholar]
  50. Gard DE, Gard MG, Kring AM, John OP. 2006. Anticipatory and consummatory components of the experience of pleasure: a scale development study. J. Res. Personal. 40:1086–102 [Google Scholar]
  51. Gard DE, Sanchez AH, Cooper K, Fisher M, Garrett C, Vinogradov S. 2014. Do people with schizophrenia have difficulty anticipating pleasure, engaging in effortful behavior, or both?. J. Abnorm. Psychol. 123:771–82 [Google Scholar]
  52. Gold JM, Strauss GP, Waltz JA, Robinson BM, Brown JK, Frank MJ. 2013. Negative symptoms of schizophrenia are associated with abnormal effort-cost computations. Biol. Psychiatry 74:130–36 [Google Scholar]
  53. Gold JM, Waltz JA, Frank MJ. 2015. Effort cost computation in schizophrenia: a commentary on the recent literature. Biol. Psychiatry 78:747–53 [Google Scholar]
  54. Gold JM, Waltz JA, Prentice KJ, Morris SE, Heerey EA. 2008. Reward processing in schizophrenia: a deficit in the representation of value. Schizophr. Bull. 34:835–47 [Google Scholar]
  55. Gray JA. 1970. The psychophysiological basis of introversion-extraversion. Behav. Res. Ther. 8:249–66 [Google Scholar]
  56. Greenberg T, Chase HW, Almeida JR, Stiffler R, Zevallos CR. et al. 2015. Moderation of the relationship between reward expectancy and prediction error-related ventral striatal reactivity by anhedonia in unmedicated major depressive disorder: findings from the EMBARC study. Am. J. Psychiatry 172:881–91 [Google Scholar]
  57. Haenlein M, Caul WF. 1987. Attention deficit disorder with hyperactivity: a specific hypothesis of reward dysfunction. Am. Acad. Child Adolesc. Psychiatry 26:356–62 [Google Scholar]
  58. Hajcak G, Moser JS, Holroyd CB, Simons RF. 2006. The feedback-related negativity reflects the binary evaluation of good versus bad outcomes. Biol. Psychol. 71:148–54 [Google Scholar]
  59. Heller AS, Johnstone T, Shackman AJ, Light SN, Peterson MJ. et al. 2009. Reduced capacity to sustain positive emotion in major depression reflects diminished maintenance of fronto-striatal brain activation. PNAS 106:22445–50 [Google Scholar]
  60. Hershenberg R, Satterthwaite TD, Daldal A, Katchmar N, Moore TM. et al. 2016. Diminished effort on a progressive ratio task in both unipolar and bipolar depression. J. Affect. Disord. 196:97–100 [Google Scholar]
  61. Howes OD, Kapur S. 2009. The dopamine hypothesis of schizophrenia: Version III—the final common pathway. Schizophr. Bull. 35:549–62 [Google Scholar]
  62. Huys QJ, Pizzagalli DA, Bogdan R, Dayan P. 2013. Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis. Biol. Mood Anxiety Disord. 3:12 [Google Scholar]
  63. Insel T, Cuthbert B, Garvey M, Heinssen R, Pine DS. et al. 2010. Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am. J. Psychiatry 167:748–51 [Google Scholar]
  64. Jackson CJ, Smillie LD. 2004. Appetitive motivation predicts the majority of personality and an ability measure: a comparison of BAS measures. Personal. Individ. Differ. 36:1627–36 [Google Scholar]
  65. Johnson SL, Edge MD, Holmes MK, Carver CS. 2012. The behavioral activation system and mania. Annu. Rev. Clin. Psychol. 8:243–67 [Google Scholar]
  66. Joormann J, Gotlib IH. 2006. Is this happiness I see? Biases in the identification of emotional facial expressions in depression and social phobia. J. Abnorm. Psychol. 115:705–14 [Google Scholar]
  67. Juckel G, Schlagenhauf F, Koslowski M, Wustenberg T, Villringer A. et al. 2006. Dysfunction of ventral striatal reward prediction in schizophrenia. Neuroimage 29:409–16 [Google Scholar]
  68. Kable JW, Glimcher PW. 2007. The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 10:1625–33 [Google Scholar]
  69. Kahneman D, Krueger AB, Schkade D, Schwarz N, Stone AA. 2006. Would you be happier if you were richer? A focusing illusion. Science 312:1908–10 [Google Scholar]
  70. Keedwell PA, Andrew C, Williams SC, Brammer MJ, Phillips ML. 2005. The neural correlates of anhedonia in major depressive disorder. Biol. Psychiatry 58:843–53 [Google Scholar]
  71. Kessler RC, McGonagle KA, Zhao S, Nelson CB, Hughes M. et al. 1994. Lifetime and 12-month prevalence of DSM-III-R psychiatric disorders in the United States: results from the National Comorbidity Survey. Arch. Gen. Psychiatry 51:8–19 [Google Scholar]
  72. Kirschner M, Hager OM, Bischof M, Hartmann-Riemer MN, Kluge A. et al. 2016. Deficits in context-dependent adaptive coding of reward in schizophrenia. NPJ Schizophr 2:16020 [Google Scholar]
  73. Klein DF. 1974. Endogenomorphic depression: a conceptual and terminological revision. Arch. Gen. Psychiatry 31:447–54 [Google Scholar]
  74. Klein-Flügge MC, Kennerley SW, Saraiva AC, Penny WD, Bestmann S. 2015. Behavioral modeling of human choices reveals dissociable effects of physical effort and temporal delay on reward devaluation. PLOS Comput. Biol. 11:e1004116 [Google Scholar]
  75. Knutson B, Fong GW, Adams CM, Varner JL, Hommer D. 2001. Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport 12:3683–87 [Google Scholar]
  76. Kobayashi S, Schultz W. 2008. Influence of reward delays on responses of dopamine neurons. J. Neurosci. 28:7837–46 [Google Scholar]
  77. Kollins SH, Lane SD, Shapiro SK. 1997. Experimental analysis of childhood psychopathology: a laboratory matching analysis of the behavior of children diagnosed with attention-deficit hyperactivity disorder (ADHD). Psychol. Rec. 47:25–44 [Google Scholar]
  78. Korn C, Sharot T, Walter H, Heekeren H, Dolan R. 2014. Depression is related to an absence of optimistically biased belief updating about future life events. Psychol. Med. 44:579–92 [Google Scholar]
  79. Kumar P, Waiter G, Ahearn T, Milders M, Reid I, Steele JD. 2008. Abnormal temporal difference reward-learning signals in major depression. Brain 131:2084–93 [Google Scholar]
  80. Lemmens SG, Rutters F, Born JM, Westerterp-Plantenga MS. 2011. Stress augments food ‘wanting’ and energy intake in visceral overweight subjects in the absence of hunger. Physiol. Behav. 103:157–63 [Google Scholar]
  81. Leyton M, Vezina P. 2013. Striatal ups and downs: their roles in vulnerability to addictions in humans. Neurosci. Biobehav. Rev. 37:1999–2014 [Google Scholar]
  82. Lighthall NR, Gorlick MA, Schoeke A, Frank MJ, Mather M. 2012. Stress modulates reinforcement learning in younger and older adults. Psychol. Aging 28:35–46 [Google Scholar]
  83. Loewenstein G. 2000. Emotions in economic theory and economic behavior. Am. Econ. Rev. 90:426–32 [Google Scholar]
  84. Luman M, Oosterlaan J, Sergeant JA. 2005. The impact of reinforcement contingencies on AD/HD: a review and theoretical appraisal. Clin. Psychol. Rev. 25:183–213 [Google Scholar]
  85. Luman M, Tripp G, Scheres A. 2010. Identifying the neurobiology of altered reinforcement sensitivity in ADHD: a review and research agenda. Neurosci. Biobehav. Rev. 34:744–54 [Google Scholar]
  86. Maunsell JH. 2004. Neuronal representations of cognitive state: reward or attention. Trends Cogn. Sci. 8:261–65 [Google Scholar]
  87. McCarthy JM, Treadway MT, Bennett ME, Blanchard JJ. 2016. Inefficient effort allocation and negative symptoms in individuals with schizophrenia. Schizophr. Res. 170:278–84 [Google Scholar]
  88. McCrae RR, Costa PT Jr. 1987. Validation of the five-factor model of personality across instruments and observers. J. Personal. Soc. Psychol. 52:81–90 [Google Scholar]
  89. Meehl PE. 1975. Hedonic capacity: some conjectures. Bull. Menninger Clin. 39:295–307 [Google Scholar]
  90. Miller WR, Rollnick S. 2012. Motivational Interviewing: Helping People Change. New York: Guilford
  91. Montague PR, Dolan RJ, Friston KJ, Dayan P. 2012. Computational psychiatry. Trends Cogn. Sci. 16:72–80 [Google Scholar]
  92. Morris RW, Griffiths O, Le Pelley ME, Weickert TW. 2012. Attention to irrelevant cues is related to positive symptoms in schizophrenia. Schizophr. Bull. 39:575–82 [Google Scholar]
  93. Nader MA, Morgan D, Gage HD, Nader SH, Calhoun TL. et al. 2006. PET imaging of dopamine D2 receptors during chronic cocaine self-administration in monkeys. Nat. Neurosci. 9:1050–56 [Google Scholar]
  94. Nieuwenhuis S, Heslenfeld DJ, von Geusau NJ, Mars RB, Holroyd CB, Yeung N. 2005. Activity in human reward-sensitive brain areas is strongly context dependent. NeuroImage 25:1302–9 [Google Scholar]
  95. Niv Y, Daw ND, Daphna J, Dayan P. 2007. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology 191:507–20 [Google Scholar]
  96. Nusslock R, Almeida JR, Forbes EE, Versace A, Frank E. et al. 2012. Waiting to win: elevated striatal and orbitofrontal cortical activity during reward anticipation in euthymic bipolar disorder adults. Bipolar Disord 14:249–60 [Google Scholar]
  97. O'Doherty JP. 2014. The problem with value. Neurosci. Biobehav. Rev. 43:259–68 [Google Scholar]
  98. Odum AL. 2011. Delay discounting: I'm a k, you're a k. J. Exp. Anal. Behav. 96:427–39 [Google Scholar]
  99. Otto AR, Raio CM, Chiang A, Phelps EA, Daw ND. 2013. Working-memory capacity protects model-based learning from stress. PNAS 110:20941–46 [Google Scholar]
  100. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD. 2006. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442:1042–45 [Google Scholar]
  101. Pizzagalli DA, Bogdan R, Ratner KG, Jahn AL. 2007. Increased perceived stress is associated with blunted hedonic capacity: potential implications for depression research. Behav. Res. Ther. 45:2742–53 [Google Scholar]
  102. Pizzagalli DA, Holmes AJ, Dillon DG, Goetz EL, Birk JL. et al. 2009. Reduced caudate and nucleus accumbens response to rewards in unmedicated individuals with major depressive disorder. Am. J. Psychiatry 166:702–10 [Google Scholar]
  103. Pizzagalli DA, Iosifescu D, Hallett LA, Ratner KG, Fava M. 2008. Reduced hedonic capacity in major depressive disorder: evidence from a probabilistic reward task. J. Psychiatr. Res. 43:76–87 [Google Scholar]
  104. Plichta MM, Scheres A. 2014. Ventral-striatal responsiveness during reward anticipation in ADHD and its relation to trait impulsivity in the healthy population: a meta-analytic review of the fMRI literature. Neurosci. Biobehav. Rev. 38:125–34 [Google Scholar]
  105. Prevost C, Pessiglione M, Metereau E, Clery-Melin ML, Dreher JC. 2010. Separate valuation subsystems for delay and effort decision costs. J. Neurosci. 30:14080–90 [Google Scholar]
  106. Rangel A, Camerer C, Montague PR. 2008. A framework for studying the neurobiology of value-based decision making. Nat. Rev. Neurosci. 9:545–56 [Google Scholar]
  107. Reddy LF, Horan WP, Barch DM, Buchanan RW, Dunayevich E. et al. 2015. Effort-based decision-making paradigms for clinical trials in schizophrenia: Part 1—psychometric characteristics of 5 paradigms. Schizophr. Bull. 41:1045–54 [Google Scholar]
  108. Robinson MJ, Warlow SM, Berridge KC. 2014. Optogenetic excitation of central amygdala amplifies and narrows incentive motivation to pursue one reward above another. J. Neurosci. 34:16567–80 [Google Scholar]
  109. Rudebeck PH, Walton ME, Smyth AN, Bannerman DM, Rushworth MF. 2006. Separate neural pathways process different decision costs. Nat. Neurosci. 9:1161–68 [Google Scholar]
  110. Russell JA, Barrett LF. 1999. Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant. J. Personal. Soc. Psychol. 76:805–19 [Google Scholar]
  111. Rutledge RB, Dean M, Caplin A, Glimcher PW. 2010. Testing the reward prediction error hypothesis with an axiomatic model. J. Neurosci. 30:13525–36 [Google Scholar]
  112. Rutledge RB, Skandali N, Dayan P, Dolan RJ. 2014. A computational and neural model of momentary subjective well-being. PNAS 111:12252–57 [Google Scholar]
  113. Salamone JD, Yohn SE, López-Cruz L, San Miguel N, Correa M. 2016. Activational and effort-related aspects of motivation: neural mechanisms and implications for psychopathology. Brain 139:1325–47 [Google Scholar]
  114. Schönberg T, Daw ND, Joel D, O'Doherty JP. 2007. Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J. Neurosci. 27:12860–67 [Google Scholar]
  115. Schultz W. 2015. Neuronal reward and decision signals: from theories to data. Physiol. Rev. 95:853–951 [Google Scholar]
  116. Schultz W, Carelli RM, Wightman RM. 2015. Phasic dopamine signals: from subjective reward value to formal economic utility. Curr. Opin. Behav. Sci. 5:147–54 [Google Scholar]
  117. Schultz W, Dayan P, Montague PR. 1997. A neural substrate of prediction and reward. Science 275:1593–99 [Google Scholar]
  118. Schwabe L, Wolf OT. 2009. Stress prompts habit behavior in humans. J. Neurosci. 29:7191–98 [Google Scholar]
  119. Sergeant JA, Oosterlaan J, van der Meere J. 1999. Information processing and energetic factors in attention-deficit/hyperactivity disorder. Handbook of Disruptive Behavior Disorders HC Quay, AE Hogan 75–104 New York: Springer [Google Scholar]
  120. Seymour B, McClure SM. 2008. Anchors, scales and the relative coding of value in the brain. Curr. Opin. Neurobiol. 18:173–78 [Google Scholar]
  121. Snaith RP, Hamilton M, Morley S, Humayan A, Hargreaves D, Trigwell P. 1995. A scale for the assessment of hedonic tone the Snaith-Hamilton Pleasure Scale. Br. J. Psychiatry 167:99–103 [Google Scholar]
  122. Solhan MB, Trull TJ, Jahng S, Wood PK. 2009. Clinical assessment of affective instability: comparing EMA indices, questionnaire reports, and retrospective recall. Psychol. Assess. 21:425–36 [Google Scholar]
  123. Strauss GP. 2013. The emotion paradox of anhedonia in schizophrenia: or is it?. Schizophr. Bull. 39:247–50 [Google Scholar]
  124. Strauss GP, Gold JM. 2012. A new perspective on anhedonia in schizophrenia. Am. J. Psychiatry 169:364–73 [Google Scholar]
  125. Strauss GP, Robinson BM, Waltz JA, Frank MJ, Kasanova Z. et al. 2011. Patients with schizophrenia demonstrate inconsistent preference judgments for affective and nonaffective stimuli. Schizophr. Bull. 37:1295–304 [Google Scholar]
  126. Strunk DR, Lopez H, DeRubeis RJ. 2006. Depressive symptoms are associated with unrealistic negative predictions of future life events. Behav. Res. Ther. 44:861–82 [Google Scholar]
  127. Syed EC, Grima LL, Magill PJ, Bogacz R, Brown P, Walton ME. 2016. Action initiation shapes mesolimbic dopamine encoding of future rewards. Nat. Neurosci. 19:34–36 [Google Scholar]
  128. Tellegen A, Waller NJ. 2008. Exploring personality through test construction: development of the multidimensional personality questionnaire. The SAGE Handbook of Personality Theory and Assessment 2 Personality Measurement and Testing GJ Boyle, G Matthews, DH Saklofske 261–92 London: Sage [Google Scholar]
  129. Thanos PK, Michaelides M, Umegaki H, Volkow ND. 2008. D2R DNA transfer into the nucleus accumbens attenuates cocaine self-administration in rats. Synapse 62:481–86 [Google Scholar]
  130. Tiffany ST, Singleton E, Haertzen CA, Henningfield JE. 1993. The development of a cocaine craving questionnaire. Drug Alcohol Depend 34:19–28 [Google Scholar]
  131. Tobler PN, Fiorillo CD, Schultz W. 2005. Adaptive coding of reward value by dopamine neurons. Science 307:1642–45 [Google Scholar]
  132. Torrubia R, Avila C, Moltó J, Caseras X. 2001. The Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ) as a measure of Gray's anxiety and impulsivity dimensions. Personal. Individ. Differ. 31:837–62 [Google Scholar]
  133. Treadway MT, Bossaller NA, Shelton RC, Zald DH. 2012. Effort-based decision-making in major depressive disorder: a translational model of motivational anhedonia. J. Abnorm. Psychol. 121:553–58 [Google Scholar]
  134. Treadway MT, Leonard CV. 2016. Isolating biomarkers for symptomatic states: considering symptom-substrate chronometry. Mol. Psychiatry 21:1180–87 [Google Scholar]
  135. Treadway MT, Peterman JS, Zald DH, Park S. 2015. Impaired effort allocation in patients with schizophrenia. Schizophr. Res. 161:382–85 [Google Scholar]
  136. Treadway MT, Pizzagalli DA. 2014. Imaging the pathophysiology of major depressive disorder—from localist models to circuit-based analysis. Biol. Mood Anxiety Disord. 4:5 [Google Scholar]
  137. Treadway MT, Zald DH. 2011. Reconsidering anhedonia in depression: lessons from translational neuroscience. Neurosci. Biobehav. Rev. 35:537–55 [Google Scholar]
  138. Treadway MT, Zald DH. 2013. Parsing anhedonia: translational models of reward-processing deficits in psychopathology. Curr. Dir. Psychol. Sci. 22:244–49 [Google Scholar]
  139. Tremblay L, Schultz W. 1999. Relative reward preference in primate orbitofrontal cortex. Nature 398:704–8 [Google Scholar]
  140. Tripp G, Wickens JR. 2008. Research review: dopamine transfer deficit: a neurobiological theory of altered reinforcement mechanisms in ADHD. J. Child Psychol. Psychiatry 49:691–704 [Google Scholar]
  141. Trull TJ, Ebner-Priemer U. 2013. Ambulatory assessment. Annu. Rev. Clin. Psychol. 9:151–76 [Google Scholar]
  142. Varazzani C, San-Galli A, Gilardeau S, Bouret S. 2015. Noradrenaline and dopamine neurons in the reward/effort trade-off: a direct electrophysiological comparison in behaving monkeys. J. Neurosci. 35:7866–77 [Google Scholar]
  143. Vilhauer JS, Young S, Kealoha C, Borrmann J, IsHak WW. et al. 2012. Treating major depression by creating positive expectations for the future: a pilot study for the effectiveness of future-directed therapy (FDT) on symptom severity and quality of life. CNS Neurosci. Ther. 18:102–9 [Google Scholar]
  144. Volkow ND, Wang GJ, Fowler JS, Logan J, Gatley SJ. et al. 1997. Decreased striatal dopaminergic responsiveness in detoxified cocaine-dependent subjects. Nature 386:830–33 [Google Scholar]
  145. Volkow ND, Wang GJ, Newcorn JH, Kollins SH, Wigal TL. et al. 2011. Motivation deficit in ADHD is associated with dysfunction of the dopamine reward pathway. Mol. Psychiatry 16:1147–54 [Google Scholar]
  146. Wade TR, de Wit H, Richards JB. 2000. Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology 150:90–101 [Google Scholar]
  147. Watson D, Naragon-Gainey K. 2009. On the specificity of positive emotional dysfunction in psychopathology: evidence from the mood and anxiety disorders and schizophrenia/schizotypy. Clin. Psychol. Rev. 30:839–48 [Google Scholar]
  148. Watson D, Weber K, Assenheimer JS, Clark LA, Strauss ME, McCormick RA. 1995. Testing a tripartite model: I. Evaluating the convergent and discriminant validity of anxiety and depression symptom scales. J. Abnorm. Psychol. 104:3–14 [Google Scholar]
  149. Willner P, Muscat R, Papp M. 1992. Chronic mild stress-induced anhedonia: a realistic animal model of depression. Neurosci. Biobehav. Rev. 16:525–34 [Google Scholar]
  150. Wilson RC, Niv Y. 2015. Is model fitting necessary for model-based fMRI?. PLOS Comput. Biol. 11:e1004237 [Google Scholar]
  151. Winer ES, Veilleux JC, Ginger EJ. 2014. Development and validation of the Specific Loss of Interest and Pleasure Scale (SLIPS). J. Affect. Disord. 152:193–201 [Google Scholar]
  152. Winton-Brown TT, Fusar-Poli P, Ungless MA, Howes OD. 2014. Dopaminergic basis of salience dysregulation in psychosis. Trends Neurosci 37:85–94 [Google Scholar]
  153. Yang X-h, Huang J, Zhu C-y, Wang Y-f, Cheung EFC. et al. 2014. Motivational deficits in effort-based decision making in individuals with subsyndromal depression, first-episode and remitted depression patients. Psychiatry Res 220:874–82 [Google Scholar]
/content/journals/10.1146/annurev-clinpsy-032816-044957
Loading
/content/journals/10.1146/annurev-clinpsy-032816-044957
Loading

Data & Media loading...

  • Article Type: Review Article
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error