1932
0
  1. Home
  2. A-Z Publications
  3. Annual Review of Neuroscience
  4. Volume 38, 2015
  5. Article

Annual Review of Neuroscience

Volume 38, 2015

Depression: A Decision-Theoretic Analysis

Abstract

The manifold symptoms of depression are common and often transient features of healthy life that are likely to be adaptive in difficult circumstances. It is when these symptoms enter a seemingly self-propelling spiral that the maladaptive features of a disorder emerge. We examine this malignant transformation from the perspective of the computational neuroscience of decision making, investigating how dysfunction of the brain's mechanisms of evaluation might lie at its heart. We start by considering the behavioral implications of pessimistic evaluations of decision variables. We then provide a selective review of work suggesting how such pessimism might arise via specific failures of the mechanisms of evaluation or state estimation. Finally, we analyze ways that miscalibration between the subject and environment may be self-perpetuating. We employ the formal framework of Bayesian decision theory as a foundation for this study, showing how most of the problems arise from one of its broad algorithmic facets, namely model-based reasoning.

Keyword(s): decision theory, depression, model-based control, model-free control, reinforcement learning
Loading

Article metrics loading...

/content/journals/10.1146/annurev-neuro-071714-033928
2015-07-08
2024-04-19
Loading full text...

Full text loading...

/deliver/fulltext/neuro/38/1/annurev-neuro-071714-033928.html?itemId=/content/journals/10.1146/annurev-neuro-071714-033928&mimeType=html&fmt=ahah

Literature Cited

  1. Abramson LY, Seligman ME, Teasdale JD. 1978. Learned helplessness in humans: critique and reformulation. J. Abnorm. Psychol. 87:149–74 [Google Scholar]
  2. Alloy LB, Abramson LY, Whitehouse WG, Hogan ME, Tashman NA. et al. 1999. Depressogenic cognitive styles: predictive validity, information processing and personality characteristics, and developmental origins. Behav. Res. Ther. 37:6503–31 [Google Scholar]
  3. Am. Psychiatr. Assoc 2013. Diagnostic and Statistical Manual of Mental Disorders. Washington, DC: Am. Psychiatr. Assoc., 5th ed..
  4. Amat J, Baratta MV, Paul E, Bland ST, Watkins LR, Maier SF. 2005. Medial prefrontal cortex determines how stressor controllability affects behavior and dorsal raphe nucleus. Nat. Neurosci. 8:3365–71 [Google Scholar]
  5. Amemori K-I, Graybiel AM. 2012. Localized microstimulation of primate pregenual cingulate cortex induces negative decision-making. Nat. Neurosci. 15:5776–85 [Google Scholar]
  6. Amsterdam JD, Settle RG, Doty RL, Abelman E, Winokur A. 1987. Taste and smell perception in depression. Biol. Psychiatry 22:121481–85 [Google Scholar]
  7. Ariely D, Loewenstein G, Prelec D. 2003. Coherent arbitrariness: stable demand curves without stable preferences. Q. J. Econ. 118:173–105 [Google Scholar]
  8. Armstrong T, Olatunji BO. 2012. Eye tracking of attention in the affective disorders: a meta-analytic review and synthesis. Clin. Psychol. Rev. 32:8704–23 [Google Scholar]
  9. Barry ES, Naus MJ, Rehm LP. 2004. Depression and implicit memory: understanding mood congruent memory bias. Cogn. Ther. Res. 28:3387–414 [Google Scholar]
  10. Bartlett FC. 1932. Remembering: A Study in Experimental and Social Psychology Cambridge, UK: Cambridge Univ. Press
  11. Beck AT. 1967. Depression: Clinical, Experimental and Theoretical Aspects New York: Harper & Row
  12. Beck AT. 1976. Cognitive Therapy and the Emotional Disorders New York: Int. Univ. Press
  13. Berlin I, Givry-Steiner L, Lecrubier Y, Puech AJ. 1998. Measures of anhedonia and hedonic responses to sucrose in depressive and schizophrenic patients in comparison with healthy subjects. Eur. Psychiatry 13:6303–9 [Google Scholar]
  14. Berridge KC, Robinson TE. 1998. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience. Brain Res. Rev. 28:3209–69 [Google Scholar]
  15. Blackwell SE, Holmes EA. 2010. Modifying interpretation and imagination in clinical depression: a single case series using cognitive bias modification. Appl. Cogn. Psychol. 24:3338–50 [Google Scholar]
  16. Boureau Y-L, Dayan P. 2011. Opponency revisited: competition and cooperation between dopamine and serotonin. Neuropsychopharmacology 36:174–97 [Google Scholar]
  17. Borkovec TD, Roemer L. 1995. Perceived functions of worry among generalized anxiety disorder subjects: distraction from more emotionally distressing topics?. J. Behav. Ther. Exp. Psychiatry 26:125–30 [Google Scholar]
  18. Buchsbaum MS. 1979. Neurophysiological reactivity, stimulus intensity modulation and the depressive disorders. The Psychobiology of Depressive Disorders: Implications for the Effects of Stress RA Depue 221–42 New York: Academic [Google Scholar]
  19. Burke HM, Davis MC, Otte C, Mohr DC. 2005. Depression and cortisol responses to psychological stress: a meta-analysis. Psychoneuroendocrinology 30:9846–56 [Google Scholar]
  20. Bylsma LM, Morris BH, Rottenberg J. 2008. A meta-analysis of emotional reactivity in major depressive disorder. Clin. Psychol. Rev. 28:4676–91 [Google Scholar]
  21. Candy M, Jones L, Williams R, Tookman A, King M. 2008. Psychostimulants for depression. Cochrane Database Syst. Rev. 2008:2CD006722 [Google Scholar]
  22. Caseras X, Garner M, Bradley BP, Mogg K. 2007. Biases in visual orienting to negative and positive scenes in dysphoria: an eye movement study. J. Abnorm. Psychol. 116:3491–97 [Google Scholar]
  23. Chase HW, Frank MJ, Michael A, Bullmore ET, Sahakian BJ, Robbins TW. 2009. Approach and avoidance learning in patients with major depression and healthy controls: relation to anhedonia. Psychol. Med. 40:3433–40 [Google Scholar]
  24. Chikkerur S, Serre T, Tan C, Poggio T. 2010. What and where: a Bayesian inference theory of attention. Vision Res. 50:222233–47 [Google Scholar]
  25. Clepce M, Gossler A, Reich K, Kornhuber J, Thuerauf N. 2010. The relation between depression, anhedonia and olfactory hedonic estimates—a pilot study in major depression. Neurosci. Lett. 471:3139–43 [Google Scholar]
  26. Coan JA, Allen JJB. 2007. Handbook of Emotion Elicitation and Assessment New York: Oxford Univ. Press
  27. Cohen JD, Braver TS, O'Reilly RC. 1996. A computational approach to prefrontal cortex, cognitive control and schizophrenia: recent developments and current challenges. Philos. Trans. R. Soc. Lond. B Biol. Sci. 351:13461515–27 [Google Scholar]
  28. Cools R, Nakamura K, Daw ND. 2011. Serotonin and dopamine: unifying affective, activational, and decision functions. Neuropsychopharmacology 36:198–113 [Google Scholar]
  29. Cowden Hindash AH, Amir N. 2012. Negative interpretation bias in individuals with depressive symptoms. Cogn. Ther. Res. 36:5502–11 [Google Scholar]
  30. Crockett MJ, Clark L, Robbins TW. 2009. Reconciling the role of serotonin in behavioral inhibition and aversion: acute tryptophan depletion abolishes punishment-induced inhibition in humans. J. Neurosci. 29:3811993–99 [Google Scholar]
  31. Cutrona CE. 1983. Causal attributions and perinatal depression. J. Abnorm. Psychol. 92:2161–72 [Google Scholar]
  32. Dantzer R, O'Connor JC, Freund GG, Johnson RW, Kelley KW. 2008. From inflammation to sickness and depression: when the immune system subjugates the brain. Nat. Rev. Neurosci. 9:146–56 [Google Scholar]
  33. D'Avanzato C, Joormann J, Siemer M, Gotlib IH. 2013. Emotion regulation in depression and anxiety: examining diagnostic specificity and stability of strategy use. Cogn. Ther. Res. 37:5968–80 [Google Scholar]
  34. Daw ND, Dayan P. 2014. The algorithmic anatomy of model-based evaluation. Philos. Trans. R. Soc. Lond. B Biol. Sci. 369:165520130478 [Google Scholar]
  35. Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ. 2011. Model-based influences on humans' choices and striatal prediction errors. Neuron 69:61204–15 [Google Scholar]
  36. Daw ND, Niv Y, Dayan P. 2005. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8:121704–11 [Google Scholar]
  37. Dayan P. 2012. How to set the switches on this thing. Curr. Opin. Neurobiol. 22:61068–74 [Google Scholar]
  38. Dayan P, Daw ND. 2008. Decision theory, reinforcement learning, and the brain. Cogn. Affect. Behav. Neurosci. 8:4429–53 [Google Scholar]
  39. Dayan P, Huys QJM. 2008. Serotonin, inhibition, and negative mood. PLOS Comput. Biol. 4:2e4 [Google Scholar]
  40. Dayan P, Niv Y, Seymour B, Daw ND. 2006. The misbehavior of value and the discipline of the will. Neural Netw. 19:81153–60 [Google Scholar]
  41. Dichter GS, Smoski MJ, Kampov-Polevoy AB, Gallop R, Garbutt JC. 2010. Unipolar depression does not moderate responses to the sweet taste test. Depress Anxiety 27:9859–63 [Google Scholar]
  42. Dickinson A. 1980. Contemporary Animal Learning Theory Cambridge, UK: Cambridge Univ. Press
  43. Diener C, Kuehner C, Brusniak W, Ubl B, Wessa M, Flor H. 2012. A meta-analysis of neurofunctional imaging studies of emotion and cognition in major depression. Neuroimage 61:3677–85 [Google Scholar]
  44. Dillon DG, Pizzagalli DA. 2013. Evidence of successful modulation of brain activation and subjective experience during reappraisal of negative emotion in unmedicated depression. Psychiatry Res. Neuroimaging 212:99–107 [Google Scholar]
  45. Dombrovski AY, Cyranowski JM, Mulsant BH, Houck PR, Buysse DJ. et al. 2008. Which symptoms predict recurrence of depression in women treated with maintenance interpersonal psychotherapy?. Depress. Anxiety 25:121060–66 [Google Scholar]
  46. Ehring T, Tuschen-Caffier B, Schnülle J, Fischer S, Gross JJ. 2010. Emotion regulation and vulnerability to depression: spontaneous versus instructed use of emotion suppression and reappraisal. Emotion 10:4563–72 [Google Scholar]
  47. Eldar E, Niv Y. 2015. Interaction between emotional state and learning underlies mood instability. Nat. Commun. 66149
  48. Elliott R, Sahakian BJ, Herrod JJ, Robbins TW, Paykel ES. 1997. Abnormal response to negative feedback in unipolar depression: evidence for a diagnosis-specific impairment. J. Neurol. Neurosurg. Psychiatry 63:74–82 [Google Scholar]
  49. Elliott R, Zahn R, Deakin JFW, Anderson IM. 2011. Affective cognition and its disruption in mood disorders. Neuropsychopharmacology 36:1153–82 [Google Scholar]
  50. Erickson K, Drevets WC, Clark L, Cannon DM, Bain EE. et al. 2005. Mood-congruent bias in affective go/no-go performance of unmedicated patients with major depressive disorder. Am. J. Psychiatry 162:112171–73 [Google Scholar]
  51. Fales CL, Barch DM, Rundle MM, Mintun MA, Snyder AZ. et al. 2008. Altered emotional interference processing in affective and cognitive-control brain circuitry in major depression. Biol. Psychiatry 63:4377–84 [Google Scholar]
  52. Forbes EE, May JC, Siegle GJ, Ladouceur CD, Ryan ND. et al. 2006. Reward-related decision-making in pediatric major depressive disorder: an fMRI study. J. Child Psychol. Psychiatry 47:101031–40 [Google Scholar]
  53. Forbes EE, Hariri AR, Martin SL, Silk JS, Moyles DL. et al. 2009. Altered striatal activation predicting real-world positive affect in adolescent major depressive disorder. Am. J. Psychiatry 166:164–73 [Google Scholar]
  54. Ford DE, Kamerow DB. 1989. Epidemiologic study of sleep disturbances and psychiatric disorders: an opportunity for prevention?. JAMA 262:111479–84 [Google Scholar]
  55. Frederick S, Loewenstein G. 1999. Hedonic adaptation. Well-Being: The Foundations of a Hedonic Psychology E Diener, N Schwarz 302–29 New York: Russell Sage Found. [Google Scholar]
  56. Fu CHY, Steiner H, Costafreda SG. 2013. Predictive neural biomarkers of clinical response in depression: a meta-analysis of functional and structural neuroimaging studies of pharmacological and psychological therapies. Neurobiol. Dis. 52:75–83 [Google Scholar]
  57. Gershman SJ, Markman AB, Otto AR. 2014. Retrospective revaluation in sequential decision making: a tale of two systems. J. Exp. Psychol. Gen. 143:1182–94 [Google Scholar]
  58. Gotlib IH, Joormann J. 2010. Cognition and depression: current status and future directions. Annu. Rev. Clin. Psychol. 6:285–312 [Google Scholar]
  59. Gradin VB, Kumar P, Waiter G, Ahearn T, Stickle C. et al. 2011. Expected value and prediction error abnormalities in depression and schizophrenia. Brain 134:Part 61751–64 [Google Scholar]
  60. Gross JJ. 2002. Emotion regulation: affective, cognitive, and social consequences. Psychophysiology 39:3281–91 [Google Scholar]
  61. Haeffel GJ. 2011. After further deliberation: Cognitive vulnerability predicts changes in event-specific negative inferences for a poor midterm grade. Cogn. Ther. Res. 35:4285–92 [Google Scholar]
  62. Haeffel GJ, Abramson LY, Brazy PC, Shah JY, Teachman BA, Nosek BA. 2007. Explicit and implicit cognition: a preliminary test of a dual-process theory of cognitive vulnerability to depression. Behav. Res. Ther. 45:61155–67 [Google Scholar]
  63. Harmer CJ, Goodwin GM, Cowen PJ. 2009. Why do antidepressants take so long to work? A cognitive neuropsychological model of antidepressant drug action. Br. J. Psychiatry 195:2102–8 [Google Scholar]
  64. Hay N, Russell SJ. 2011. Metareasoning for Monte Carlo tree search Tech. Rep., Electr. Eng. Comput. Sci., Univ. Calif., Berkeley
  65. Holmes AJ, Pizzagalli DA. 2007. Task feedback effects on conflict monitoring and executive control: relationship to subclinical measures of depression. Emotion 7:168–76 [Google Scholar]
  66. Huys QJM. 2007. Reinforcers and control: towards a computational ætiology of depression. PhD Thesis, Gatsby Comput. Neurosci. Unit, Univ. Coll. London, Univ. London
  67. Huys QJM, Dayan P. 2009. A Bayesian formulation of behavioral control. Cognition 113:3314–28 [Google Scholar]
  68. Huys QJM, Eshel N, O'Nions E, Sheridan L, Dayan P, Roiser JP. 2012. Bonsai trees in your head: how the Pavlovian system sculpts goal-directed choices by pruning decision trees. PLOS Comput. Biol. 8:3e1002410 [Google Scholar]
  69. Huys QJM, Guitart-Masip M, Dolan RJ, Dayan P. 2015. Decision-theoretic psychiatry. Clin. Psychol. Sci. In press
  70. Huys QJM, Pizzagalli DA, Bogdan R, Dayan P. 2013. Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis. Biol. Mood Anxiety Disord. 3:112 [Google Scholar]
  71. Huys QJM, Tobler PN, Hasler G, Flagel SB. 2014. The role of learning-related dopamine signals in addiction vulnerability. Prog. Brain Res. 211:31–77 [Google Scholar]
  72. Huys QJM, Vogelstein J, Dayan P. 2009. Psychiatry: insights into depression through normative decision-making models. Advances in Neural Information Processing Systems 21 D Koller, D Schuurmans, Y Bengio, L Bottou 729–36 Cambridge, MA: MIT Press [Google Scholar]
  73. Iacoviello BM, Alloy LB, Abramson LY, Choi JY. 2010. The early course of depression: a longitudinal investigation of prodromal symptoms and their relation to the symptomatic course of depressive episodes. J. Abnorm. Psychol. 119:3459–67 [Google Scholar]
  74. Insel T, Cuthbert B, Garvey M, Heinssen R, Pine DS. et al. 2010. Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am. J. Psychiatry 167:7748–51 [Google Scholar]
  75. Johnson A, Redish AD. 2007. Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J. Neurosci. 27:4512176–89 [Google Scholar]
  76. Joormann J. 2004. Attentional bias in dysphoria: the role of inhibitory processes. Cogn. Emot. 18:1125–47 [Google Scholar]
  77. Joormann J. 2006. Differential effects of rumination and dysphoria on the inhibition of irrelevant emotional material: Evidence from a negative priming task. Cogn. Ther. Res. 30:2149–60 [Google Scholar]
  78. Joormann J, Gotlib IH. 2008. Updating the contents of working memory in depression: interference from irrelevant negative material. J. Abnorm. Psychol. 117:1182–92 [Google Scholar]
  79. Joormann J, Levens SM, Gotlib IH. 2011. Sticky thoughts: depression and rumination are associated with difficulties manipulating emotional material in working memory. Psychol. Sci. 22:8979–83 [Google Scholar]
  80. Joormann J, Vanderlind WM. 2014. Emotion regulation in depression: the role of biased cognition and reduced cognitive control. Clin. Psychol. Sci. 2:4402–21 [Google Scholar]
  81. Kellough JL, Beevers CG, Ellis AJ, Wells TT. 2008. Time course of selective attention in clinically depressed young adults: an eye tracking study. Behav. Res. Ther. 46:111238–43 [Google Scholar]
  82. Keramati M, Dezfouli A, Piray P. 2011. Speed/accuracy trade-off between the habitual and the goal-directed processes. PLOS Comput. Biol. 7:5e1002055 [Google Scholar]
  83. Killcross S, Coutureau E. 2003. Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb. Cortex 13:4400–8 [Google Scholar]
  84. Knutson B, Bhanji JP, Cooney RE, Atlas LY, Gotlib IH. 2008. Neural responses to monetary incentives in major depression. Biol. Psychiatry 63:7686–92 [Google Scholar]
  85. Kumar P, Waiter G, Ahearn T, Milders M, Reid I, Steele JD. 2008. Abnormal temporal difference reward-learning signals in major depression. Brain 131:Part 82084–93 [Google Scholar]
  86. Lamers F, de Jonge P, Nolen WA, Smit JH, Zitman FG. et al. 2010. Identifying depressive subtypes in a large cohort study: results from the Netherlands Study of Depression and Anxiety (NESDA). J. Clin. Psychiatry 71:121582–89 [Google Scholar]
  87. Lautenbacher S, Roscher S, Strian D, Fassbender K, Krumrey K, Krieg J-C. 1994. Pain perception in depression: relationships to symptomatology and naloxone-sensitive mechanisms. Psychosom. Med. 56:345–52 [Google Scholar]
  88. Lautenbacher S, Spernal J, Schreiber W, Krieg JC. 1999. Relationship between clinical pain complaints and pain sensitivity in patients with depression and panic disorder. Psychosom. Med. 61:6822–27 [Google Scholar]
  89. Lawson C, MacLeod C, Hammond G. 2002. Interpretation revealed in the blink of an eye: depressive bias in the resolution of ambiguity. J. Abnorm. Psychol. 111:2321–28 [Google Scholar]
  90. Leventhal AM, Chasson GS, Tapia E, Miller EK, Pettit JW. 2006. Measuring hedonic capacity in depression: a psychometric analysis of three anhedonia scales. J. Clin. Psychol. 62:121545–58 [Google Scholar]
  91. Lewinsohn P, Youngren M, Grosscup S. 1979. Reinforcement and depression. The Psychobiology of Depressive Disorders: Implications for the Effects of Stress RA Depue 291–316 New York: Academic [Google Scholar]
  92. Lieder F, Goodman N, Huys QJM. 2013. Learned helplessness and generalization. Proc. 35th Annu. Conf. Cogn. Sci. Soc. Berlin
  93. Liverant GI, Kamholz BW, Sloan DM, Brown TA. 2011. Rumination in clinical depression: a type of emotional suppression?. Cogn. Ther. Res. 35:3253–65 [Google Scholar]
  94. López-Solà M, Pujol J, Hernández-Ribas R, Harrison BJ, Contreras-Rodríguez O. et al. 2010. Effects of duloxetine treatment on brain response to painful stimulation in major depressive disorder. Neuropsychopharmacology 35:112305–17 [Google Scholar]
  95. Lyubomirsky S, Nolen-Hoeksema S. 1993. Self-perpetuating properties of dysphoric rumination. J. Personal. Soc. Psychol. 65:2339–49 [Google Scholar]
  96. Maia TV, Frank MJ. 2011. From reinforcement learning models to psychiatric and neurological disorders. Nat. Neurosci. 14:2154–62 [Google Scholar]
  97. Maier SF, Amat J, Baratta MV, Paul E, Watkins LR. 2006. Behavioral control, the medial prefrontal cortex, and resilience. Dialogues Clin. Neurosci. 8:4397–406 [Google Scholar]
  98. Maier SF, Watkins LR. 2005. Stressor controllability and learned helplessness: the roles of the dorsal raphe nucleus, serotonin, and corticotropin-releasing factor. Neurosci. Biobehav. Rev. 29:4–5829–41 [Google Scholar]
  99. Marr D. 1982. Vision New York: Freeman
  100. Mathews A, MacLeod C. 2005. Cognitive vulnerability to emotional disorders. Annu. Rev. Clin. Psychol. 1:167–95 [Google Scholar]
  101. Mayberg HS. 2009. Targeted electrode-based modulation of neural circuits for depression. J. Clin. Investig. 119:4717–25 [Google Scholar]
  102. Mazzoni P, Hristova A, Krakauer JW. 2007. Why don't we move faster? Parkinson's disease, movement vigor, and implicit motivation. J. Neurosci. 27:277105–16 [Google Scholar]
  103. McGlinchey JB, Zimmerman M, Young D, Chelminski I. 2006. Diagnosing major depressive disorder VIII: Are some symptoms better than others. J. Nerv. Ment. Dis. 194:10785–90 [Google Scholar]
  104. Mitchell AJ, McGlinchey JB, Young D, Chelminski I, Zimmerman M. 2009. Accuracy of specific symptoms in the diagnosis of major depressive disorder in psychiatric out-patients: data from the MIDAS project. Psychol. Med. 39:71107–16 [Google Scholar]
  105. Mogg K, Bradley BP, Williams R, Mathews A. 1993. Subliminal processing of emotional information in anxiety and depression. J. Abnorm. Psychol. 102:2304–11 [Google Scholar]
  106. Montague PR, Dayan P, Sejnowski TJ. 1996. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16:51936–47 [Google Scholar]
  107. Montague PR, Dolan RJ, Friston KJ, Dayan P. 2012. Computational psychiatry. Trends Cogn. Sci. 16:172–80 [Google Scholar]
  108. Moulds ML, Kandris E, Starr S, Wong ACM. 2007. The relationship between rumination, avoidance and depression in a non-clinical sample. Behav. Res. Ther. 45:2251–61 [Google Scholar]
  109. Murphy FC, Michael A, Robbins TW, Sahakian BJ. 2003. Neuropsychological impairment in patients with major depressive disorder: the effects of feedback on task performance. Psychol. Med. 33:3455–67 [Google Scholar]
  110. Niv Y, Daw ND, Joel D, Dayan P. 2007. Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology 191:3507–20 [Google Scholar]
  111. Nolen-Hoeksema S. 1991. Responses to depression and their effects on the duration of depressive episodes. J. Abnorm. Psychol. 100:4569–82 [Google Scholar]
  112. Nolen-Hoeksema S, Morrow J, Fredrickson BL. 1993. Response styles and the duration of episodes of depressed mood. J. Abnorm. Psychol. 102:120–28 [Google Scholar]
  113. Nolen-Hoeksema S, Wisco BE, Lyubomirsky S. 2008. Rethinking rumination. Perspect. Psychol. Sci. 3:5400–24 [Google Scholar]
  114. O'Doherty JP. 2011. Contributions of the ventromedial prefrontal cortex to goal-directed action selection. Ann. N.Y. Acad. Sci. 1239118–29
  115. Pfeiffer BE, Foster DJ. 2013. Hippocampal place-cell sequences depict future paths to remembered goals. Nature 497:744774–79 [Google Scholar]
  116. Pizzagalli DA, Holmes AJ, Dillon DG, Goetz EL, Birk JL. et al. 2009. Reduced caudate and nucleus accumbens response to rewards in unmedicated individuals with major depressive disorder. Am. J. Psychiatry 166:6702–10 [Google Scholar]
  117. Pizzagalli DA, Jahn AL, O'Shea JP. 2005. Toward an objective characterization of an anhedonic phenotype: a signal-detection approach. Biol. Psychiatry 57:4319–27 [Google Scholar]
  118. Ray RD, Ochsner KN, Cooper JC, Robertson ER, Gabrieli JDE, Gross JJ. 2005. Individual differences in trait rumination and the neural systems supporting cognitive reappraisal. Cogn. Affect. Behav. Neurosci. 5:2156–68 [Google Scholar]
  119. Redish AD, Jensen S, Johnson A. 2008. A unified framework for addiction: vulnerabilities in the decision process. Behav. Brain Sci. 31:4415–37 discuss. 437–87 [Google Scholar]
  120. Remijnse PL, Nielen MMA, van Balkom AJLM, Hendriks G-J, Hoogendijk WJ. et al. 2009. Differential frontal-striatal and paralimbic activity during reversal learning in major depressive disorder and obsessive-compulsive disorder. Psychol. Med. 39:91503–18 [Google Scholar]
  121. Robinson OJ, Cools R, Carlisi CO, Sahakian BJ, Drevets WC. 2012. Ventral striatum response during reward and punishment reversal learning in unmedicated major depressive disorder. Am. J. Psychiatry 169:2152–59 [Google Scholar]
  122. Rock PL, Roiser JP, Riedel WJ, Blackwell AD. 2014. Cognitive impairment in depression: a systematic review and meta-analysis. Psychol. Med. 44:2029–40 [Google Scholar]
  123. Roiser JP, Elliott R, Sahakian BJ. 2012. Cognitive mechanisms of treatment in depression. Neuropsychopharmacology 37:1117–36 [Google Scholar]
  124. Rude SS, Valdez CR, Odom S, Ebrahimi A. 2003. Negative cognitive biases predict subsequent depression. Cogn. Ther. Res. 27:4415–29 [Google Scholar]
  125. Savitz JB, Drevets WC. 2013. Neuroreceptor imaging in depression. Neurobiol. Dis. 52:49–65 [Google Scholar]
  126. Schlagenhauf F, Huys QJM, Deserno L, Rapp MA, Beck A. et al. 2014. Striatal dysfunction during reversal learning in unmedicated schizophrenia patients. Neuroimage 89:171–80 [Google Scholar]
  127. Schwartz N, Temkin P, Jurado S, Lim BK, Heifets BD. et al. 2014. Decreased motivation during chronic pain requires long-term depression in the nucleus accumbens. Science 345:6196535–42 [Google Scholar]
  128. Shah PJ, Ogilvie AD, Goodwin GM, Ebmeier KP. 1997. Clinical and psychometric correlates of dopamine D2 binding in depression. Psychol. Med. 27:61247–56 [Google Scholar]
  129. Siegle GJ, Steinhauer SR, Thase ME, Stenger VA, Carter CS. 2002. Can't shake that feeling: event-related fMRI assessment of sustained amygdala activity in response to emotional information in depressed individuals. Biol. Psychiatry 51:9693–707 [Google Scholar]
  130. Sloan DM, Strauss ME, Quirk SW, Sajatovic M. 1997. Subjective and expressive emotional responses in depression. J. Affect. Disord. 46:2135–41 [Google Scholar]
  131. Smoski MJ, Felder J, Bizzell J, Green SR, Ernst M. et al. 2009. fMRI of alterations in reward selection, anticipation, and feedback in major depressive disorder. J. Affect. Disord. 118:1–369–78 [Google Scholar]
  132. Stankevicius A, Huys QJM, Kalra A, Seriès P. 2014. Optimism as a prior belief about the probability of future reward. PLOS Comput. Biol. 10:5e1003605 [Google Scholar]
  133. Steele JD, Kumar P, Ebmeier KP. 2007. Blunted response to feedback information in depressive illness. Brain 130:Part 92367–74 [Google Scholar]
  134. Steffens DC, Wagner HR, Levy RM, Horn KA, Krishnan KR. 2001. Performance feedback deficit in geriatric depression. Biol. Psychiatry 50:5358–63 [Google Scholar]
  135. Sutton R. 1988. Learning to predict by the methods of temporal differences. Mach. Learn. 3:19–44 [Google Scholar]
  136. Sutton R. 1991. Dyna, an integrated architecture for learning, planning and reacting. Sigart Bull. 2:160–63 [Google Scholar]
  137. Taylor Tavares JV, Clark L, Furey ML, Williams GB, Sahakian BJ, Drevets WC. 2008. Neural basis of abnormal response to negative feedback in unmedicated mood disorders. Neuroimage 42:31118–26 [Google Scholar]
  138. Tobler PN, Fiorillo CD, Schultz W. 2005. Adaptive coding of reward value by dopamine neurons. Science 307:57151642–45 [Google Scholar]
  139. Tran TB, Siemer M, Joormann J. 2011. Implicit interpretation biases affect emotional vulnerability: a training study. Cogn. Emot. 25:3546–58 [Google Scholar]
  140. Treadway MT, Zald DH. 2011. Reconsidering anhedonia in depression: lessons from translational neuroscience. Neurosci. Biobehav. Rev. 35:3537–55 [Google Scholar]
  141. Tremblay LK, Naranjo CA, Cardenas L, Herrmann N, Busto UE. 2002. Probing brain reward system function in major depressive disorder: altered response to dextroamphetamine. Arch. Gen. Psych. 59:5209–15 [Google Scholar]
  142. Tremblay LK, Naranjo CA, Graham SJ, Herrmann N, Mayberg HS. et al. 2005. Functional neuroanatomical substrates of altered reward processing in major depressive disorder revealed by a dopaminergic probe. Arch. Gen. Psych. 62:111228–36 [Google Scholar]
  143. Treynor W, Gonzalez R, Nolen-Hoeksema S. 2003. Rumination reconsidered: a psychometric analysis. Cogn. Ther. Res. 27:3247–59 [Google Scholar]
  144. Tye KM, Mirzabekov JJ, Warden MR, Ferenczi EA, Tsai H-C. et al. 2013. Dopamine neurons modulate neural encoding and expression of depression-related behaviour. Nature 493:7433537–41 [Google Scholar]
  145. Watkins PC, Martin CK, Stern LD. 2000. Unconscious memory bias in depression: perceptual and conceptual processes. J. Abnorm. Psychol. 109:2282–89 [Google Scholar]
  146. Weinstein ND. 1980. Unrealistic optimism about future life events. J. Personal. Soc. Psychol. 39:5806–20 [Google Scholar]
  147. Weissmann AN, Beck AT. 1978. Development and validation of the Dysfunctional Attitudes Scale: a preliminary investigation Presented at Annu. Meet. Am. Educ. Res. Assoc., Toronto
  148. Wells A. 1999. A metacognitive model and therapy for generalized anxiety disorder. Clin. Psychol. Psychother. 6:286–95 [Google Scholar]
  149. Werner-Seidler A, Banks R, Dunn BD, Moulds ML. 2013. An investigation of the relationship between positive affect regulation and depression. Behav. Res. Ther. 51:146–56 [Google Scholar]
  150. Williams AD, Blackwell SE, Mackenzie A, Holmes EA, Andrews G. 2013. Combining imagination and reason in the treatment of depression: a randomized controlled trial of Internet-based cognitive-bias modification and Internet-CBT for depression. J. Consult. Clin. Psychol. 81:5793–99 [Google Scholar]
  151. Williams JMG, Watts FN, MacLeod C, Mathews A. 1997. Cognitive Psychology and Emotional Disorders Chichester, UK: Wiley, 2nd ed..
  152. Williams JMG, Barnhofer T, Crane C, Herman D, Raes F. et al. 2007. Autobiographical memory specificity and emotional disorder. Psychol. Bull. 133:1122–48 [Google Scholar]
  153. Williams KE, Chambless DL, Ahrens A. 1997. Are emotions frightening? An extension of the fear of fear construct. Behav. Res. Ther. 35:3239–48 [Google Scholar]
  154. Willner P. 1985. Depression: A Psychobiological Synthesis New York: Wiley
  155. Wilson RC, Takahashi YK, Schoenbaum G, Niv Y. 2014. Orbitofrontal cortex as a cognitive map of task space. Neuron 81:2267–79 [Google Scholar]
  156. World Health Organ 1990. The ICD-10 Classification of Mental and Behavioural Disorders: Clinical Descriptions and Diagnostic Guidelines Geneva: World Health Organ.
  157. Xu J, Griffiths TL. 2010. A rational analysis of the effects of memory biases on serial reproduction. Cogn. Psychol. 60:2107–26 [Google Scholar]
  158. Yu AJ, Dayan P, Cohen JD. 2009. Dynamics of attentional selection under conflict: toward a rational Bayesian account. J. Exp. Psychol. Hum. Percept. Perform. 35:3700–17 [Google Scholar]
  159. Zhang W-N, Chang S-H, Guo L-Y, Zhang K-L, Wang J. 2013. The neural correlates of reward-related processing in major depressive disorder: a meta-analysis of functional magnetic resonance imaging studies. J. Affect. Disord. 151:2531–39 [Google Scholar]
/content/journals/10.1146/annurev-neuro-071714-033928
Loading
  • Article Type: Review Article

Most Cited Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error