1932

Abstract

In everyday life, the outcomes of our actions are rarely certain. Further, we often lack the information needed to precisely estimate the probability and value of potential outcomes as well as how much effort will be required by the courses of action under consideration. Under such conditions of uncertainty, individual differences in the estimation and weighting of these variables, and in reliance on model-free versus model-based decision making, have the potential to strongly influence our behavior. Both anxiety and depression are associated with difficulties in decision making. Further, anxiety is linked to increased engagement in threat-avoidance behaviors and depression is linked to reduced engagement in reward-seeking behaviors. The precise deficits, or biases, in decision making associated with these common forms of psychopathology remain to be fully specified. In this article, we review evidence for which of the computations supporting decision making are altered in anxiety and depression and consider the potential consequences for action selection. In addition, we provide a schematic framework that integrates the findings reviewed and will hopefully be of value to future studies.

Loading

Article metrics loading...

/content/journals/10.1146/annurev-neuro-080317-062007
2018-07-08
2024-12-05
Loading full text...

Full text loading...

/deliver/fulltext/neuro/41/1/annurev-neuro-080317-062007.html?itemId=/content/journals/10.1146/annurev-neuro-080317-062007&mimeType=html&fmt=ahah

Literature Cited

  1. Am. Psychiatr. Assoc. 2013. Diagnostic and Statistical Manual of Mental Disorders Arlington, VA: American Psychiatric Publishing. , 5th ed..
    [Google Scholar]
  2. Amsterdam JD, Settle RG, Doty RL, Abelman E, Winokur A 1987. Taste and smell perception in depression. Biol. Psychiatry 22:1481–85
    [Google Scholar]
  3. Bach DR, Hulme O, Penny WD, Dolan RJ 2011. The known unknowns: neural representation of second-order uncertainty, and ambiguity. J. Neurosci. 31:4811–20
    [Google Scholar]
  4. Behrens TE, Woolrich MW, Walton ME, Rushworth MF 2007. Learning the value of information in an uncertain world. Nat. Neurosci. 10:1214–21
    [Google Scholar]
  5. Bjärehed J, Sarkohi A, Andersson G 2010. Less positive or more negative? Future-directed thinking in mild to moderate depression. Cogn. Behav. Ther. 39:37–45
    [Google Scholar]
  6. Bijsterbosch J, Smith S, Forster S, John OP, Bishop SJ 2014. Resting state correlates of subdimensions of anxious affect. J. Cogn. Neurosci. 26:914–26
    [Google Scholar]
  7. Bishop SJ, Dalgleish T, Yule W 2004. Memory for emotional stories in high and low depressed children. Memory 12:214–30
    [Google Scholar]
  8. Blair KS, Blair RJR 2012. A cognitive neuroscience approach to generalized anxiety disorder and social phobia. Emot. Rev. 4:133–38
    [Google Scholar]
  9. Bonnelle V, Manohar S, Behrens T, Husain M 2016. Individual differences in premotor brain systems underlie behavioral apathy. Cereb. Cortex 26:807–19
    [Google Scholar]
  10. Bonnelle V, Veromann KR, Burnett Heyes S, Lo Sterzo E, Manohar S, Husain M 2015. Characterization of reward and effort mechanisms in apathy. J. Physiol. Paris 109:16–26
    [Google Scholar]
  11. Bradley B, Mathews A 1983. Negative self-schemata in clinical depression. Br. J. Clin. Psychol. 22:Pt. 3173–81
    [Google Scholar]
  12. Branco LD, Cotrena C, Ponsoni A, Salvador-Silva R, Vasconcellos SJL, Fonseca RP 2017. Identification and perceived intensity of facial expressions of emotion in bipolar disorder and major depression. Arch. Clin. Neuropsychol. 14:acx080
    [Google Scholar]
  13. Brown TA, Campbell LA, Lehman CL, Grisham JR, Manchill RB 2001. Current and lifetime comorbidity of the DSM-IV anxiety and mood disorders in a large clinical sample. J. Abnorm. Psychol. 110:585–99
    [Google Scholar]
  14. Browning M, Behrens TE, Jocham G, O'Reilly JX, Bishop SJ 2015. Anxious individuals have difficulty learning the causal statistics of aversive environments. Nat. Neurosci. 18:590–96
    [Google Scholar]
  15. Butler G, Mathews A 1983. Cognitive processes in anxiety. Adv. Behav. Res. Ther. 5:51–62
    [Google Scholar]
  16. Cahill L, Haier RJ, Fallon J, Alkire MT, Tang C et al. 1996. Amygdala activity at encoding correlated with long-term, free recall of emotional information. PNAS 93:8016–21
    [Google Scholar]
  17. Camerer C 1995. Individual decision making. Handbook of Experimental Economics JH Kagel, AE Roth 587–703 Princeton, NJ: Princeton University Press
    [Google Scholar]
  18. Charpentier CJ, Aylward J, Roiser JP, Robinson OJ 2017. Enhanced risk aversion, but not loss aversion, in unmedicated pathological anxiety. Biol. Psychiatry 81:1014–22
    [Google Scholar]
  19. Chong TT, Bonnelle V, Husain M 2016. Quantifying motivation with effort-based decision-making paradigms in health and disease. Prog. Brain Res. 229:71–100
    [Google Scholar]
  20. Clark DM, Teasdale JD 1982. Diurnal variation in clinical depression and accessibility of memories of positive and negative experiences. J. Abnorm. Psychol. 91:87–95
    [Google Scholar]
  21. Cryan JF, Valentino RJ, Lucki I 2005. Assessing substrates underlying the behavioral effects of antidepressants using the modified rat forced swimming test. Neurosci. Biobehav. Rev. 29:547–69
    [Google Scholar]
  22. Davis M, Walker DL, Miles L, Grillon C 2010. Phasic versus sustained fear in rats and humans: role of the extended amygdala in fear versus anxiety. Neuropsychopharmacology 35:105–35
    [Google Scholar]
  23. Daw ND, Dayan P 2014. The algorithmic anatomy of model-based evaluation. Philos. Trans. R. Soc. B 369:1655
    [Google Scholar]
  24. Daw ND, Niv Y, Dayan P 2005. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8:1704
    [Google Scholar]
  25. Dayan P, Huys QJ 2009. Serotonin in affective control. Annu. Rev. Neurosci. 32:95–126
    [Google Scholar]
  26. Dolcos F, Katsumi Y, Weymar M, Moore M, Tsukiura T, Dolcos S 2017. Emerging directions in emotional episodic memory. Front. Psychol. 8:1867
    [Google Scholar]
  27. Dugas MJ, Gagnon F, Ladouceur R, Freeston MH 1998. Generalized anxiety disorder: a preliminary test of a conceptual model. Behav. Res. Ther. 36:215–26
    [Google Scholar]
  28. Etkin A, Klemenhagen KC, Dudman JT, Rogan MT, Hen R, Hirsch J 2004. Individual differences in trait anxiety predict the response of the basolateral amygdala to unconsciously processed fearful faces. Neuron 44:1043–55
    [Google Scholar]
  29. Floresco SB, Ghods-Sharifi S 2007. Amygdala-prefrontal cortical circuitry regulates effort-based decision making. Cereb. Cortex 17:251–60
    [Google Scholar]
  30. Foster DJ, Wilson MA 2006. Reverse replay of behavioural sequences in hippocampal place cells during the awake state. Nature 440:680–83
    [Google Scholar]
  31. Grillon C, Lissek S, Rabin S, McDowell D, Dvir S, Pine DS 2008. Increased anxiety during anticipation of unpredictable but not predictable aversive stimuli as a psychophysiologic marker of panic disorder. Am. J. Psychiatry 165:898–904
    [Google Scholar]
  32. Hartley CA, Phelps EA 2012. Anxiety and decision-making. Biol. Psychiatry 72:113–18
    [Google Scholar]
  33. Hauber W, Sommer S 2009. Prefrontostriatal circuitry regulates effort-related decision making. Cereb. Cortex 19:2240–47
    [Google Scholar]
  34. Hong RY 2007. Worry and rumination: differential associations with anxious and depressive symptoms and coping behavior. Behav. Res. Ther. 45:277–90
    [Google Scholar]
  35. Huang H, Thompson W, Paulus MP 2017. Computational dysfunctions in anxiety: failure to differentiate signal from noise. Biol. Psychiatry 82:440–46
    [Google Scholar]
  36. Huys QJ, Daw ND, Dayan P 2015. Depression: a decision-theoretic analysis. Annu. Rev. Neurosci. 38:1–23
    [Google Scholar]
  37. Huys QJ, Pizzagalli DA, Bogdan R, Dayan P 2013. Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis. Biol. Mood Anxiety Disord. 3:12
    [Google Scholar]
  38. Johnson A, Redish AD 2005. Hippocampal replay contributes to within session learning in a temporal difference reinforcement learning model. Neural Netw 18:1163–71
    [Google Scholar]
  39. Kahneman D, Tversky A 1979. Prospect theory: an analysis of decision under risk. Econometrica 47:263–91
    [Google Scholar]
  40. Kahneman D, Tversky A 1982. The simulation heuristic. Judgment Under Uncertainty: Heuristics and Biases D Kahneman, P Slovic, A Tversky 201–8 New York: Cambridge University Press
    [Google Scholar]
  41. Keramati M, Smittenaar P, Dolan RJ, Dayan P 2016. Adaptive integration of habits into depth-limited planning defines a habitual-goal-directed spectrum. PNAS 113:12868–73
    [Google Scholar]
  42. Kessler RC, Chiu WT, Demler O, Merikangas KR, Walters EE 2005. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch. Gen. Psychiatry 62:617–27
    [Google Scholar]
  43. Kircanski K, Thompson RJ, Sorenson JE, Sherdell L, Gotlib IH 2015. Rumination and worry in daily life: examining the naturalistic validity of theoretical constructs. Clin. Psychol. Sci. 3:926–39
    [Google Scholar]
  44. Krypotos AM, Effting M, Kindt M, Beckers T 2015. Avoidance learning: a review of theoretical models and recent developments. Front. Behav. Neurosci. 9:189
    [Google Scholar]
  45. Lauriola M, Panno A, Levin IP, Lejuez CW 2014. Individual differences in risky decision making: a meta-analysis of sensation seeking and impulsivity with the Balloon Analogue Risk Task. J. Behav. Decis. Mak. 27:20–36
    [Google Scholar]
  46. Lee KM, Coelho MA, Sern KR, Class MA, Bocz MD, Szumlinski KK 2017. Anxiolytic effects of buspirone and MTEP in the Porsolt forced swim test. Chronic Stress1 https://doi.org/10.1177/2470547017712985
    [Google Scholar]
  47. Li J, Schiller D, Schoenbaum G, Phelps EA, Daw ND 2011. Differential roles of human striatum and amygdala in associative learning. Nat. Neurosci. 14:1250–52
    [Google Scholar]
  48. Lin LJ 1992. Self-improving reactive agents based on reinforcement learning, planning and teaching. Mach. Learn. 8:293–321
    [Google Scholar]
  49. MacLeod AK, Byrne A 1996. Anxiety, depression, and the anticipation of future positive and negative experiences. J. Abnorm. Psychol. 105:286–89
    [Google Scholar]
  50. MacLeod AK, Byrne A, Valentine JD 1996. Affect, emotional disorder, and future-directed thinking. Cogn. Emot. 10:69–86
    [Google Scholar]
  51. MacLeod AK, Salaminiou E 2001. Reduced positive future-thinking in depression: cognitive and affective factors. Cogn. Emot. 15:99–107
    [Google Scholar]
  52. MacLeod AK, Williams JM, Bekerian DA 1991. Worry is reasonable: the role of explanations in pessimism about future personal events. J. Abnorm. Psychol. 100:478–86
    [Google Scholar]
  53. MacLeod C, Campbell L 1992. Memory accessibility and probability judgments: an experimental evaluation of the availability heuristic. J. Personal. Soc. Psychol. 63:890–902
    [Google Scholar]
  54. Maner JK, Richey JA, Cromer K, Mallott M, Lejuez CW et al. 2007. Dispositional anxiety and risk-avoidant decision-making. Personal. Individ. Diff. 42:665–75
    [Google Scholar]
  55. Mathews A, Mackintosh B 1998. A cognitive model of selective processing in anxiety. Cogn. Ther. Res. 22:539–60
    [Google Scholar]
  56. McEvoy PM, Watson H, Watkins ER, Nathan P 2013. The relationship between worry, rumination, and comorbidity: evidence for repetitive negative thinking as a transdiagnostic construct. J. Affect. Disord. 151:313–20
    [Google Scholar]
  57. Mirenowicz J, Schultz W 1996. Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379:449–51
    [Google Scholar]
  58. Moore AC, MacLeod AK, Barnes D, Langdon DW 2006. Future-directed thinking and depression in relapsing-remitting multiple sclerosis. Br. J. Health Psychol. 11:Pt. 4663–75
    [Google Scholar]
  59. Muris P, van der Heiden S 2006. Anxiety, depression, and judgments about the probability of future negative and positive events in children. J. Anxiety Disord. 20:252–61
    [Google Scholar]
  60. Nord CL, Prabhu G, Nolte T, Fonagy P, Dolan R et al. 2017. Vigour in active avoidance. Sci. Rep. 7:60
    [Google Scholar]
  61. Peeters F, Nicolson NA, Berkhof J, Delespaul P, deVries M 2003. Effects of daily events on mood states in major depressive disorder. J. Abnorm. Psychol. 112:203–11
    [Google Scholar]
  62. Porsolt RD, Le Pichon M, Jalfre M 1977. Depression: a new animal model sensitive to antidepressant treatments. Nature 266:730–32
    [Google Scholar]
  63. Potts AJ, Bennett PJ, Kennedy SH, Vaccarino FJ 1997. Depressive symptoms and alterations in sucrose taste perception: cognitive bias or a true change in sensitivity. Can. J. Exp. Psychol. 51:57–60
    [Google Scholar]
  64. Pulcu E, Browning M 2017. Affective bias as a rational response to the statistics of rewards and punishments. eLife 6:e27879
    [Google Scholar]
  65. Raghunathan R, Pham MT 1999. All negative moods are not equal: motivational influences of anxiety and sadness on decision-making. Organ. Behav. Hum. Decis. Process. 79:56–77
    [Google Scholar]
  66. Roesch MR, Esber GR, Li J, Daw ND, Schoenbaum G 2012. Surprise! Neural correlates of Pearce-Hall and Rescorla-Wagner coexist within the brain. Eur. J. Neurosci. 35:1190–200
    [Google Scholar]
  67. Rushworth MF, Behrens TE 2008. Choice, uncertainty and value in prefrontal and cingulate cortex. Nat. Neurosci. 11:389–97
    [Google Scholar]
  68. Schaefer KL, Baumann J, Rich BA, Luckenbaugh DA, Zarate CA 2010. Perception of facial emotion in adults with bipolar or unipolar depression and controls. J. Psychiatr. Res. 44:1229–35
    [Google Scholar]
  69. Schultz W 1998. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80:1–27
    [Google Scholar]
  70. Schultz W 2015. Neuronal reward and decision signals: from theories to data. Physiol. Rev. 95:853–951
    [Google Scholar]
  71. Schultz W 2016. Reward functions of the basal ganglia. J. Neural Transm. 123:679–93
    [Google Scholar]
  72. Schultz W, Dayan P, Montague PR 1997. A neural substrate of prediction and reward. Science 275:1593–99
    [Google Scholar]
  73. Scinska A, Sienkiewicz-Jarosz H, Kuran W, Ryglewicz D, Rogowski A et al. 2004. Depressive symptoms and taste reactivity in humans. Physiol. Behav. 82:899–904
    [Google Scholar]
  74. Servatius RJ, Jiao X, Beck KD, Pang KC, Minor TR 2008. Rapid avoidance acquisition in Wistar-Kyoto rats. Behav. Brain Res. 192:191–97
    [Google Scholar]
  75. Seymour B, O'Doherty JP, Dayan P, Koltzenburg M, Jones AK et al. 2004. Temporal difference models describe higher-order learning in humans. Nature 429:664–67
    [Google Scholar]
  76. Shin LM, Liberzon I 2010. The neurocircuitry of fear, stress, and anxiety disorders. Neuropsychopharmacology 35:169–91
    [Google Scholar]
  77. Sutton RS 1990. Integrated architectures for learning, planning, and reacting based on approximating dynamic programming. Proc. Int. Conf. Machine Learning, 7th, Austin216–24 San Francisco: Morgan Kaufman Publishers
    [Google Scholar]
  78. Sutton RS, Barto AG 1998. Reinforcement Learning: An Introduction Cambridge, MA: MIT Press
    [Google Scholar]
  79. Szabó M, Lovibond PF 2004. The cognitive content of thought-listed worry episodes in clinic-referred anxious and nonreferred children. J. Clin. Child Adolesc. Psychol. 33:613–22
    [Google Scholar]
  80. Szabó M, Lovibond PF 2006. Worry episodes and perceived problem solving: a diary-based approach. Anxiety Stress Coping 19:175–87
    [Google Scholar]
  81. Talmi D, Seymour B, Dayan P, Dolan RJ 2008. Human Pavlovian-instrumental transfer. J. Neurosci. 28:360–68
    [Google Scholar]
  82. Teasdale JD, Taylor R, Fogarty SJ 1980. Effects of induced elation-depression on the accessibility of memories of happy and unhappy experiences. Behav. Res. Ther. 18:339–46
    [Google Scholar]
  83. Treadway MT, Bossaller NA, Shelton RC, Zald DH 2012. Effort-based decision-making in major depressive disorder: a translational model of motivational anhedonia. J. Abnorm. Psychol. 121:553–58
    [Google Scholar]
  84. Treadway MT, Buckholtz JW, Schwartzman AN, Lambert WE, Zald DH 2009. Worth the ‘EEfRT’? The effort expenditure for rewards task as an objective measure of motivation and anhedonia. PLOS ONE 4:e6598
    [Google Scholar]
  85. Treynor W, Gonzalez R, Nolen-Hoeksema S 2003. Rumination reconsidered: a psychometric analysis. Cogn. Ther. Res. 27:247–59
    [Google Scholar]
  86. Tversky A, Kahneman D 1974. Judgment under uncertainty: heuristics and biases. Science 185:1124–31
    [Google Scholar]
  87. Tversky A, Kahneman D 1992. Advances in prospect theory: cumulative representation of uncertainty. J. Risk Uncertain. 5:297–323
    [Google Scholar]
  88. Verkuil B, Brosschot JF, Thayer JF 2007. Capturing worry in daily life: Are trait questionnaires sufficient. Behav. Res. Ther. 45:1835–44
    [Google Scholar]
  89. Walton ME, Bannerman DM, Alterescu K, Rushworth MF 2003. Functional specialization within medial frontal cortex of the anterior cingulate for evaluating effort-related decisions. J. Neurosci. 23:6475–79
    [Google Scholar]
  90. Walton ME, Groves J, Jennings KA, Croxson PL, Sharp T et al. 2009. Comparing the role of the anterior cingulate cortex and 6-hydroxydopamine nucleus accumbens lesions on operant effort-based decision making. Eur. J. Neurosci. 29:1678–91
    [Google Scholar]
  91. Watkins E, Moulds M, Mackintosh B 2005. Comparisons between rumination and worry in a non-clinical population. Behav. Res. Ther. 43:1577–85
    [Google Scholar]
  92. Watkins ER 2008. Constructive and unconstructive repetitive thought. Psychol. Bull. 134:163–206
    [Google Scholar]
  93. Wiech K, Tracey I 2009. The influence of negative emotions on pain: behavioral effects and neural mechanisms. Neuroimage 47:987–94
    [Google Scholar]
/content/journals/10.1146/annurev-neuro-080317-062007
Loading
/content/journals/10.1146/annurev-neuro-080317-062007
Loading

Data & Media loading...

  • Article Type: Review Article
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error