1932

Abstract

Treatment and prevention efforts guided by psychological theory, research, and practice can have outcomes of greater value than the resources consumed by those efforts—and outcomes superior to those attainable by other means, often at lower costs. How can we make this hope true more often, for more of the clients who need our services, despite severe resource constraints? Routinely reporting the costs, effectiveness, and benefits of psychological interventions from client, practitioner, and societal perspectives is only a beginning. We also need to use descriptive and inferential statistics to measure, report, and analyze the cost-effectiveness and cost-benefit of our interventions to discover the strongest determinants of intervention costs and outcomes. The emerging literature on cost-inclusive research in psychology suggests that delivery systems are one primary determinant of costs and outcomes of most interventions, as are the psychological techniques applied.

Loading

Article metrics loading...

/content/journals/10.1146/annurev-clinpsy-071519-110415
2020-05-07
2024-03-28
Loading full text...

Full text loading...

/deliver/fulltext/clinpsy/16/1/annurev-clinpsy-071519-110415.html?itemId=/content/journals/10.1146/annurev-clinpsy-071519-110415&mimeType=html&fmt=ahah

Literature Cited

  1. APA (Am. Psychol. Assoc.) Pres. Task Force Evid.-Based Pract 2006. Evidence-based practice in psychology. Am. Psychol. 61:271–85
    [Google Scholar]
  2. Andrews G, Basu A, Cuijpers P, Craske MG, McEnvoy P et al. 2018. Computer therapy for the anxiety and depression disorders is effective, acceptable and practical health care: an updated meta-analysis. J. Anxiety Disord. 55:70–78
    [Google Scholar]
  3. Aos S, Lieb R, Mayfiel J, Miller M, Pennucci A 2004. Benefits and costs of prevention and early intervention programs for youth Doc. 04-07-3901, Wash. State Inst. Public Policy Olympia:
  4. Bandura A, Blanchard EB, Ritter B 1969. Relative efficacy of desensitization and modeling approaches for including behavioral, affective, and attitudinal changes. J. Personal. Soc. Psychol. 13:173–99
    [Google Scholar]
  5. Boudreau R, Moulton K, Cunningham J 2010. Self-Directed Cognitive Behavioural Therapy for Adults with Diagnoses of Depression: Systematic Review of Clinical Effectiveness, Cost-Effectiveness, and Guidelines Ottawa: Can. Agency Drugs Technol. Health
  6. Buntrock C, Ebert DD, Lehr D, Smit F, Riper H et al. 2016. Effect of a web-based guided self-help intervention for prevention of major depression in adults with subthreshold depression: a randomized clinical trial. JAMA 315:171854–63
    [Google Scholar]
  7. Byrne M. 2019. Increasing the impact of behavior change intervention research: Is there a role for stakeholder engagement?. Health Psychol 38:4290–96
    [Google Scholar]
  8. Campbell JL, Britten N, Green C, Holt TA, Lattimer V et al. 2013. The effectiveness and cost-effectiveness of telephone triage of patients requesting same day consultations in general practice: study protocol for a cluster randomised controlled trial comparing nurse-led and GP-led management systems (ESTEEM). Trials 14:4
    [Google Scholar]
  9. Carlbring P, Andersson G, Cuijpers P, Riper H, Hedman-Lagerlof E 2018. Internet-based versus face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. Cogn. Behav. Ther. 47:11–18
    [Google Scholar]
  10. Carter DE, Newman FL. 1976. A client-oriented system of mental health service delivery and program management: a workbook and guide DHEW Publ. ADM 76-307, Natl. Inst. Ment. Health Rockville, MD:
  11. Cent. Dis. Control Prev 2019. Cost-effectiveness analysis. Centers for Disease Control and Prevention https://www.cdc.gov/policy/polaris/economics/cost-effectiveness.html
    [Google Scholar]
  12. Chorpita BF. 2019. Questions about industry. Behav. Ther. 42:5145–47
    [Google Scholar]
  13. Croft B, Battis K, Ostrow L, Salzer MS 2019. Service costs and mental health self-direction: findings from consumer recovery investment fund self-directed care. Psychiatr. Rehabil. J. 42:4401–6
    [Google Scholar]
  14. Crow SJ, Agras WS, Halmi KA, Fairburn CG, Mitchell JE et al. 2013. A cost effectiveness analysis of stepped care treatment for bulimia nervosa. Int. J. Eat. Disord. 46:4302–7
    [Google Scholar]
  15. Crowley DM, Dodge KA, Barnett WS, Corso P, Duffy S et al. 2018. Standards of evidence for conducting and reporting economic evaluations in prevention science. Prev. Sci. 19:3366–90
    [Google Scholar]
  16. Cuijpers P, Smit F, Penninx BW, de Graaf R, ten Have M et al. 2010. Economic costs of neuroticism. Arch. Gen. Psychiatry 67:101086–93
    [Google Scholar]
  17. Cummings NA. 1977. Prolonged (ideal) versus short-term (realistic) psychotherapy. Prof. Psychol. 8:491–501
    [Google Scholar]
  18. Cummings NA, Follette WT. 1968. Psychiatric services and medical utilization in a prepaid health plan setting. Med. Care 5:31–41
    [Google Scholar]
  19. Cummings NA, Follette WT. 1976. Brief psychotherapy and medical utilization: an eight-year follow-up. The Professional Psychologist Today: New Developments in Law, Health Insurance, and Health Practice H Dorken San Francisco: Jossey-Bass
    [Google Scholar]
  20. Daley M, Argeriou M, McCarty D, Callahan JJ, Shepard DS et al. 2000. The costs of crime and the benefits of substance abuse treatment for pregnant women. J. Subst. Abuse Treat. 19:4445–58
    [Google Scholar]
  21. de Beurs E, Warmerdam EH, Oudejans SCC, Spits M, Dingemanse P et al. 2018. Treatment outcome, duration, and costs: a comparison of performance indicators using data from eight mental health care providers in the Netherlands. Adm. Policy Ment. Health 45:212–23
    [Google Scholar]
  22. Dickerson JF, Lynch FL, Leo MC, DeBar LL, Pearson J et al. 2018. Cost-effectiveness of cognitive behavioral therapy for depressed youth declining antidepressants. Pediatrics 141:2e20171969
    [Google Scholar]
  23. Donker T, Batterham PJ, Warmerdam L, Bennett K, Bennett A et al. 2013. Predictors and moderators of response to internet-delivered Interpersonal Psychotherapy and Cognitive Behavior Therapy for depression. J. Affect. Disord. 151:1343–51
    [Google Scholar]
  24. Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW 2015. Methods for the Economic Evaluation of Health Care Programmes Oxford, UK: Oxford Univ. Press, 4th ed..
  25. Essock SM, Frisman LK, Kontos NJ 1998. Cost-effectiveness of assertive community treatment teams. Am. J. Orthopsychiatry 68:2179–90
    [Google Scholar]
  26. Ettner SL, Huang D, Evans E, Ash DR, Hardy M et al. 2006. Benefit-cost in the California Treatment Outcome Project: Does substance abuse treatment “pay for itself”?. Health Serv. Res. 41:1192–213
    [Google Scholar]
  27. Fairweather GW, Sanders DH, Maynard H, Cressler DL 1969. Community Life for the Mentally Ill Chicago: Aldine
  28. Farrell NR, Leonard RC, Riemann BC 2019. The “behavioral specialist” model of training novice paraprofessional clinicians: an innovative, cost-effective approach for increasing the scalability of CBT. Behav. Ther. 42:4111–17
    [Google Scholar]
  29. Fenwick E, Clapton K, Schulpher M 2001. Representing uncertainty: the role of cost-effectiveness acceptability curves. Health Econ 10:779–87
    [Google Scholar]
  30. Fishman DB. 1975. Development of a generic cost-effectiveness methodology for evaluating patient services of a community mental health center. Evaluation in Alcohol, Drug Abuse, and Mental Health Service J Zusman, CR Wurster 153–74 Lexington, MA: Heath
    [Google Scholar]
  31. Freed MC, Rohan KJ, Yates BT 2004. Cost-effectiveness of light therapy, cognitive-behavioral therapy, or their combination for seasonal affective disorder. Chronobiol. Int. 21:788
    [Google Scholar]
  32. French AN, Yates BT, Fowles TR 2018. Cost-effectiveness of Parent–Child Interaction Therapy in clinics versus homes: client, provider, administrator, and overall perspectives. J. Child Fam. Stud. 27:3329–44
    [Google Scholar]
  33. French MT, McCollister KE, Cacciola J, Durell J, Stephens RL 2002. Benefit-cost analysis of addiction treatment in Arkansas: specialty and standard residential programs for pregnant and parenting women. Subst. Abuse 23:131–51
    [Google Scholar]
  34. Gajic-Veljanoski O, Sanyal C, McMartin K, Xie X, Walter M et al. 2018. Economic evaluations of commonly used structured psychotherapies for major depressive disorder and generalized anxiety disorder: a systematic review. Can. Psychol. 59:4301–14
    [Google Scholar]
  35. Glick HA, Doshi JA, Sonnad SS, Polsky D 2007. Economic Evaluation in Clinical Trials Oxford, UK: Oxford Univ. Press
  36. Herman PM, Avery DJ, Schemp CS, Walsh ME 2009. Are cost-inclusive evaluations worth the effort. Eval. Progr. Plan. 32:55–61
    [Google Scholar]
  37. Holden C. 1978. Senators hear case for psychotherapy. Science 201:794–95
    [Google Scholar]
  38. Hornack SE, Yates BT. 2017. Patient and program costs, and outcomes, of including gender-sensitive services in intensive inpatient programs for substance use. Eval. Progr. Plan. 65:139–47
    [Google Scholar]
  39. Husereau D, Drummond M, Petrou S, Carswell C, Moher D et al. 2013. Consolidated Health Economic Evaluation Reporting Standards (CHEERS)—explanation and elaboration: a report of the ISPOR Health Economic Evaluation Publication Guidelines Good Reporting Practices Task Force. Value Health 16:231–50
    [Google Scholar]
  40. Ioannidis JPA, Stanley TD, Doucouliagos H 2017. The power of bias in economics research. Econ. J. 127:F236–65
    [Google Scholar]
  41. Jacobsen PB, Prasad R, Villani J, Lee CM, Rochlin D et al. 2019. The role of economic analyses in promoting adoption of behavioral and psychosocial interventions in clinical settings. Health Psychol 38:8680–88
    [Google Scholar]
  42. Jones K, Vischi T. 1979. Impact of alcohol, drug abuse, and mental health treatment on medical care utilization. A review of the research literature. Med. Care 17:12 Suppl. 21–82
    [Google Scholar]
  43. Kaplan RM, Gold M, Duffy SQ, Miller N, Glassman JR et al. 2019. Economic analysis in behavioral health: toward application of standardized methodologies. Health Psychol 38:8672–79
    [Google Scholar]
  44. Karon BP, VandenBos GR. 1976. Cost/benefit analysis: psychologist versus psychiatrist for schizophrenics. Prof. Psychol. Res. Pract. 7:107–11
    [Google Scholar]
  45. Kazdin AE. 2018. Innovations in Psychosocial Interventions and Their Delivery: Leveraging Cutting-Edge Science to Improve the World's Mental Health Oxford, UK: Oxford Univ. Press
  46. Kazdin AE. 2019. Pioneers of early cognitive behavior therapy Video, Assoc. Behav. Cogn. Ther New York: https://www.youtube.com/watch?reload=9&v=Sh5K13k0EJ0&feature=youtu.be
  47. Kazdin AE, Blase SL. 2011. Rebooting psychotherapy research and practice to reduce the burden of mental illness. Perspect. Psychol. Sci. 6:21–37
    [Google Scholar]
  48. Kessler LG. 1981. Operations research and the mental health service system: Volume I report of the Ad Hoc Advisory Group DHHS Publ. ADM 81-1018, Natl. Inst. Ment. Health Rockville, MD:
  49. Kiluk BD, Devore KA, Buck MB, Nich C, Frankforter TL et al. 2016. Randomized trial of computerized cognitive behavior therapy for alcohol use disorders: efficacy as a virtual stand-alone and treatment add-on compared with standard outpatient treatment. Alcohol Clin. Exp. Res. 40:1991–2000
    [Google Scholar]
  50. Kiluk BD, Nich C, Buck MB, Devore KA, Frankforter TL et al. 2018. Randomized clinical trial of computerized and clinician-delivered CBT in comparison with standard outpatient treatment for substance use disorders: primary within-treatment and follow-up outcomes. Am. J. Psychiatry 175:9853–63
    [Google Scholar]
  51. Levin HM. 1975. Cost-effectiveness analysis in evaluation research. In Handbook of Evaluation Research 2 M Guttentag, EL Struening 89–122 Beverly Hills, CA: Sage
    [Google Scholar]
  52. Levin HM. 1983. Cost-Effectiveness: A Primer Beverly Hills, CA: Sage
  53. Levin HM, McEwan PJ, Belfield CR, Bowden AB, Shand RD 2018. Economic Evaluation in Education: Cost-Effectiveness and Benefit-Cost Analysis Los Angeles: Sage, 3rd ed..
  54. Linehan MM, Kanter JW, Comtois KA 1999. Dialectic behavior therapy for borderline personality disorder: efficacy, specificity, and cost effectiveness. Psychotherapy Indications and Outcomes DS Janowsky 93–118 Washington, DC: Am. Psychiatr. Press
    [Google Scholar]
  55. Lothgren M, Zethraeus N. 2000. Definition, interpretation and calculation of cost-effectiveness acceptability curves. Health Econ 9:623–30
    [Google Scholar]
  56. Luborsky L, Singer B, Luborsky L 1975. Comparative studies of psycho therapies: Is it true that “everyone has won and all must have prizes”. Arch. Gen. Psychiatry 32:995–1008
    [Google Scholar]
  57. Markowitz JC. 2015. Is psychotherapy for personality disorders worth it?. J. Clin. Psychiatry 76:111472–73
    [Google Scholar]
  58. McGuire TG. 1980. Markets for psychotherapy. See VandenBos 1980 187–245
  59. McGuire TG. 1989. Outpatient benefits for mental health services in Medicare: alignment with the private sector. Am. Psychol. 44:818–24
    [Google Scholar]
  60. Mischel W. 1968. Personality and Assessment New York: Wiley
  61. Neumann PJ, Sanders GD, Russell LB, Ganiats TG 2017. Cost-Effectiveness in Health and Medicine Oxford, UK: Oxford Univ. Press, 2nd ed..
  62. Nicholls J, Lawlor E, Neitzert E, Goodspeed T 2012. A Guide to Social Return on Investment Liverpool, UK: SROI Netw.
  63. O'Connell ME, Boat T, Warner KE 2009. Preventing Mental, Emotional, and Behavioral Disorders Among Young People: Progress and Possibilities Washington, DC: Natl. Acad. Press
  64. Ofman JJ, Sullivan SD, Neumann PJ, Chiou CF, Henning JM et al. 2003. Examining the value and quality of health economic analyses: implications of utilizing the QHES. J. Manag. Care Pharm. 9:153–61
    [Google Scholar]
  65. Olmstead TA, Sindelar JL, Easton CJ, Carroll KM 2007. The cost-effectiveness of four treatments for marijuana dependence. Addiction 102:1443–53
    [Google Scholar]
  66. Persaud N. 2005. Is cost analysis underutilized in decision making?. J. Multidiscip. Eval. 2:81–82
    [Google Scholar]
  67. Pew Charit. Trusts 2013. States’ use of cost-benefit analysis: improving results for taxpayers Rep., July 29. https://www.pewtrusts.org/en/research-and-analysis/reports/2013/07/29/states-use-of-costbenefit-analysis
  68. Pietzsch JB, Garner A, Cipriano LE, Linehan JH 2011. An integrated health-economic analysis of diagnostic and therapeutic strategies in the treatment of moderate-to-severe obstructive sleep apnea. Sleep 34:6695–709
    [Google Scholar]
  69. Robinson LA, Hammitt JK, Cecchini M, Chalkidou K, Claxton K et al. 2019. Reference Case Guidelines for Benefit-Cost Analysis in Global Health and Development Boston: Harvard T.H. Chan Sch. Public Health https://sites.sph.harvard.edu/bcaguidelines/guidelines
  70. Romero-Sanchiz P, Nogueira-Arjona R, García-Ruiz A, Luciano JV, García Compayo J et al. 2017. Economic evaluation of a guided and unguided internet-based CBT intervention for major depression: results from a multi-center, three-armed randomized controlled trial conducted in primary care. PLOS ONE 12:2e0172741
    [Google Scholar]
  71. Rothenberg J. 1975. Cost-benefit analysis: a methodological exposition. Handbook of Evaluation Research 2 M Guttentag, EL Struening 55–88 Beverly Hills, CA: Sage
    [Google Scholar]
  72. Sanders GD, Neumann PJ, Basu A, Brock DW, Feeny D et al. 2016. Recommendations for conduct, methodological practices, and reporting of cost-effectiveness analysis: Second Panel on Cost-Effectiveness in Health and Medicine. JAMA 316:101093–103
    [Google Scholar]
  73. Sava FA, Yates BT, Lupu V, Hatieganu I, Szentagotai A et al. 2009. Cost-effectiveness and cost-utility of cognitive therapy, rational emotive behavioral therapy, and fluoxetine (Prozac) in treating depression: a randomized clinical trial. J. Clin. Psychol. 65:36–52
    [Google Scholar]
  74. Scriven M. 1967. The methodology of evaluation. Perspectives of Curriculum Evaluation RW Tyler, RM Gagne, M Scriven 39–83 Chicago: Rand-McNally
    [Google Scholar]
  75. Scriven M. 1969. An introduction to meta-evaluation. Educ. Proj. Rep. 2:36–38
    [Google Scholar]
  76. Shadish WR, Cook TD, Campbell DT 2002. Experimental and Quasi-Experimental Designs for Generalized Causal Inference Boston: Houghton Mifflin
  77. Shadish WR, Matt GE, Navarro AM, Phillips G 2000. The effects of psychological therapies under clinically representative conditions: a meta-analysis. Psychol. Bull. 126:512–29
    [Google Scholar]
  78. Siegert FE, Yates BT. 1980. Behavioral child-management cost-effectiveness: a comparison of individual in-office, individual in-home, and group delivery systems. Eval. Health Prof. 3:2123–52
    [Google Scholar]
  79. Sloane RB, Staples FR, Cristol AH, Yorkston NJ, Whipple K 1975. Psychotherapy Versus Behavior Therapy Cambridge, MA: Harvard Univ. Press
  80. Smith ML, Glass GV, Miller TI 1980. The Benefits of Psychotherapy Baltimore, MD: Johns Hopkins Univ. Press
  81. Sorensen JE, Phipps DW. 1975. Cost-finding and rate-setting for community mental health centers DHEW Publ. ADM 76-291, Natl. Inst. Ment. Health Rockville, MD:
  82. Steuerle E, Jackson LM. 2016. Advancing the Power of Economic Evidence to Inform Investments in Children, Youth, and Families Washington, DC: Natl. Acad. Press
  83. Stufflebeam DL. 2001. The metaevaluation imperative. Am. J. Eval. 22:183–209
    [Google Scholar]
  84. Thaler RH, Sunstein CR. 2008. Nudge: Improving Decisions About Health, Wealth, and Happiness New Haven, CT: Yale Univ. Press
  85. Ubel PA, Hirth RA, Chernew ME, Fendrick AM 2003. What is the price of life and why doesn't it increase at the rate of inflation?. Arch. Intern. Med. 163:141637–41
    [Google Scholar]
  86. US Congress Off. Technol. Assess 1980. The Implications of Cost-Effectiveness Analysis of Medical Technology Washington, DC: US Gov. Print. Off.
  87. VandenBos G 1980. Psychotherapy: Practice, Research, Policy Beverly Hills, CA: Sage
  88. Watson DL, Tharp RG. 2013. Self-Directed Behavior: Self-Modification for Personal Adjustment Belmont, CA: Wadsworth
  89. Yates BT. 1978. Improving the cost-effectiveness of obesity programs: reducing the cost per pound. Int. J. Obes. 2:249–66
    [Google Scholar]
  90. Yates BT. 1980. Improving Effectiveness and Reducing Costs in Mental Health Springfield, IL: Charles C. Thomas
  91. Yates BT. 1981. Testimony of the American Psychological Association on the subject of effectiveness and cost-benefit of outpatient mental health services. Congr. Rec. Serial 97-11 124–30
    [Google Scholar]
  92. Yates BT. 1984. How psychology can improve the effectiveness and reduce the costs of health services. Psychotherapy 21:439–51
    [Google Scholar]
  93. Yates BT. 1985. Self-Management: The Science and Art of Helping Yourself Belmont, CA: Wadsworth
  94. Yates BT. 1986. Applications in Self-Management Belmont, CA: Wadsworth
  95. Yates BT. 1994. Toward the incorporation of costs, cost-effectiveness analysis, and cost-benefit analysis into clinical research. J. Consult. Clin. Psychol. 62:729–36
    [Google Scholar]
  96. Yates BT. 1996. Analyzing Costs, Procedures, Processes, and Outcomes in Human Services: An Introduction Thousand Oaks, CA: Sage
  97. Yates BT. 1997. Formative evaluation of costs, cost-effectiveness, and cost-benefit: toward cost → procedure → process → outcome analysis. Handbook of Applied Social Research Methods L Bickman, D Rog 285–314 Thousand Oaks, CA: Sage
    [Google Scholar]
  98. Yates BT. 1999. Measuring and improving cost, cost-effectiveness, and cost-benefit for substance abuse treatment programs Publ. 99-4518, Natl. Inst. Drug Abuse Bethesda, MD: https://archives.drugabuse.gov/publications/measuring-improving-costs-cost-effectiveness-cost-benefit-substance-abuse-treatment-programs
  99. Yates BT. 2010. Evaluating costs and benefits of consumer-operated services: unexpected resistance, unanticipated insights, and déjà vu all over again. Evaluation in the Face of Uncertainty: Anticipating Surprise and Responding to the Inevitable JA Morell 224–30 New York: Guilford
    [Google Scholar]
  100. Yates BT. 2011. Delivery systems can determine therapy costs, and effectiveness, more than type of therapy. Perspect. Psychol. Sci. 6:498–502
    [Google Scholar]
  101. Yates BT. 2012. Step arounds for common pitfalls when valuing resources used versus resources produced. New Dir. Eval. 133:43–52
    [Google Scholar]
  102. Yates BT. 2018. Commentary on standards of evidence for conducting and reporting economic evaluations in prevention science. Prev. Sci. 19:396–401
    [Google Scholar]
  103. Yates BT, Haven WG, Thoresen CE 1979. Cost-effectiveness analysis at Learning House: how much change for how much money?. Progress in Behavior Therapy with Delinquents JS Stumphauzer 186–222 Springfield, IL: Charles C. Thomas
    [Google Scholar]
  104. Yates BT, Mannix D, Freed MC, Campbell J, Johnsen M et al. 2011. Consumer-operated service programs: monetary and donated costs and cost-effectiveness. Psychiatr. Rehabil. J. 35:291–99
    [Google Scholar]
  105. Yates BT, Marra M. 2017a. Introduction to social return on investment (SROI). Eval. Progr. Plan. 64:95–97
    [Google Scholar]
  106. Yates BT, Marra M. 2017b. Social return on investment (SROI): problems, solutions…and is SROI a good investment?. Eval. Prog. Plan. 64:136–44
    [Google Scholar]
  107. Yates BT, Newman FL. 1980a. Approaches to cost-effectiveness analysis and cost-benefit analysis of psychotherapy. See VandenBos 1980 103–62
  108. Yates BT, Newman FL. 1980b. Findings of cost-effectiveness and cost-benefit analyses of psychotherapy. See VandenBos 1980 163–85
  109. Yates BT, Taub J. 2003. Assessing the costs, benefits, cost-effectiveness, and cost-benefit of psychological assessment: We should, we can, and here's how. Psychol. Assess. 15:478–95
    [Google Scholar]
  110. Youngstrom EA, De Los Reyes A 2015. Commentary: moving toward cost-effectiveness in using psychophysiological measures in clinical assessment: validity, decision making, and adding value. J. Clin. Child Adolesc. Psychol. 44:2352–61
    [Google Scholar]
  111. Yount SE, Cella D, Blozis S 2019. PROMIS®: standardizing the patient voice in health psychology research and practice. Health Psychol 38:5343–46
    [Google Scholar]
/content/journals/10.1146/annurev-clinpsy-071519-110415
Loading
/content/journals/10.1146/annurev-clinpsy-071519-110415
Loading

Data & Media loading...

  • Article Type: Review Article
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error