1932

Abstract

To build a coherent knowledge base about what psychological intervention strategies work, develop interventions that have positive societal impact, and maintain and increase this impact over time, it is necessary to replace the classical treatment package research paradigm. The multiphase optimization strategy (MOST) is an alternative paradigm that integrates ideas from behavioral science, engineering, implementation science, economics, and decision science. MOST enables optimization of interventions to strategically balance effectiveness, affordability, scalability, and efficiency. In this review we provide an overview of MOST, discuss several experimental designs that can be used in intervention optimization, consider how the investigator can use experimental results to select components for inclusion in the optimized intervention, discuss the application of MOST in implementation science, and list future issues in this rapidly evolving field. We highlight the feasibility of adopting this new research paradigm as well as its potential to hasten the progress of psychological intervention science.

Loading

Article metrics loading...

/content/journals/10.1146/annurev-clinpsy-080822-051119
2024-07-12
2025-02-15
Loading full text...

Full text loading...

/deliver/fulltext/clinpsy/20/1/annurev-clinpsy-080822-051119.html?itemId=/content/journals/10.1146/annurev-clinpsy-080822-051119&mimeType=html&fmt=ahah

Literature Cited

  1. Aarons GA, Hurlburt M, Horwitz SM. 2011.. Advancing a conceptual model of evidence-based practice implementation in public service sectors. . Adm. Policy Ment. Health 38:(1):423
    [Crossref] [Google Scholar]
  2. Almirall D, Chronis-Tuscano A. 2016.. Adaptive interventions in child and adolescent mental health. . J. Clin. Child Adolesc. Psychol. 45:(4):38395
    [Crossref] [Google Scholar]
  3. Almirall D, Nahum-Shani I, Wang L, Kasari C. 2018.. Experimental designs for research on adaptive interventions: singly and sequentially randomized trials. . See Collins & Kugler 2018 , pp. 89120
  4. Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, et al. 2010.. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. . Cochrane Database Syst. Rev. 2010:(3):CD005470
    [Google Scholar]
  5. Broder-Fingert S, Kuhn J, Sheldrick RC, Chu A, Fortuna L, et al. 2019.. Using the Multiphase Optimization Strategy (MOST) framework to test intervention delivery strategies: a study protocol. . Trials 20::728
    [Crossref] [Google Scholar]
  6. Caldwell LL, Smith EA, Collins LM, Graham JW, Lai M, et al. 2012.. Translational research in South Africa: evaluating implementation quality using a factorial design. . Child Youth Care Forum 41:(2):11936
    [Crossref] [Google Scholar]
  7. Cohen J. 1988.. Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ:: Lawrence Erlbaum. , 2nd ed..
    [Google Scholar]
  8. Collins LM. 2018.. Optimization of Behavioral, Biobehavioral, and Biomedical Interventions: The Multiphase Optimization Strategy (MOST). New York:: Springer
    [Google Scholar]
  9. Collins LM, Baker TB, Mermelstein RJ, Piper ME, Jorenby DE, et al. 2011.. The multiphase optimization strategy for engineering effective tobacco use interventions. . Ann. Behav. Med. 41:(2):20826
    [Crossref] [Google Scholar]
  10. Collins LM, Chakraborty B, Murphy SA, Strecher V. 2009.. Comparison of a phased experimental approach and a single randomized clinical trial for developing multicomponent behavioral interventions. . Clin. Trials 6:(1):515
    [Crossref] [Google Scholar]
  11. Collins LM, Kugler KC, eds. 2018.. Optimization of Behavioral, Biobehavioral, and Biomedical Interventions: Advanced Topics. Cham, Switz.:: Springer
    [Google Scholar]
  12. Collins LM, Murphy SA, Bierman KL. 2004.. A conceptual framework for adaptive preventive interventions. . Prev. Sci. 5:(3):18596
    [Crossref] [Google Scholar]
  13. Collins LM, Strayhorn JC, Vanness DJ. 2021.. One view of the next decade of research on behavioral and biobehavioral approaches to cancer prevention and control: intervention optimization. . Transl. Behav. Med. 11:(11):19982008
    [Crossref] [Google Scholar]
  14. Collins LM, Trail JB, Kugler KC, Baker TB, Piper ME, Mermelstein RJ. 2014.. Evaluating individual intervention components: making decisions based on the results of a factorial screening experiment. . Transl. Behav. Med. 4:(3):23851
    [Crossref] [Google Scholar]
  15. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. 2012.. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. . Med. Care 50:(3):21726
    [Crossref] [Google Scholar]
  16. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. 2009.. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. . Implement. Sci. 4::50
    [Crossref] [Google Scholar]
  17. Damschroder LJ, Reardon CM, Widerquist MAO, Lowery J. 2022.. The updated consolidated framework for implementation research based on user feedback. . Implement. Sci. 17::75
    [Crossref] [Google Scholar]
  18. Downs DS, Savage JS, Rivera DE, Pauley AM, Leonard KS, et al. 2021.. Adaptive, behavioral intervention impact on weight gain, physical activity, energy intake, and motivational determinants: results of a feasibility trial in pregnant women with overweight/obesity. . J. Behav. Med. 44:(5):60521
    [Crossref] [Google Scholar]
  19. Dziak JJ, Almirall D, Dempsey W, Stanger C, Nahum-Shani I. 2024.. SMART binary: new sample size planning resources for SMART studies with binary outcome measurements. . Multivar. Behav. Res. 59:(1):116
    [Crossref] [Google Scholar]
  20. Dziak JJ, Nahum-Shani I, Collins LM. 2012.. Multilevel factorial experiments for developing behavioral interventions: power, sample size, and resource considerations. . Psychol. Methods 17:(2):15375
    [Crossref] [Google Scholar]
  21. Fernandez ME, Schlechter CR, Del Fiol G, Gibson B, Kawamoto K, et al. 2020.. QuitSMART Utah: an implementation study protocol for a cluster-randomized, multi-level sequential multiple assignment randomized trial to increase reach and impact of tobacco cessation treatment in community health centers. . Implement. Sci. 15::9
    [Crossref] [Google Scholar]
  22. Fisher RA. 1946.. Statistical Methods for Research Workers. London:: Oliver and Boyd. , 10th ed..
    [Google Scholar]
  23. Gallis JA, Bennett GG, Steinberg DM, Askew S, Turner EL. 2019.. Randomization procedures for multicomponent behavioral intervention factorial trials in the multiphase optimization strategy framework: challenges and recommendations. . Transl. Behav. Med. 9:(6):104756
    [Crossref] [Google Scholar]
  24. Guastaferro K, Collins LM. 2021.. Optimization methods and implementation science: an opportunity for behavioral and biobehavioral interventions. . Implement. Res. Pract. 2::26334895211054364
    [Google Scholar]
  25. Guo P, Rivera DE, Dong Y, Deshpande S, Savage JS, et al. 2022.. Optimizing behavioral interventions to regulate gestational weight gain with sequential decision policies using hybrid model predictive control. . Comput. Chem. Eng. 160::107721
    [Crossref] [Google Scholar]
  26. Gwadz MV, Collins LM, Cleland CM, Leonard NR, Wilton L, et al. 2017.. Using the multiphase optimization strategy (MOST) to optimize an HIV care continuum intervention for vulnerable populations: a study protocol. . BMC Public Health 17::383
    [Crossref] [Google Scholar]
  27. Kazdin AE. 2000.. Psychotherapy for Children and Adolescents: Directions for Research and Practice. Oxford, UK/New York:: Oxford Univ. Press
    [Google Scholar]
  28. Kidwell KM, Almirall D. 2023.. Sequential, multiple assignment, randomized trial designs. . JAMA 329:(4):33637
    [Crossref] [Google Scholar]
  29. Kidwell KM, Seewald NJ, Tran Q, Kasari C, Almirall D. 2018.. Design and analysis considerations for comparing dynamic treatment regimens with binary outcomes from sequential multiple assignment randomized trials. . J. Appl. Stat. 45::162851
    [Crossref] [Google Scholar]
  30. Kilbourne AM, Almirall D, Eisenberg D, Waxmonsky J, Goodrich DE, et al. 2014.. Protocol: adaptive implementation of effective programs trial (ADEPT): cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program. . Implement. Sci. 9::132
    [Crossref] [Google Scholar]
  31. Kugler KC, Wyrick DL, Tanner AE, Milroy JJ, Chambers B, et al. 2018.. Using the multiphase optimization strategy (MOST) to develop an optimized online STI preventive intervention aimed at college students: description of conceptual model and iterative approach to optimization. . See Collins & Kugler 2018 , pp. 121
  32. Landoll RR, Vargas SE, Samardzic KB, Clark MF, Guastaferro K. 2022.. The preparation phase in the multiphase optimization strategy (MOST): a systematic review and introduction of a reporting checklist. . Transl. Behav. Med. 12:(2):291303
    [Crossref] [Google Scholar]
  33. Leeman J, Birken SA, Powell BJ, Rohweder C, Shea CM. 2017.. Beyond “implementation strategies”: classifying the full range of strategies used in implementation science and practice. . Implement. Sci. 12::125
    [Crossref] [Google Scholar]
  34. Liao P, Klasnja P, Tewari A, Murphy SA. 2016.. Sample size calculations for micro-randomized trials in mHealth. . Stat. Med. 35:(12):194471
    [Crossref] [Google Scholar]
  35. Marques MM, Guastaferro K. 2022.. The development of effective and tailored digital behavior change interventions: an introduction to the multiphase optimization strategy (MOST). . Eur. Health Psychol. 22:(4):793800
    [Google Scholar]
  36. McClure JB, Derry H, Riggs KR, Westbrook EW, St John J, et al. 2012.. Questions about quitting (Q2): design and methods of a multiphase optimization strategy (MOST) randomized screening experiment for an online, motivational smoking cessation intervention. . Contemp. Clin. Trials 33:(5):1094102
    [Crossref] [Google Scholar]
  37. Michie S, Atkins L, West R. 2014.. The Behaviour Change Wheel Book: A Guide to Designing Interventions. London:: Silverback
    [Google Scholar]
  38. Montgomery RJV, Kwak J, Kosloski K, O'Connell Valuch K. 2011.. Effects of the TCARE® intervention on caregiver burden and depressive symptoms: preliminary findings from a randomized controlled study. . J. Gerontol. B 66:(5):64047
    [Crossref] [Google Scholar]
  39. Murphy SA. 2005.. An experimental design for the development of adaptive treatment strategies. . Stat. Med. 24:(10):145581
    [Crossref] [Google Scholar]
  40. Murray DM. 1998.. Design and Analysis of Group-Randomized Trials. Oxford, UK:: Oxford Univ. Press
    [Google Scholar]
  41. Nahum-Shani I, Dziak JJ. 2018.. Multilevel factorial designs in intervention development. . See Collins & Kugler 2018 , pp. 4787
  42. Nahum-Shani I, Dziak JJ, Collins LM. 2018a.. Multilevel factorial designs with experiment-induced clustering. . Psychol. Methods 23:(3):45879
    [Crossref] [Google Scholar]
  43. Nahum-Shani I, Dziak JJ, Venera H, Pfammatter AF, Spring B, Dempsey W. 2023.. Design of experiments with sequential randomizations on multiple timescales: the hybrid experimental design. . Behav. Res. Methods. https://doi.org/10.3758/s13428-023-02119-z
    [Google Scholar]
  44. Nahum-Shani I, Dziak JJ, Walton MA, Dempsey W. 2022a.. Hybrid experimental designs for intervention development: what, why, and how. . Adv. Methods Pract. Psychol. Sci. 5:(3):25152459221114280
    [Google Scholar]
  45. Nahum-Shani I, Dziak JJ, Wetter DW. 2022b.. MCMTC: a pragmatic framework for selecting an experimental design to inform the development of digital interventions. . Front. Digit. Health 4::798025
    [Crossref] [Google Scholar]
  46. Nahum-Shani I, Potter LN, Lam CY, Yap J, Moreno A, et al. 2021.. The mobile assistance for regulating smoking (MARS) micro-randomized trial design protocol. . Contemp. Clin. Trials 110::106513
    [Crossref] [Google Scholar]
  47. Nahum-Shani I, Shaw SD, Carpenter SM, Murphy SA, Yoon C. 2022c.. Engagement in digital interventions. . Am. Psychol. 77:(7):83652
    [Crossref] [Google Scholar]
  48. Nahum-Shani I, Smith SN, Spring BJ, Collins LM, Witkiewitz K, et al. 2018b.. Just-in-time adaptive interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. . Ann. Behav. Med. 52:(6):44662
    [Crossref] [Google Scholar]
  49. NIH (Natl. Inst. Health.). 2017.. NIH's definition of a clinical trial. . National Institutes of Health. https://grants.nih.gov/policy/clinical-trials/definition.htm
    [Google Scholar]
  50. O'Hara KL, Knowles LM, Guastaferro K, Lyon AR. 2022.. Human-centered design methods to achieve preparation phase goals in the multiphase optimization strategy framework. . Implement. Res. Pract. 3::26334895221131052
    [Google Scholar]
  51. Papa A, Follette WC. 2015.. Dismantling studies of psychotherapy. . In The Encyclopedia of Clinical Psychology, ed. RL Cautin, SO Lilienfeld . Chichester, UK:: Wiley. https://doi.org/10.1002/9781118625392.wbecp523
    [Google Scholar]
  52. Perry CK, Damschroder LJ, Hemler JR, Woodson TT, Ono SS, Cohen DJ. 2019.. Specifying and comparing implementation strategies across seven large implementation interventions: a practical application of theory. . Implement. Sci. 14::32
    [Crossref] [Google Scholar]
  53. Piper ME, Schlam TR, Cook JW, Smith SS, Bolt DM, et al. 2017.. Toward precision smoking cessation treatment I: moderator results from a factorial experiment. . Drug Alcohol Depend. 171::5965
    [Crossref] [Google Scholar]
  54. Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, et al. 2017.. Methods to improve the selection and tailoring of implementation strategies. . J. Behav. Health Serv. Res. 44:(2):17794
    [Crossref] [Google Scholar]
  55. Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT, et al. 2012.. A compilation of strategies for implementing clinical innovations in health and mental health. . Med. Care Res. Rev. 69:(2):12357
    [Crossref] [Google Scholar]
  56. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, et al. 2015.. A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project. . Implement. Sci. 10::21
    [Crossref] [Google Scholar]
  57. Proctor EK, Powell BJ, McMillen JC. 2013.. Implementation strategies: recommendations for specifying and reporting. . Implement. Sci. 8::139
    [Crossref] [Google Scholar]
  58. Qian T, Walton AE, Collins LM, Klasnja P, Lanza ST, et al. 2022.. The microrandomized trial for developing digital interventions: experimental design and data analysis considerations. . Psychol. Methods 27::87494
    [Crossref] [Google Scholar]
  59. Rivera DE, Hekler EB, Savage JS, Downs DS. 2018.. Intensively adaptive interventions using control systems engineering: two illustrative examples. . See Collins & Kugler 2018 , pp. 12173
  60. Shiffman S, Stone AA, Hufford MR. 2008.. Ecological momentary assessment. . Annu. Rev. Clin. Psychol. 4::132
    [Crossref] [Google Scholar]
  61. Smith SN, Almirall D, Choi SY, Koschmann E, Rusch A, et al. 2022.. Primary aim results of a clustered SMART for developing a school-level, adaptive implementation strategy to support CBT delivery at high schools in Michigan. . Implement. Sci. 17::42
    [Crossref] [Google Scholar]
  62. Smith SN, Almirall D, Prenovost K, Liebrecht C, Kyle J, et al. 2019.. Change in patient outcomes after augmenting a low-level implementation strategy in community practices that are slow to adopt a collaborative chronic care model: a cluster randomized implementation trial. . Med. Care 57:(7):50311
    [Crossref] [Google Scholar]
  63. Stirman SW, Beidas RS. 2020.. Expanding the reach of psychological science through implementation science: introduction to the special issue. . Am. Psychol. 75:(8):103337
    [Crossref] [Google Scholar]
  64. Strayhorn JC, Collins LM, Brick TR, Marchese SH, Pfammatter AF, et al. 2022.. Using factorial mediation analysis to better understand the effects of interventions. . Transl. Behav. Med. 12:(1):ibab137
    [Crossref] [Google Scholar]
  65. Strayhorn JC, Collins LM, Vanness DJ. 2023.. A posterior expected value approach to decision-making in the multiphase optimization strategy for intervention science. . Psychol. Methods. https://psycnet.apa.org/doi/10.1037/met0000569
    [Google Scholar]
  66. Strayhorn JC, Vanness DJ, Collins LM. 2024a.. Optimizing interventions for equitability: some initial ideas. . Prev. Sci. https://doi.org/10.1007/s11121-024-01644-3
    [Google Scholar]
  67. Strayhorn JC, Cleland CM, Vanness DJ, Wilton L, Gwadz M, Collins LM. 2024b.. Using decision analysis for intervention value efficiency to select optimized interventions in the multiphase optimization strategy. . Health Psychol. 43:(2):89100
    [Crossref] [Google Scholar]
  68. Tanner AE, Guastaferro KM, Rulison KL, Wyrick DL, Milroy JJ, et al. 2021.. A hybrid evaluation-optimization trial to evaluate an intervention targeting the intersection of alcohol and sex in college students and simultaneously test an additional component aimed at preventing sexual violence. . Ann. Behav. Med. 55:(12):118487
    [Crossref] [Google Scholar]
  69. Vanness D, Collins LM, Strayhorn JC. 2023.. P25 dynamic intervention optimization (DIO): a Bayesian adaptive framework for multicomponent intervention optimization using expected net benefit of sampling. . Value Health 26:(6 Suppl.):S6
    [Crossref] [Google Scholar]
  70. Voils CI, King HA, Maciejewski ML, Allen KD, Yancy WS, Shaffer JA. 2014.. Approaches for informing optimal dose of behavioral interventions. . Ann. Behav. Med. 48:(3):392401
    [Crossref] [Google Scholar]
  71. Walton A, Nahum-Shani I, Crosby L, Klasnja P, Murphy S. 2018.. Optimizing digital integrated care via micro-randomized trials. . Clin. Pharmacol. Ther. 104:(1):5358
    [Crossref] [Google Scholar]
  72. Watkins E, Newbold A, Tester-Jones M, Collins LM, Mostazir M. 2023.. Investigation of active ingredients within internet-delivered cognitive behavioral therapy for depression: a randomized optimization trial. . JAMA Psychiatry 80:(9):94251
    [Crossref] [Google Scholar]
  73. Watkins E, Newbold A, Tester-Jones M, Javaid M, Cadman J, et al. 2016.. Implementing multifactorial psychotherapy research in online virtual environments (IMPROVE-2): study protocol for a phase III trial of the MOST randomized component selection method for internet cognitive-behavioural therapy for depression. . BMC Psychiatry 16::345
    [Crossref] [Google Scholar]
  74. Weiner BJ, Lewis MA, Clauser SB, Stitzenberg KB. 2012.. In search of synergy: strategies for combining interventions at multiple levels. . J. Natl. Cancer Inst. Monogr. 2012:(44):3441
    [Crossref] [Google Scholar]
  75. Wu CFJ, Hamada MS. 2011.. Experiments: Planning, Analysis, and Optimization. New York:: Wiley
    [Google Scholar]
  76. Wyrick DL, Tanner AE, Milroy JJ, Guastaferro K, Bhandari S, et al. 2020.. itMatters: optimization of an online intervention to prevent sexually transmitted infections in college students. . J. Am. Coll. Health 70:(4):121222
    [Crossref] [Google Scholar]
  77. Yap J, Dziak JJ, Maiti R, Lynch K, McKay JR, et al. 2023.. Sample size estimation for comparing dynamic treatment regimens in a SMART: a Monte Carlo-based approach and case study with longitudinal overdispersed count outcomes. . Stat. Methods Med. Res. 32:(7):126783
    [Crossref] [Google Scholar]
/content/journals/10.1146/annurev-clinpsy-080822-051119
Loading
/content/journals/10.1146/annurev-clinpsy-080822-051119
Loading

Data & Media loading...

  • Article Type: Review Article
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error