1932
0
  1. Home
  2. A-Z Publications
  3. Annual Review of Public Health
  4. Volume 45, 2024
  5. Article

Annual Review of Public Health

Volume 45, 2024

Adaptive Designs in Implementation Science and Practice: Their Promise and the Need for Greater Understanding and Improved Communication

Abstract

The promise of adaptation and adaptive designs in implementation science has been hindered by the lack of clarity and precision in defining what it means to adapt, especially regarding the distinction between adaptive study designs and adaptive implementation strategies. To ensure a common language for science and practice, authors reviewed the implementation science literature and found that the term adaptive was used to describe interventions, implementation strategies, and trial designs. To provide clarity and offer recommendations for reporting and strengthening study design, we propose a taxonomy that describes fixed versus adaptive implementation strategies and implementation trial designs. To improve impact, () futureimplementation studies should prespecify implementation strategy core functions that in turn can be taught to and replicated by health system/community partners, () funders should support exploratory studies that refine and specify implementation strategies, and () investigators should systematically address design requirements and ethical considerations (e.g., randomization, blinding/masking) with health system/community partners.

Keyword(s): adaptation, cluster randomized design, community engagement, implementation strategies, quality improvement
Loading

Article metrics loading...

/content/journals/10.1146/annurev-publhealth-060222-014438
2024-05-20
2024-05-29
Loading full text...

Full text loading...

/deliver/fulltext/publhealth/45/1/annurev-publhealth-060222-014438.html?itemId=/content/journals/10.1146/annurev-publhealth-060222-014438&mimeType=html&fmt=ahah

Literature Cited

  1. 1.
    Acosta J, Chinman M, Ebener P, Malone PS, Cannon J, D'Amico EJ. 2020.. Sustaining an evidence-based program over time: moderators of sustainability and the role of the Getting To Outcomes implementation support intervention. . Prev. Sci. 21::807–19
     [Crossref] [Google Scholar]
  2. 2.
    Almirall D, Nahum-Shani I, Wang L, Kasari C. 2018.. Experimental designs for research on adaptive interventions: singly and sequentially randomized trials. . In Optimization of Behavioral, Biobehavioral, and Biomedical Interventions, ed. LM Collins, K Kugler , pp. 89–120. Cham, Switz.:: Springer
     [Google Scholar]
  3. 3.
    Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA. 1998.. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. . BMJ 317:(7156):465–68
     [Crossref] [Google Scholar]
  4. 4.
    Berta W, Cranley L, Dearing JW, Dogherty EJ, Squires JE, Estabrooks CA. 2015.. Why (we think) facilitation works: insights from organizational learning theory. . Implement. Sci. 10:(1):141
     [Crossref] [Google Scholar]
  5. 5.
    Brown CH, Curran G, Palinkas LA, Aarons GA, Wells KB, et al. 2017.. An overview of research and evaluation designs for dissemination and implementation. . Annu. Rev. Public Health 38::1–22
     [Crossref] [Google Scholar]
  6. 6.
    Burgess RA, Shittu F, Iuliano A, Haruna I, Valentine P, et al. 2023.. Whose knowledge counts? Involving communities in intervention and trial design using community conversations. . Trials 24:(1):385
     [Crossref] [Google Scholar]
  7. 7.
    Butcher NJ, Monsour A, Mew EJ, Chan A-W, Moher D, et al. 2022.. Guidelines for reporting outcomes in trial reports: the CONSORT-Outcomes 2022 Extension. . JAMA 328:(22):2252–64 7. Presents evidence- and consensus-based standards for reporting outcomes in clinical trials.
     [Crossref] [Google Scholar]
  8. 8.
    Cannon JS, Gilbert M, Ebener P, Malone PS, Reardon CM. 2019.. Influence of an implementation support intervention on barriers and facilitators to delivery of a substance use prevention program. . Prev. Sci. 20::1200–10
     [Crossref] [Google Scholar]
  9. 9.
    Chang M, Chow S-C. 2005.. A hybrid Bayesian adaptive design for dose response trials. . J. Biopharm. Stat. 15:(4):677–91
     [Crossref] [Google Scholar]
  10. 10.
    Chinman M, Acosta J, Ebener P, Malone PS, Slaughter M. 2016.. Can implementation-support help community-based settings better deliver evidence-based sexual health promotion programs: a randomized trial of Getting To Outcomes®. . Implement. Sci. 11::78
     [Crossref] [Google Scholar]
  11. 11.
    Chinman M, Acosta J, Ebener P, Malone PS, Slaughter M. 2018.. A cluster-randomized trial of Getting To Outcomes’ impact on sexual health outcomes in community-based settings. . Prev. Sci. 19::437–48 11. Demonstrates that Getting To Outcomes improves program fidelity and outcomes from a randomized trial.
     [Crossref] [Google Scholar]
  12. 12.
    Chinman M, Acosta J, Ebener P, Shearer A. 2022.. “ What we have here, is a failure to [replicate]”: ways to solve a replication crisis in implementation science. . Prev. Sci. 23:(5):739–50
     [Crossref] [Google Scholar]
  13. 13.
    Chinman M, Ebener P, Malone PS, Cannon J, D'Amico E, Acosta J. 2018.. Testing implementation support for evidence-based programs in community settings: a replication cluster-randomized trial of Getting To Outcomes®. . Implement. Sci. 13::131
     [Crossref] [Google Scholar]
  14. 14.
    Cohen JA, Mannarino AP, Deblinger E. 2006.. Treating Trauma and Traumatic Grief in Children and Adolescents. New York:: Guilford Press
  15. 15.
    Creed TA, Kuo PB, Oziel R, Reich D, Thomas M, et al. 2022.. Knowledge and attitudes toward an artificial intelligence-based fidelity measurement in community cognitive behavioral therapy supervision. . Adm. Policy Ment. Health 49:(3):343–56
     [Crossref] [Google Scholar]
  16. 16.
    Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. 2012.. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. . Med. Care 50:(3):217–26 16. Presents the hybrid designs for implementation research, which combines efficacy and implementation trial aspects.
     [Crossref] [Google Scholar]
  17. 17.
    Curran GM, Landes SJ, McBain SA, Pyne JM, Smith JD, et al. 2022.. Reflections on 10 years of effectiveness-implementation hybrid studies. . Front. Health Serv. 2::1053496
     [Crossref] [Google Scholar]
  18. 18.
    Eisman AB, Kim B, Salloum RG, Shuman CJ, Glasgow RE. 2022.. Advancing rapid adaptation for urgent public health crises: using implementation science to facilitate effective and efficient responses. . Front. Public Health 10::959567
     [Crossref] [Google Scholar]
  19. 19.
    Esmail LC, Barasky R, Mittman BS, Hickam DH. 2020.. Improving comparative effectiveness research of complex health interventions: standards from the Patient-Centered Outcomes Research Institute (PCORI). . J. Gen. Intern. Med. 35:(Suppl. 2):875–81
     [Crossref] [Google Scholar]
  20. 20.
    Fixsen D, Blasé KA, Naoom SF, Wallace F. 2009.. Core implementation components. . Res. Soc. Work Pract. 19:(5):531–40 20. Reviews literature and presents a framework of core implementation functions that are consistent across efforts.
     [Crossref] [Google Scholar]
  21. 21.
    Forbes D. 2013.. Blinding: an essential component in decreasing risk of bias in experimental designs. . Evid.-Based Nursing 16::70–71
     [Crossref] [Google Scholar]
  22. 22.
    Frakt AB, Prentice JC, Pizer SD, Elwy AR, Garrido MM, et al. 2018.. Overcoming challenges to evidence-based policy development in a large, integrated delivery system. . Health Serv. Res. 53:(6):4789–807
     [Crossref] [Google Scholar]
  23. 23.
    Geng EH, Mody A, Powell BJ. 2023.. On-the-go adaptation of implementation approaches and strategies in health: emerging perspectives and research opportunities. . Annu. Rev. Public Health 44::21–36
     [Crossref] [Google Scholar]
  24. 24.
    Goss C. 2023.. MAISYs: a flexible tool to meet the changing needs of implementation science. . Wash. Univ. St. Louis Cent. Dissem. Implement. Blog, Jan. 22. https://publichealth.wustl.edu/maisys-a-flexible-tool-to-meet-the-changing-needs-of-implementation-science/
    [Google Scholar]
  25. 25.
    Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L, et al. 2001.. Changing provider behavior: an overview of systematic reviews of interventions. . Med. Care 39:(8 Suppl. 2):II2–45
     [Google Scholar]
  26. 26.
    Guastaferro K, Collins LM. 2021.. Optimization methods and implementation science: an opportunity for behavioral and biobehavioral interventions. . Implement. Res. Pract. 2::26334895211054363
     [Google Scholar]
  27. 27.
    Herman PM, Chinman M, Cannon J, Ebener P, Malone PS, et al. 2020.. Cost analysis of Getting to Outcomes implementation support of CHOICE in Boys and Girls Clubs in Southern California. . Prev. Sci. 21::245–55
     [Crossref] [Google Scholar]
  28. 28.
    Herman PM, Chinman M, Ebener P, Malone PS, Acosta J. 2020.. Cost analysis of a randomized trial of Getting to Outcomes implementation support for a teen pregnancy prevention program offered in Boys and Girls Clubs in Alabama and Georgia. . Prev. Sci. 21:(8):1114–25
     [Crossref] [Google Scholar]
  29. 29.
    Hwang S, Birken SA, Melvin CL, Rohweder CL, Smith JD. 2020.. Designs and methods for implementation research: advancing the mission of the CTSA program. . J. Clin. Transl. Sci. 4::159–67
     [Crossref] [Google Scholar]
  30. 30.
    Johnson K, Gustafson D, Ewigman B, Provost L, Roper R. 2015.. Using rapid-cycle research to reach goals: awareness, assessment, adaptation, acceleration. AHRQ Publ. 15-0036 , Agency Healthc. Res. Qual. (AHRQ), Rockville, MD:
  31. 31.
    Kapur J, Elm J, Chamberlain JM, Barsan W, Cloyd J, et al. 2019.. Randomized trial of three anticonvulsant medications for status epilepticus. . N. Engl. J. Med. 381:(22):2103–13
     [Crossref] [Google Scholar]
  32. 32.
    Kasari C, Kaiser A, Goods K, Nietfeld J, Mathy P, et al. 2014.. Communication interventions for minimally verbal children with autism: a sequential multiple assignment randomized trial. . J. Am. Acad. Child Adolesc. Psychiatry 53:(6):635–46
     [Crossref] [Google Scholar]
  33. 33.
    Kho A, Daumit GL, Truesdale KP, Brown A, Kilbourne AM, et al. 2022.. The National Heart Lung and Blood Institute Disparities Elimination through Coordinated Interventions to Prevent and Control Heart and Lung Disease Alliance. . Health Serv. Res. 57:(Suppl. 1):20–31
     [Crossref] [Google Scholar]
  34. 34.
    Kilbourne AM, Almirall D, Eisenberg D, Waxmonsky J, Goodrich DE, et al. 2014.. Protocol: Adaptive Implementation of Effective Programs Trial (ADEPT): cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program. . Implement. Sci. 9::132
     [Crossref] [Google Scholar]
  35. 35.
    Kilbourne AM, Almirall D, Goodrich DE, Lai Z, Abraham KM, et al. 2014.. Enhancing outreach for persons with serious mental illness: 12-month results from a cluster randomized trial of an adaptive implementation strategy. . Implement. Sci. 9:(1):163
     [Crossref] [Google Scholar]
  36. 36.
    Kilbourne AM, Barbaresso MM, Lai Z, Nord KM, Bramlet M, et al. 2017.. Improving physical health in patients with chronic mental disorders: twelve-month results from a randomized controlled collaborative care trial. . J. Clin. Psychiatry 78:(1):129–37
     [Crossref] [Google Scholar]
  37. 37.
    Kilbourne AM, Geng E, Eshun-Wilson I, Sweeney S, Shelley D, et al. 2023.. How does facilitation in healthcare work? Using mechanism mapping to illuminate the black box of a meta-implementation strategy. . Implement. Sci. Commun. 4:(1):53
     [Crossref] [Google Scholar]
  38. 38.
    Kilbourne AM, Goodrich DE, Miake-Lye I, Braganza MZ, Bowersox NW. 2019.. Quality enhancement research initiative implementation roadmap: toward sustainability of evidence-based practices in a learning health system. . Med. Care 57:(10 Suppl. 3):S286–93
     [Crossref] [Google Scholar]
  39. 39.
    Kilbourne AM, Neumann MS, Pincus HA, Bauer MS, Stall R. 2007.. Implementing evidence-based interventions in health care: application of the Replicating Effective Programs framework. . Implement. Sci. 2:(1):42 39. Describes an implementation strategy that focuses on a process to enable adaptation of effective interventions up front in order to enable more feasible implementation over time.
     [Crossref] [Google Scholar]
  40. 40.
    Kilbourne AM, Smith SN, Choi SY, Koschmann E, Liebrecht C, Rusch A, et al. 2018.. Adaptive School-based Implementation of CBT (ASIC): clustered-SMART for building an optimized adaptive implementation intervention to improve uptake of mental health interventions in schools. . Implement. Sci. 13:(1):119
     [Crossref] [Google Scholar]
  41. 41.
    Kirchner JE, Ritchie MJ, Pitcock JA, Parker LE, Curran GM, Fortney JC. 2014.. Outcomes of a partnered facilitation strategy to implement primary care–mental health. . J. Gen. Intern. Med. 29:(4):904–12
     [Crossref] [Google Scholar]
  42. 42.
    Kwan BM, Brownson RC, Glasgow RE, Morrato EH, Luke DA. 2022.. Designing for dissemination and sustainability to promote equitable impacts on health. . Annu. Rev. Public Health 43::331–53
     [Crossref] [Google Scholar]
  43. 43.
    Leeman J, Birken SA, Powell BJ, Rohweder C, Shea CM. 2017.. Beyond “implementation strategies”: classifying the full range of strategies used in implementation science and practice. . Implement. Sci. 12:(1):125
     [Crossref] [Google Scholar]
  44. 44.
    Mazzucca S, Tabak RG, Pilar M, Ramsey AT, Baumann AA, et al. 2018.. Variation in research designs used to test the effectiveness of dissemination and implementation strategies: a review. . Front. Public Health 6::32
     [Crossref] [Google Scholar]
  45. 45.
    Miller CJ, Barnett ML, Baumann AA, Gutner CA, Wiltsey-Stirman S. 2021.. The FRAME-IS: a framework for documenting modifications to implementation strategies in healthcare. . Implement. Sci. 16:(1):36 45. Presents a framework and tool to track changes to implementation strategies during an implementation effort.
     [Crossref] [Google Scholar]
  46. 46.
    Miller CJ, Smith SN, Pugatch M. 2020.. Experimental and quasi-experimental designs in implementation research. . Psychiatry Res. 283::112452
     [Crossref] [Google Scholar]
  47. 47.
    Nahum-Shani I, Almirall D, Buckley J. 2019.. An introduction to adaptive interventions and SMART Designs in Education. NCSER 2020-001 , US Dep. Educ., Natl. Cent. Spec. Educ. Res., Washington, DC:. https://ies.ed.gov/ncser/pubs/2020001/pdf/2020001.pdf
  48. 48.
    Pallmann P, Bedding AW, Choodari-Oskooei B, Dimairo M, Flight L, et al. 2018.. Adaptive designs in clinical trials: why use them, and how to run and report them. . BMC Med. 16:(1):29
     [Crossref] [Google Scholar]
  49. 49.
    Parchman ML, Anderson ML, Dorr DA, Fagnan LJ, O'Meara ES, et al. 2019.. A randomized trial of external practice support to improve cardiovascular risk factors in primary care. . Ann. Fam. Med. 17:(Suppl. 1):S40–49
     [Crossref] [Google Scholar]
  50. 50.
    Perkins GD, Ji C, Deakin CD, Quinn T, Nolan JP, et al., PARAMEDIC2 Collab. 2018.. A Randomized Trial of Epinephrine in Out-of-Hospital Cardiac Arrest. . N. Engl. J. Med. 379:(8):711–21
     [Crossref] [Google Scholar]
  51. 51.
    Powell BJ, Beidas RS, Lewis CC, Aarons GA, McMillen JC, et al. 2017.. Methods to improve the selection and tailoring of implementation strategies. . J. Behav. Health Serv. Res. 44:(2):177–94 51. Provides an overview of methods for matching implementation strategies to the local need and context.
     [Crossref] [Google Scholar]
  52. 52.
    Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, et al. 2015.. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. . Implement. Sci. 10::21 52. Researchers used implementation experts to develop a standard terminology for implementation strategies.
     [Crossref] [Google Scholar]
  53. 53.
    Proctor EK, Powell BJ, McMillen JC. 2013.. Implementation strategies: recommendations for specifying and reporting. . Implement. Sci. 8:(1):139 53. Provides guidance on how to report implementation strategies in papers in a standardized format.
     [Crossref] [Google Scholar]
  54. 54.
    Proctor E, Ramsey AT, Saldana L, Maddox TM, Chambers DA, Brownson RC. 2022.. FAST: A Framework to Assess Speed of Translation of health innovations to practice and policy. . Glob. Implement. Res. Appl. 2:(2):107–19
     [Crossref] [Google Scholar]
  55. 55.
    Quanbeck A, Almirall D, Jacobson N, Brown RT, Landeck JK, et al. 2020.. The Balanced Opioid Initiative: protocol for a clustered, sequential, multiple-assignment randomized trial to construct an adaptive implementation strategy to improve guideline-concordant opioid prescribing in primary care. . Implement. Sci. 15::26
     [Crossref] [Google Scholar]
  56. 56.
    Rogal SS, Yakovchenko V, Morgan T, Bajaj JS, Gonzalez R, et al. 2020.. Getting to Implementation: a protocol for a Hybrid III stepped wedge cluster randomized evaluation of using data-driven implementation strategies to improve cirrhosis care for Veterans. . Implement. Sci. 15:(1):92
     [Crossref] [Google Scholar]
  57. 57.
    Smith JD, Merle JL, Webster KA, Cahue S, Penedo FJ, Garcia SF. 2022.. Tracking dynamic changes in implementation strategies over time within a hybrid type 2 trial of an electronic patient-reported oncology symptom and needs monitoring program. . Front. Health Serv. 2::983217
     [Crossref] [Google Scholar]
  58. 58.
    Smith SN, Almirall D, Choi SY, Koschmann E, Rusch A, et al. 2022.. Primary aim results of a clustered SMART for developing a school-level, adaptive implementation strategy to support CBT delivery at high schools in Michigan. . Implement. Sci. 17:(1):42
     [Crossref] [Google Scholar]
  59. 59.
    Smith SN, Almirall D, Prenovost K, Liebrecht C, Kyle J, et al. 2019.. Change in patient outcomes after augmenting a low-level implementation strategy in community practices that are slow to adopt a collaborative chronic care model: a cluster randomized implementation trial. . Med. Care 57:(7):503–11
     [Crossref] [Google Scholar]
  60. 60.
    Smith SN, Liebrecht CM, Bauer MS, Kilbourne AM. 2020.. Comparative effectiveness of external vs blended facilitation on collaborative care model implementation in slow-implementer community practices. . Health Serv. Res. 55:(6):954–65
     [Crossref] [Google Scholar]
  61. 61.
    U.S. Dep. Health Hum. Serv., Food Drug Adm. 2019.. Adaptive design clinical trials for drugs and biologics guidance for industry. Rep., Cent. Drug Eval. Res., Cent. Biol. Eval. Res. , Silver Spring, MD:. https://www.fda.gov/regulatory-information/search-fda-guidance-documents/adaptive-design-clinical-trials-drugs-and-biologics-guidance-industry
  62. 62.
    Waxmonsky J, Kilbourne AM, Goodrich DE, Nord KM, Lai Z, et al. 2014.. Enhanced fidelity to treatment for bipolar disorder: results from a randomized controlled implementation trial. . Psychiatr. Serv. 65:(1):81–90
     [Crossref] [Google Scholar]
/content/journals/10.1146/annurev-publhealth-060222-014438
Loading
Adaptive Designs in Implementation Science and Practice: Their Promise and the Need for Greater Understanding and Improved Communication
Annual Review of Public Health 45, 69 (2024); https://doi.org/10.1146/annurev-publhealth-060222-014438
/content/journals/10.1146/annurev-publhealth-060222-014438
/content/journals/10.1146/annurev-publhealth-060222-014438
Loading

Data & Media loading...

  • Article Type: Review Article

Most Cited Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error