1932

Abstract

Complexity—resulting from interactions among many component parts—is a property of both the intervention and the context (or system) into which it is placed. Complexity increases the unpredictability of effects. Complexity invites new approaches to logic modeling, definitions of integrity and means of standardization, and evaluation. New metaphors and terminology are needed to capture the recognition that knowledge generation comes from the hands of practitioners/implementers as much as it comes from those usually playing the role of intervention researcher. Failure to acknowledge this may blind us to the very mechanisms we seek to understand. Researchers in clinical settings are documenting health improvement gains made as a consequence of complex systems thinking. Improvement science in clinical settings has much to offer researchers in population health.

Loading

Article metrics loading...

/content/journals/10.1146/annurev-publhealth-031912-114421
2015-03-18
2024-04-23
Loading full text...

Full text loading...

/deliver/fulltext/publhealth/36/1/annurev-publhealth-031912-114421.html?itemId=/content/journals/10.1146/annurev-publhealth-031912-114421&mimeType=html&fmt=ahah

Literature Cited

  1. Abraham C, Michie S. 1.  2008. A taxonomy of behavior change techniques used in interventions. Health Psychol. 27:379–87 [Google Scholar]
  2. Adamic L. 2.  2011. Complex systems: unzipping Zipf's law. Nature 474:7350164–65 [Google Scholar]
  3. Albrecht L, Archibald M, Arseneau D, Scott SD. 3.  2013. Development of a checklist to assess the quality of porting of knowledge translation interventions using the Work Group for Intervention Development and Evaluation Research (WIDER) recommendations. Implement. Sci. 8:52 [Google Scholar]
  4. Anderson LM, Petticrew M, Rehfuess E, Armstrong R, Ueffing E. 4.  et al. 2011. Using logic models to capture complexity in systematic reviews. Res. Synth. Methods 2:33–42 [Google Scholar]
  5. Anderson R. 5.  2008. New MRC guidelines on evaluating complex interventions. BMJ 337:a1937 [Google Scholar]
  6. Arai L, Roen K, Roberts H, Popay J. 6.  2005. It might work in Oklahoma but will it work in Oakhampton? Context and implementation in the effectiveness literature on domestic smoke detectors. Inj. Prev. 11:148–51 [Google Scholar]
  7. Ashley SR. 7.  2009. Innovation diffusion: implications for evaluation. New Dir. Eval. 124:35–45 [Google Scholar]
  8. Axelrod R, Cohen MD. 8.  2000. Harnessing Complexity New York: Basic Books
  9. Barnes M, Matka E, Sullivan H. 9.  2003. Evidence, understanding and complexity: evaluation in non-linear systems. Evaluation 9:265–84 [Google Scholar]
  10. Batalden P, Bate P, Webb D, McLoughlin V. 10.  2011. Planning and leading a multidisciplinary colloquium to explore the epistemology of improvement. BMJ Qual. Saf. 20:Suppl. 1i1–4 [Google Scholar]
  11. Bartholomew LK, Parcel GS, Kok G. 11.  1998. Intervention mapping: a process for developing theory- and evidence-based health education programs. Health Educ. Behav. 25:545–63 [Google Scholar]
  12. Bauman LJ, Stein REK, Ireys HT. 12.  1991. Reinventing fidelity: the transfer of social technology among settings. Am. J. Community Psychol. 19:619–39 [Google Scholar]
  13. Berkman LF, Breslow L. 13.  1983. Health and Ways of Living: The Alameda County Study New York: Oxford Univ. Press
  14. Birkeland S, Murphy-Graham E, Weiss CH. 14.  2005. Good reasons for ignoring good evaluation: the case of the drug abuse resistance education (DARE) program. Eval. Progr. Plan. 28:3247–56 [Google Scholar]
  15. Bisset S, Potvin L, Daniel M. 15.  2013. The adaptive nature of implementation practice: case study of a school based nutrition education intervention. Eval. Progr. Plan. 39:10–18 [Google Scholar]
  16. Blake SC, Ottoson JM. 16.  2009. Knowledge utilization: implications for evaluation. New Dir. Eval. 124:21–34 [Google Scholar]
  17. Bonell C, Fletcher A, Jamal F, Wells H, Harden A. 17.  et al. 2013. Theories of how the school environment impacts on student health: systematic review and synthesis. Health Place 24:242–49 [Google Scholar]
  18. Bonell C, Fletcher A, Morton M, Lorenc T, Moore L. 18.  2012. Realist randomised controlled trials: a new approach to evaluating complex public health interventions. Soc. Sci. Med. 75:2299–306 [Google Scholar]
  19. Bonell C, Fletcher A, Morton M, Lorenc T, Moore L. 19.  2013. Methods don't make assumptions, people do: a response to Marchal et al.. Soc. Sci. Med. 94:81–82 [Google Scholar]
  20. Bourdieu P. 20.  1991. The peculiar history of scientific reason. Sociol. Forum 6:3–25 [Google Scholar]
  21. Burton C. 21.  2012. Heavy tailed distributions of effect sizes in systematic reviews of complex interventions. PLOS ONE 7:3e34222 [Google Scholar]
  22. Byng R, Norman I, Redfern S, Jones R. 22.  2008. Exposing the key functions of a complex intervention for shared care in mental health: a case study of a process evaluation. BMC Health Serv. Res. 8:274 [Google Scholar]
  23. Callon M. 23.  1986. Some elements of a sociology of translation: domestication of the scallops and fishermen of St. Brieuc Bay. Power, Action and Belief: A New Sociology of Knowledge J Law 196–233 London: Routledge [Google Scholar]
  24. Campbell C, Nair Y, Maimane S. 24.  2007. Building contexts that support effective community responses to HIV/AIDS: a South African case study. Am. J. Community Psychol. 39:347–63 [Google Scholar]
  25. Chalabi Z, Lorenc T. 25.  2013. Reducing agent-based models to inform evaluation of complex interventions. Examples from the built environment. Prev. Med. 57:434–35 [Google Scholar]
  26. Christens BD, Hanlin CE, Speer PW. 26.  2007. Getting the social organism thinking: strategy for systems change. Am. J. Community Psychol. 39:229–38 [Google Scholar]
  27. 27. CIHR (Can. Inst. Health Res.) IRSC (Inst. Popul. Public Health) 2010. Stimulating Methodological and Theoretical Innovation in Population Health Intervention Research. Workshop Summary Report Toronto: CIHR. http://www.cihr-irsc.gc.ca/e/documents/ipph_workshop_sum_report_2010_e.pdf
  28. 28. COMMIT Res. Group 1995. Community intervention trial for smoking cessation (COMMIT): I. Cohort results from a four-year community intervention. Am. J. Public Health 85:183–92 [Google Scholar]
  29. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. 29.  2008. Developing and evaluating complex interventions: the new Medical Research Council Guidance. BMJ 337:979–83 [Google Scholar]
  30. Cronbach LJ. 30.  1982. Toward Reform of Program Evaluation San Francisco: Jossey-Bass
  31. Datta J, Petticrew M. 31.  2013. Challenges to evaluating complex interventions: a content analysis of published papers. BMC Public Health 13:568 [Google Scholar]
  32. Davies R. 32.  2004. Scale, complexity and the representation of theories of change. Part 1. Evaluation 10:101–21 [Google Scholar]
  33. Davies R. 33.  2005. Scale, complexity and the representation of theories of change. Part 2. Evaluation 11:133–39 [Google Scholar]
  34. Davison CM. 34.  2009. Knowledge translation: implications for evaluation. New Dir. Eval. 124:75–87 [Google Scholar]
  35. Dawber TR. 35.  1980. The Framingham Study Cambridge, MA: Harvard Univ. Press
  36. DeGroff A, Cargo M. 36.  2009. Policy implementation implications for evaluation. New Dir. Eval. 124:47–60 [Google Scholar]
  37. 37. Dep. Clin. Epidemiol. Biostat., McMaster Univ 1981. How to read the clinical journals: IV. To determine the etiology or causation. Can. Med. Assoc. J. 124:985–90 [Google Scholar]
  38. Dignan MB, Carr PA. 38.  1987. Program Planning for Health Education and Health Promotion Philadelphia: Lea & Febiger
  39. Di Ruggerio E, Rose A, Gaudreau K. 39.  2009. Canadian Institutes of Health Research support for population health intervention research in Canada. Can. J. Public Health 100:i15–19 [Google Scholar]
  40. Douthwaite B, Delve R, Ekboir J, Twomlow S. 40.  2003. Contending with complexity: the role of evaluation in implementing sustainable natural resource management. Int. J. Agric. Sustain. 1:51–66 [Google Scholar]
  41. Egolf B, Lasker J, Wolf S, Potvin L. 41.  1992. The Roseto effect: a 50 year comparison of mortality rates. Am. J. Public Health 82:1089–92 [Google Scholar]
  42. Fisher EB. 42.  1995. Editorial: the results of the COMMIT trial. Am. J. Public Health 85:159–60 [Google Scholar]
  43. Flay BR. 43.  1986. Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. Prev. Med. 15:451–74 [Google Scholar]
  44. Ford JK. 44.  2007. Building capability throughout change effort: leading the transformation of a police agency to community policing. Am. J. Community Psychol. 39:321–34 [Google Scholar]
  45. Foster-Fishman PG, Behrens TR. 45.  2007. Systems change reborn: rethinking our theories, methods and efforts in human services reform and community based change. Am. J. Community Psychol. 39:191–96 [Google Scholar]
  46. Foster-Fishman PG, Nowell B, Yang H. 46.  2007. Putting the system back into systems change: a framework for understanding and changing organisational and community systems. Am. J. Community Psychol. 39:197–215 [Google Scholar]
  47. Fullan M. 47.  1993. Change Forces: Probing the Depths of Educational Reform London: Farmer Press
  48. Fuller S. 48.  1997. Obituary; Thomas S. Kuhn 18 July 1922–17 June 1996. Confessions of a recovering Kuhnian. Soc. Stud. Sci. 27:492–94 [Google Scholar]
  49. Funnell SC, Rogers PJ. 49.  2011. Purposeful Program Theory. Effective Use of Theories of Change and Logic Models San Francisco: Jossey-Bass/Wiley
  50. Gal I, Prigat A. 50.  2005. Why organizations continue to create patient information leaflets with readability and usability problems: an exploratory study. Health Educ. Res. 20:485–93 [Google Scholar]
  51. Glasgow RE, Vogt TM, Boles SM. 51.  1999. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am. J. Public Health 89:1322–27 [Google Scholar]
  52. Goodman RM, Speers MA, McLeroy K, Fawcett S, Kegler M. 52.  et al. 1998. Identifying and defining the dimensions of community capacity to provide a basis for measurement. Health Educ. Behav. 25:258–78 [Google Scholar]
  53. Green LW. 53.  2001. From research to “best practices” in other settings and populations. Am. J. Health Behav. 25:3165–78 [Google Scholar]
  54. Green LW. 54.  2006. Public health asks of systems science: To advance our evidence-based practice, can you help us get more practice-based evidence?. Am. J. Public Health 96:406–9 [Google Scholar]
  55. Green LW, Glasgow RE. 55.  2007. A focus on external validity. Eval. Health Prof. 30:115–17 [Google Scholar]
  56. Green LW, Kreuter MW, Deeds SG, Partridge KB. 56.  1980. Health Education Planning: A Diagnostic Approach. Palo Alto, CA: Mayfield
  57. Green LW, Wilson AL, Lovato CY. 57.  1986. What changes can health promotion achieve and how long do these changes last? The trade-offs between expediency and durability. Prev. Med. 15:508–21 [Google Scholar]
  58. Greenhalgh T, Hinder S, Stamer K, Bratan T, Russell J. 58.  2010. Adoption, non-adoption, and abandonment of a personal electronic health record: case study of HealthSpace. BMJ 341:c5814 [Google Scholar]
  59. Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O. 59.  2004. Diffusion of innovation in service organization: systematic review and recommendations. Milbank Q. 82:581–629 [Google Scholar]
  60. Greenhalgh T, Russell J, Ashcroft RE, Parsons W. 60.  2011. Why national eHealth programs need dead philosophers: Wittgensteinian reflections on policymakers' reluctance to learn from history. Millbank Q. 89:533–63 [Google Scholar]
  61. Greenhalgh T, Stones R. 61.  2010. Theorising big IT programs in health care: strong structuration theory meets actor network theory. Soc. Sci. Med. 70:1285–94 [Google Scholar]
  62. Haines V, Godley J, Hawe P. 62.  2011. Understanding interdisciplinary collaborations as social networks. Am. J. Community Psychol. 47:11–11 [Google Scholar]
  63. Hancock L, Sanson-Fisher R, Perkins J, Girgis A, Howley P, Schofield M. 63.  2001. The effect of a community action intervention on adolescent smoking rates in rule Australian towns: the CART project. Prev. Med. 32:332–40 [Google Scholar]
  64. Hawe P. 64.  1994. Capturing the meaning of ‘community’ in community intervention evaluation: some contributions from community psychology. Health Promot. Int. 9:199–210 [Google Scholar]
  65. Hawe P, Bond L, Butler H. 65.  2009. Knowledge theories can inform evaluation practice. What can a complexity lens add?. New Dir. Eval. 124:89–100 [Google Scholar]
  66. Hawe P, Riley T. 66.  2005. Ecological theory in practice: illustrations from a community-based intervention to promote the health of recent mothers. Prev. Sci. 6:227–36 [Google Scholar]
  67. Hawe P, Shiell A, Riley T. 67.  2004. Complex interventions: how far ‘out of control’ should a randomised controlled trial be?. BMJ 328:1561–63 [Google Scholar]
  68. Hawe P, Shiell A, Riley T. 68.  2009. Theorising interventions as events in systems. Am. J. Community Psychol. 43:267–76 [Google Scholar]
  69. Homer J, Milstein B. 69.  2004. Optimal decision-making in dynamic model of community health. Proc. 37th Annu. Hawaii Int. Conf. Syst. Sci., Waikoloa, Hawaii. http://www.computer.org/csdl/proceedings/hicss/2004/2056/03/205630085a.pdf
  70. Iversen DC. 70.  1986. Forum: the health promotion sciences and chronic disease prevention. The scientific base of health promotion. Prev. Med. 15:439–41 [Google Scholar]
  71. Jan S, Ferrari G, Watts C, Hargreaves J, Kim J. 71.  et al. 2011. Economic evaluation of a combined micro-finance and gender training intervention for the prevention of intimate partner violence rural South Africa. Health Policy Plan. 26:366–72 [Google Scholar]
  72. Khoury MJ, Gwinn M, Ioannidis JPA. 72.  2010. The emergence of translational epidemiology: from scientific discovery to population health impact. Am. J. Epidemiol. 172:517–24 [Google Scholar]
  73. Lalonde M. 73.  1974. A New Perspective on the Health of Canadians: A Working Document Ottawa: Health & Welf.
  74. Lanham HJ, Leykum LK, Taylor BS, McCannon JC, Lindberg C, Lester RT. 74.  2013. How complexity science can inform scale up and spread in health care: understanding the role of self organisation variation across local context. Soc. Sci. Med. 93:194–202 [Google Scholar]
  75. Leventhal H, Safer MA, Cleary PD, Gutmann M. 75.  1980. Cardiovascular risk reduction for lifestyle change: comments on the Stanford study. J. Consult. Clin. Psychol. 48:150–58 [Google Scholar]
  76. Leykum LK, Pugh J, Lawrence V, Parchman M, Noel PH. 76.  et al. 2007. Organizational interventions employing principles of complexity science have improved outcomes for patients with Type II diabetes. Implement. Sci. 2:28 [Google Scholar]
  77. Lindberg C, Clancy TR. 77.  2010. Managing organisational complexity. Positive deviance: an elegant solution to a complex problem. J. Nurs. Adm. 40:150–53 [Google Scholar]
  78. Ling T. 78.  2012. Evaluating complex and unfolding interventions in real time. Evaluation 18:79–91 [Google Scholar]
  79. Lynch JJ. 79.  1977. The Broken Heart. The Medical Consequences of Loneliness New York: Basic Books
  80. Macintyre S. 80.  2010. Good intentions and received wisdom are not good enough: the need for controlled trials in public health. J. Epidemiol. Community Health 65:564–67 [Google Scholar]
  81. Marchal B, Westhorp G, Wong G, Van Belle S, Greenhalgh T. 81.  et al. 2013. Realist RCTs of complex interventions: an oxymoron. Soc. Sci. Med. 94:124–28 [Google Scholar]
  82. May C. 82.  2006. A rational model for assessing and evaluating complex interventions in health care. BMC Health Serv. Res. 6:86 [Google Scholar]
  83. May C. 83.  2013. Agency and implementation: understanding the embedding of healthcare innovations in practice. Soc. Sci. Med. 78:26–33 [Google Scholar]
  84. May C. 84.  2013. Towards a general theory of implementation. Implement. Sci. 8:18 [Google Scholar]
  85. May C, Murray E, Finch T, Mair F, Treweek S. 85.  et al. 2010. Normalization process theory on-line users' manual and toolkit Access. Sept. 1, 2014. http://www.normalizationprocess.org
  86. McLeroy K. 86.  2006. Thinking of systems. Am. J. Public Health 96:3402 [Google Scholar]
  87. Miller RL, Shinn M. 87.  2005. Learning from communities: overcoming difficulties in dissemination of prevention and promotion efforts. Am. J. Community Psychol. 35:3/4169–83 [Google Scholar]
  88. Mold M, Berridge V. 88.  2013. The history of health promotion. Health Promotion Theory L Cragg, M Davies, W Macdowall 3–19 Berkshire, UK: Oxford Univ. Press, 2nd ed.. [Google Scholar]
  89. Moore G, Audrey A, Barker M, Bond L, Bonell C. 89.  et al. 2014. Process evaluation in complex public health intervention studies: the need for guidance. J. Epidemiol. Community Health 68:101–2 [Google Scholar]
  90. Mrazek PJ, Haggerty RJ. 90.  1994. Reducing Risks For Mental Disorders: Frontiers For Preventive Intervention Research Washington, DC: Natl. Acad. Press
  91. 91. MRC (Med. Res. Counc.) 2000. A Framework for the Development and Evaluation of RCTs for Complex Interventions to Improve Health London: MRC
  92. Nelson EC, Batalden PB, Godfrey MM, Lazar JS. 92.  2011. Value by Design: Developing Clinical Microsystems to Achieve Organizational Excellence San Francisco: Jossey-Bass
  93. Nutbeam D, Bauman A. 93.  2006. Evaluation in a Nutshell: A Practical Guide to the Evaluation of Health Promotion Programs. Sydney: McGraw-Hill
  94. Oliver ML. 94.  2009. The transfer process: implications for evaluation. New Dir. Eval. 124:61–73 [Google Scholar]
  95. Osenga K. 95.  2013. The Internet is not a super highway: using metaphors to communicate information and communications policy. J. Inf. Policy 3:30–54 [Google Scholar]
  96. Ottoson JM. 96.  2009. Knowledge for action theories in evaluation: knowledge utilization, diffusion, implementation, transfer, and translation. New Dir. Eval. 124:7–20 [Google Scholar]
  97. Ottoson JM, Green LW. 97.  1987. Reconciling concept and context: theory of implementation. Adv. Health Educ. Promot. 2:353–82 [Google Scholar]
  98. Ottoson JM, Hawe P. 98.  2009. Editors' notes. Knowledge utilization, diffusion, implementation, transfer, and translation: implications for evaluation. New Dir. Eval. 124:1–108 [Google Scholar]
  99. Øvretveit J, Leviton L, Parry G. 99.  2011. Increasing the generalisability of improvement research with an improvement replication program. BMJ Qual. Saf. 20:Suppl. 1i87–91 [Google Scholar]
  100. Paina L, Peters DH. 100.  2011. Understanding pathways for scaling up health services through the lens of complex adaptive systems. Health Policy Plan. 1:1–9 [Google Scholar]
  101. Patton GC, Bond L, Carlin JB, Thomas L, Butler H. 101.  et al. 2006. Promoting social inclusion in schools: a group randomized trial of effects on student risk behaviors. Am. J. Public Health 96:1582–88 [Google Scholar]
  102. Patton MQ. 102.  1994. Developmental evaluation. Am. J. Eval. 15:311–19 [Google Scholar]
  103. Pawson R. 103.  2006. Simple principles for the evaluation of complex programs. Public Health Evidence: Tackling Health Inequalities A Killoran, C Swann, M Kelly 223–38 New York: Oxford Univ. Press [Google Scholar]
  104. Pawson R. 104.  2013. The Science of Evaluation: A Realist Manifesto. New York: Sage
  105. Peterson AV Jr, Kealey KA, Mann SL, Marek PM, Sarason IG. 105.  2000. Hutchinson Smoking Prevention Project: long-term randomized trial in school-based tobacco use prevention—results on smoking. J. Natl. Cancer Inst. 92:1979–91 [Google Scholar]
  106. Petticrew M. 106.  2011. When are complex interventions complex? When are simple interventions simple?. Eur. J. Public Health 21:397–99 [Google Scholar]
  107. Pluye P, Potvin L, Denis J-L. 107.  2004. Making public health programs last: conceptualizing sustainability. Eval. Progr. Plan. 27:121–33 [Google Scholar]
  108. Pluye P, Potvin L, Denis J-L, Pelletier J, Mannoni C. 108.  2005. Program sustainability begins with the first events. Eval. Progr. Plan. 28:123–37 [Google Scholar]
  109. Pronyk PM, Hargreaves JR, Kim JC, Morison LA, Phetla G. 109.  et al. 2006. Effect of a structural intervention for the prevention of intimate-partner violence and HIV in rural South Africa: a cluster randomised trial. Lancet 368:1973–83 [Google Scholar]
  110. Rickles D, Shiell A, Hawe P. 110.  2007. A simple guide to chaos and complexity. J. Epidemiol. Community Health 61:933–37 [Google Scholar]
  111. Riley T, Hawe P. 111.  2005. Researching practice: the methodological case for narrative inquiry. Health Educ. Res. 20:226–36 [Google Scholar]
  112. Riley T, Hawe P. 112.  2009. A typology of practice narratives within a preventive, community intervention trial. Implement. Sci. 4:80 [Google Scholar]
  113. Riley T, Hawe P, Shiell A. 113.  2005. Contested ground: How should qualitative evidence inform the conduct of a community intervention trial?. J. Health Serv. Res. Policy 10:103–10 [Google Scholar]
  114. Rogers PJ. 114.  2000. Causal models in program theory evaluation. New Dir. Eval. 87:47–55 [Google Scholar]
  115. Rogers PJ. 115.  2008. Using programme theory to evaluate complicated and complex aspects of interventions. Evaluation 14:29–48 [Google Scholar]
  116. Rosenstock IM. 116.  1974. The historical origins of the health belief model. Health Educ. Monogr. 2:328 [Google Scholar]
  117. Sanson-Fisher RW, D'Este CA, Carey ML, Noble N, Paul CL. 117.  2014. Evaluation of systems oriented public health interventions: alternative research designs. Annu. Rev. Public Health 35:9–27 [Google Scholar]
  118. Sfard A. 118.  1998. On two metaphors for learning and the danger of choosing just one. Educ. Res. 27:4–13 [Google Scholar]
  119. Shiell A, Hawe P. 119.  1996. Health promotion, community development and the tyranny of individualism. Health Econ. 5:241–47 [Google Scholar]
  120. Shiell A, Hawe P, Gold L. 120.  2008. Complex interventions or complex systems? Implications for health economic evaluation. BMJ 336:1281–83 [Google Scholar]
  121. Shiell A, Hawe P, Riley T, Gold L. 121.  2005. Ecological evaluation of complex community interventions: theory, method and controversy. Proc. 18th World Conf. Int. Union Health Promot. Educ. April 2004, Melbourne, Aust.
  122. Stame N. 122.  2004. Theory-based evaluation and types of complexity. Evaluation 10:58–76 [Google Scholar]
  123. Suarez-Balcazar Y, Redmond L, Kouba J, Hellwig M, Davis R. 123.  et al. 2007. Introducing systems change in the schools: the case of school luncheons and vending machines. Am. J. Community Psychol. 39:335–45 [Google Scholar]
  124. Susser M. 124.  1995. The tribulations of trials. Am. J. Public Health 85:156–58 [Google Scholar]
  125. Syme SL. 125.  1986. Strategies for health promotion. Prev. Med. 15:492–507 [Google Scholar]
  126. Thompson B, Coronado G, Snipes SA, Pueschel K. 126.  2003. Methodological advances and ongoing challenges in the design of community-based health promotion programs. Annu. Rev. Public Health 24:315–40 [Google Scholar]
  127. Trickett EJ. 127.  1984. Towards a distinctive community psychology: an ecological metaphor for the conduct of community research and training. Am. J. Community Psychol. 12:261–79 [Google Scholar]
  128. Trickett EJ, Beehler S, Deutsch C, Green LW, Hawe P. 128.  et al. 2011. Advancing the science of community level interventions. Am. J. Public Health 101:1410–19 [Google Scholar]
  129. Trickett EJ, Ryerson Espino S, Hawe P. 129.  2011. How are community interventions conceptualized and conducted? An analysis of published accounts. J. Community Psychol. 39:5576–91 [Google Scholar]
  130. Trickett EJ, Watts RJ, Birman D. 130.  1994. Human Diversity: Perspectives on People in Context San Francisco: Jossey-Bass
  131. 131. U.S. Dep. Health, Educ. Welf 1979. Healthy People: The Surgeon General's Report on Health Promotion and Disease Prevention. Washington, DC: U.S. GPO
  132. Wandersman A. 132.  2003. Community science: bridging the gap between science and practice with community centered models. Am. J. Community Psychol. 31:227–42 [Google Scholar]
/content/journals/10.1146/annurev-publhealth-031912-114421
Loading
  • Article Type: Review Article
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error