Decisions related to a spectrum of nutrition-related public health and clinical concerns must consider many factors and are best informed by evaluating the totality and quality of the evidence. Systematic review (SR) is a structured process to evaluate, compare, and synthesize relevant evidence for the SR-specific question(s). Applications of SR are exemplified here through the discussion of four case studies: research agendas, nutrient reference intakes, dietary guidance, and practice guidelines. Concerns that SR cannot be effectively applied to nutrition evidence because of the lack of an unexposed comparator and the complex homeostasis in nutrition are discussed. Central to understanding the applicability of SR is its flexibility in defining key inclusion criteria and rigorous elements as appropriate for the SR-specific question(s). Through the reduction of bias and random error by explicit, reproducible, comprehensive, and rigorous examination of all of the evidence, SR informs the scientific judgment needed for sound evidence-based public health nutrition.


Article metrics loading...

Loading full text...

Full text loading...


Literature Cited

  1. Acad. Nutr. Dietetics 2012. Evidence Analysis Manual: Steps in the Academy Evidence Analysis Process. Chicago: Acad. Nutr. Dietetics http://andevidencelibrary.com/files/Docs/2012_Jan_EA_Manual.pdf
  2. Ades AE, Sutton AJ. 2.  2006. Multiparameter evidence synthesis in epidemiology and medical decision-making: current controversies. J. Royal Stat. Soc. 169:5–35 [Google Scholar]
  3. Am. Diabetic Assoc 2012. Introduction. Diabetes Care 35:Suppl. 1S1–2 [Google Scholar]
  4. 4. Am. Diabetic Assoc 2012. Standards of medical care in diabetes—2012. Diabetes Care 35Suppl. 1S11–63
  5. Balk EM, Horsley TA, Newberry SJ, Lichtenstein AH, Yetley EA. 5.  et al. 2007. A collaborative effort to apply the evidence-based review process to the field of nutrition: challenges, benefits, and lessons learned. Am. J. Clin. Nutr. 85:1448–56 [Google Scholar]
  6. Barza M, Trikalinos TA, Lau J. 6.  2009. Statistical considerations in meta-analysis. Infect. Dis. Clin. North Am. 23:195–210 [Google Scholar]
  7. Becker LA, van Binsbergen JJ. 7.  2005. How can a proposed Cochrane diet and nutrition field work effectively?. Eur. J. Clin. Nutr. 59:Suppl. 1S167–71 [Google Scholar]
  8. Blumberg J, Heaney RP, Huncharek M, Scholl T, Stampfer M. 8.  et al. 2010. Evidence-based criteria in the nutritional context. Nutr. Rev. 68:8478–84 [Google Scholar]
  9. Bonis P, Chun M, Tatsioni A, Sun Y, Kupelnick B. 9.  et al. 2005. Effects of omega-3 fatty acids on organ transplantation AHRQ Evid. Rep. Rockville, MD: Agency Healthc. Res. Qual. http://www.ncbi.nlm.nih.gov/books/NBK37665/
  10. Brito JP, Domecq JP, Murad MH, Guyatt GH, Montori VM. 10.  2013. The Endocrine Society guidelines: when the confidence cart goes before the evidence horse. J. Clin. Endocrinol. Metab. 98:3246–52 [Google Scholar]
  11. Brownson RC, Fielding JE, Maylahn CM. 11.  2009. Evidence-based public health: a fundamental concept for public health practice. Annu. Rev. Public Health 30:175–201 [Google Scholar]
  12. Chung M, Balk EM, Brendel M, Ip S, Lau J. 12.  et al. 2009. Vitamin D and calcium: a systematic review of health outcomes Evid. Rep./Technol. Assess. No. 183. Rockville, MD: Agency Healthc. Res. Qual. http://www.ncbi.nlm.nih.gov/books/NBK32603/
  13. Chung M, Balk EM, Ip S, Lee J, Terasawa T. 13.  et al. 2010. Systematic review to support the development of nutrient reference intake values: challenges and solutions. Am. J. Clin. Nutr. 92:273–76 [Google Scholar]
  14. Chung M, Balk EM, Ip S, Raman G, Yu WW. 14.  et al. 2009. Reporting of systematic reviews of micronutrients and health: a critical appraisal. Am. J. Clin. Nutr. 89:1099–113 [Google Scholar]
  15. Chung M, Balk EM, Ip S, Raman G, Yu WW. 15.  et al. 2009. Reporting of systematic reviews of micronutrients and health: a critical appraisal. Nutr. Res. Ser., Vol. 3. Rockville, MD: Agency Healthc. Res. Qual. http://www.ncbi.nlm.nih.gov/books/NBK45231/
  16. Cipriani A, Furukawa TA, Barbui C. 16.  2011. What is a Cochrane review?. Epidemiol. Psychiatr. Sci. 20:231–33 [Google Scholar]
  17. Cranney A, Horsley T, O'Donnell S, Weiler H, Puil L. 17.  et al. 2007. Effectiveness and safety of vitamin D in relation to bone health Evid. Rep./Technol. Assess. No. 158. Rockville, MD: Agency Healthc. Res. Qual. http://archive.ahrq.gov/downloads/pub/evidence/pdf/vitamind/vitad.pdf
  18. Croswell JM, Kramer BS. 18.  2009. Clinical trial design and evidence-based outcomes in the study of liver diseases. J. Hepatol. 50:817–26 [Google Scholar]
  19. De-Regil LM, Jefferds ME, Sylvetsky AC, Dowswell T. 19.  2011. Intermittent iron supplementation for improving nutrition and development in children under 12 years of age. Cochrane Database Syst. Rev. 12:CD009085 http://www.ncbi.nlm.nih.gov/pubmed/22161444 [Google Scholar]
  20. Dhonukshe-Rutten RA, Bouwman J, Brown KA, Cavelaars AE, Collings R. 20.  et al. 2013. EURRECA—evidence-based methodology for deriving micronutrient recommendations. Crit. Rev. Food Sci. Nutr. 53:999–1040 [Google Scholar]
  21. Dietary Guidel. Advis. Comm 2010. Report of the Dietary Guidelines Advisory Committee on the Dietary Guidelines for Americans, 2010. To the Secretary of Agriculture and the Secretary of Health and Human Services. Washington, DC: Agric. Res. Serv http://www.cnpp.usda.gov/Publications/DietaryGuidelines/2010/DGAC/Report/2010DGACReport-camera-ready-Jan11-11.pdf
  22. Eddy DM, Hasselblad V, Schachter R. 22.  1990. An introduction to a Bayesian method for meta-analysis: the Confidence Profile Method. Med. Decis. Making 10:15–23 [Google Scholar]
  23. Fox AM, Horowitz CR. 23.  2013. Best practices in policy approaches to obesity prevention. J. Health Care Poor Underserved 24:168–92 [Google Scholar]
  24. Fox DM. 24.  2011. Systematic reviews and health policy: the influence of a project on perinatal care since 1988. Milbank Q. 89:425–49 [Google Scholar]
  25. Higgins JPT, Green S. 25.  2011. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 London: Cochrane Collab http://www.handbook.cochrane.org/
  26. Hooper L, Smith GD, Ebrahim S. 26.  2006. Cochrane reviews on dietary advice for reducing intakes of fat and salt. Eur. J. Clin. Nutr. 60:926–28 [Google Scholar]
  27. Inst. Med 2002. Evolution of Evidence for Selected Nutrient and Disease Relationships. Washington, DC: Natl. Acad. Press
  28. Inst. Med 2011. Dietary Reference Intakes for Calcium and Vitamin D. Washington, DC: Natl. Acad. Press
  29. Inst. Med. Comm. Stand. Dev. Trustworthy Clin. Pract. Guidel 2011. Clinical Practice Guidelines We Can Trust. Washington, DC: Natl. Acad. Press
  30. Inst. Med. Comm. Stand. Syst. Rev. Comp. Eff. Res 2011. Finding What Works in Health Care: Standards for Systematic Reviews LL Eden J, A Berg, S Morton Washington, DC: Natl. Acad. Press
  31. Lichtenstein AH, Yetley EA, Lau J. 31.  2008. Application of systematic review methodology to the field of nutrition. J. Nutr. 138:2297–306 [Google Scholar]
  32. Lichtenstein AH, Yetley EA, Lau J. 32.  2009. Application of Systematic Review Methodology to the Field of Nutrition. Nutr. Res. Ser. 1 Rockville, MD: Agency Healthc. Res. Qual http://www.ncbi.nlm.nih.gov/pubmed/20734513
  33. MacLean CH, Issa AM, Newberry SJ, Mojica WA, Morton SC. 33.  et al. 2005. Effects of omega-3 fatty acids on cognitive function with aging, dementia, and neurological diseases Evid. Rep./Technol. Assess. No. 114 Rockville, MD: Agency Healthc. Res Qual. http://archive.ahrq.gov/downloads/pub/evidence/pdf/o3cogn/o3cogn.pdf
  34. MacLean CH, Mojica WA, Morton SC, Pencharz J, Hasenfeld Garland R. 34.  et al. 2004. Effects of omega-3 fatty acids on lipids and glycemic control in type II diabetes and the metabolic syndrome and on inflammatory bowel disease, rheumatoid arthritis, renal disease, systemic lupus erythematosus, and osteoporosis Evid. Rep./Technol. Assess. No. 89 Rockville, MD: Agency Healthc. Res Qual. http://archive.ahrq.gov/downloads/pub/evidence/pdf/o3lipid/o3lipid.pdf
  35. MacLean CH, Newberry SJ, Mojica WA, Issa A, Khanna P. 35.  et al. 2005. Effects of omega-3 fatty acids on cancer Evid. Rep./Technol. Assess. No. 113 Rockville, MD: Agency Healthc. Res. Qual. Evid http://www.ncbi.nlm.nih.gov/books/NBK37626/
  36. Maki KC, Slavin JL, Rains TM, Kris-Etherton PM. 36.  2014. Limitations of observational evidence: implications for evidence-based dietary recommendations. Adv. Nutr. 5:7–15 [Google Scholar]
  37. Mann JL. 37.  2010. Evidence-based nutrition: Does it differ from evidence-based medicine?. Ann. Med. 42:475–86 [Google Scholar]
  38. Moorthy D, Chung M, Lee L, Yu WW, Lau J, Trikalinos TA. 38.  2013. Concordance between the findings of epidemiological studies and randomized trials in nutrition: an empirical evaluation and citation analysis Nutr. Res. Ser., Vol. 6 Rockville, MD: Agency Healthc. Res . Qual http://www.ahrq.gov/research/findings/evidence-based-reports/nutrtp6.pdf
  39. Natl. Inst. Health, Natl. Heart Lung Blood Inst 2004. Working Group report on future clinical research directions on omega-3 fatty acids and cardiovascular disease. Bethesda, MD: NHLBI http://www.nhlbi.nih.gov/meetings/workshops/omega-3/omega-3-rpt.htm
  40. Noyes J, Gough D, Lewin S, Mayhew A, Michie S. 40.  et al. 2013. A research and development agenda for systematic reviews that ask complex questions about complex interventions. J. Clin. Epidemiol. 66:1262–70 [Google Scholar]
  41. Panagiotou OA, Ioannidis JP. 41.  2012. Primary study authors of significant studies are more likely to believe that a strong association exists in a heterogeneous meta-analysis compared with methodologists. J. Clin. Epidemiol. 65:740–47 [Google Scholar]
  42. Petticrew M, Rehfuess E, Noyes J, Higgins JP, Mayhew A. 42.  et al. 2013. Synthesizing evidence on complex interventions: how meta-analytical, qualitative, and mixed-method approaches can contribute. J. Clin. Epidemiol. 66:1230–43 [Google Scholar]
  43. Reeves BC, van Binsbergen J, van Weel C. 43.  2005. Systematic reviews incorporating evidence from nonrandomized study designs: reasons for caution when estimating health effects. Eur. J. Clin. Nutr. 59:Suppl. 1S155–61 [Google Scholar]
  44. Ridley M. 44.  2012. Three cheers for scientific backbiting. Wall Street Journal(US ed.) July 28:C4 [Google Scholar]
  45. Rizos EC, Ntzani EE, Bika E, Kostapanos MS, Elisaf MS. 45.  2012. Association between omega-3 fatty acid supplementation and risk of major cardiovascular disease events: a systematic review and meta-analysis. JAMA 308:1024–33 [Google Scholar]
  46. Russell R, Chung M, Balk EM, Atkinson S, Giovannucci EL. 46.  et al. 2009. Opportunities and challenges in conducting systematic reviews to support the development of nutrient reference values: vitamin A as an example. Am. J. Clin. Nutr. 89:728–33 [Google Scholar]
  47. Russell R, Chung M, Balk EM, Atkinson S, Giovannucci EL. 47.  et al. 2009. Issues and challenges in conducting systematic reviews to support development of nutrient reference values: workshop summary. Nutr. Res. Ser. 2 Rockville, MD: Agency Healthc. Res. Qual http://www.ncbi.nlm.nih.gov/books/NBK44081/
  48. Samson D, Schoelles KM. 48.  2012. Chapter 2: medical tests guidance (2) developing the topic and structuring systematic reviews of medical tests: utility of PICOTS, analytic frameworks, decision trees, and other frameworks. J. Gen. Intern. Med. 27:Suppl. 1S11–19 [Google Scholar]
  49. Schachter H, Reisman J, Tran K, Dales B, Kourad K. 49.  et al. 2004. Health effects of omega-3 fatty acids on asthma Evid. Rep./Technol. Assess. No. 91 Rockville, MD: Agency Healthc. Res. Qual. http://archive.ahrq.gov/downloads/pub/evidence/pdf/o3asthma/o3asthma.pdf
  50. Schachter HM, Kourad K, Merali Z, Lumb A, Tran K, Miguelez M. 50.  2005. Effects of omega-3 fatty acids on mental health Evid. Rep./Technol. Assess. No. 116 Rockville, MD: Agency Healthc. Res. Qual http://archive.ahrq.gov/downloads/pub/evidence/pdf/o3mental/o3mental.pdf
  51. Shao A, Mackay D. 51.  2010. A commentary on the nutrient-chronic disease relationship and the new paradigm of evidence-based nutrition. Nat. Med. J. 2:10–18 [Google Scholar]
  52. Spahn JM, Lyon JM, Altman JM, Blum-Kemelor DM, Essery EV. 52.  et al. 2011. The systematic review methodology used to support the 2010 Dietary Guidelines Advisory Committee. J. Am. Diet. Assoc. 111:520–23 [Google Scholar]
  53. Sutton AJ, Higgins JPT. 53.  2008. Recent developments in meta-analysis. Statist. Med. 27:625–50 [Google Scholar]
  54. Tovey D. 54.  2014. The role of the Cochrane Collaboration in support of the WHO Nutrition Guidelines. Adv. Nutr. 5:35–39 [Google Scholar]
  55. Trikalinos TA, Lee J, Moorthy D, Yu WW, Lau J. 55.  et al. 2012. Effects of eicosapentanoic acid and docosahexanoic acid on mortality across diverse settings: systematic review and meta-analysis of randomized trials and prospective cohorts. Nutr. Res. Ser. 4 Rockville, MD: Agency Healthc. Res. Qual http://www.ncbi.nlm.nih.gov/pubmed/22479722
  56. Trikalinos TA, Moorthy D, Chung M, Yu WW, Lee J. 56.  et al. 2011. Comparison of translational patterns in two nutrient-disease associations. Nutr. Res. Ser. 5 Rockville, MD: Agency Healthc. Res. Qual http://www.ncbi.nlm.nih.gov/books/NBK82526/
  57. Vandorsten JP, Dodson WC, Espeland MA, Grobman WA, Guise JM. 57.  et al. 2013. National Institutes of Health consensus conference statement: diagnosing gestational diabetes mellitus. NIH Consens. State Sci. Statements 2911–30
  58. Wald NJ, Morris JK. 58.  2003. Teleo-analysis: combining data from different types of study. BMJ 327:616–18 [Google Scholar]
  59. Wang C, Chung M, Lichtenstein A, Balk E, Kupelnick B. 59.  et al. 2004. Effects of omega-3 fatty acids on cardiovascular disease Evid. Rep./Technol. Assess. No. 94 Rockville, MD: Agency Healthc. Res. Qual http://www.ncbi.nlm.nih.gov/books/NBK37223/
  60. Wang C, Harris WS, Chung M, Lichtenstein AH, Balk EM. 60.  et al. 2006. n-3 Fatty acids from fish or fish-oil supplements, but not alpha-linolenic acid, benefit cardiovascular disease outcomes in primary- and secondary-prevention studies: a systematic review. Am. J. Clin. Nutr. 84:5–17 [Google Scholar]
  61. Weidemann P, Schütz H, Spangenberg A, Krug HF. 61.  2011. Evidence maps: communicating risk assessments in societal controversies: the case of engineered nanoparticles. Risk Anal. 31:1770–83 [Google Scholar]
  62. World Health Organ 2012. WHO Handbook for Guideline Development Geneva, Switz.: World Health Organ.
  63. World Health Organ 2011. Guideline: Intermittent Iron Supplementation in Preschool and School-Age Children Geneva, Switz: World Health Organ www.who.int/nutrition/publications/micronutrients/guidelines/guideline_iron_supplementation_children/en/index.html
  64. Yetley EA, Brule D, Cheney MC, Davis CD, Esslinger KA. 64.  et al. 2009. Dietary reference intakes for vitamin D: justification for a review of the 1997 values. Am. J. Clin. Nutr. 89:719–27 [Google Scholar]

Data & Media loading...

  • Article Type: Review Article
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error