1932

Abstract

In this review, we discuss the science of model validation as it applies to physiological modeling. There is widespread disagreement and ambiguity about what constitutes model validity. In areas in which models affect real-world decision-making, including within the clinic, in regulatory science, or in the design and engineering of novel therapeutics, this question is of critical importance. Without an answer, it impairs the usefulness of models and casts a shadow over model credibility in all domains. To address this question, we examine the use of nonmathematical models in physiological research, in medical practice, and in engineering to see how models in other domains are used and accepted. We reflect on historic physiological models and how they have been presented to the scientific community. Finally, we look at various validation frameworks that have been proposed as potential solutions during the past decade.

Loading

Article metrics loading...

/content/journals/10.1146/annurev-bioeng-082219-051740
2020-06-04
2024-03-28
Loading full text...

Full text loading...

/deliver/fulltext/bioeng/22/1/annurev-bioeng-082219-051740.html?itemId=/content/journals/10.1146/annurev-bioeng-082219-051740&mimeType=html&fmt=ahah

Literature Cited

  1. 1. 
    Van Noorden R. 2017. The science that's never been cited. Nature 552:162–64
    [Google Scholar]
  2. 2. 
    Jebeile J, Barberousse A. 2016. Empirical agreement in model validation. Stud. Hist. Philos. Sci. A 56:168–74
    [Google Scholar]
  3. 3. 
    Ericsson AC, Crim MJ, Franklin CL 2013. A brief history of animal modeling. Mo. Med. 110:201–5
    [Google Scholar]
  4. 4. 
    Kaizer JS, Heller AK, Oberkampf WL 2015. Scientific computer simulation review. Reliab. Eng. Syst. Saf. 138:210–18
    [Google Scholar]
  5. 5. 
    Batzel J, Bachar M, Karemaker JM, Kappel F 2012. Merging mathematical and physiological knowledge: dimensions and challenges. Mathematical Modeling and Validation in Physiology: Applications to the Cardiovascular and Respiratory Systems J Batzel, M Baschar, F Kappel 3–20 Berlin: Springer-Verlag
    [Google Scholar]
  6. 6. 
    Schultz SG. 2002. William Harvey and the circulation of the blood: the birth of a scientific revolution and modern physiology. News Physiol. Sci. 17:175–80
    [Google Scholar]
  7. 7. 
    Rosenblueth A, Wiener N. 1945. The role of models in science. Philos. Sci. 12:316–21
    [Google Scholar]
  8. 8. 
    Valverde I, Gomez-Ciriza G, Hussain T, Suarez-Mejias C, Velasco-Forte MN et al. 2017. Three-dimensional printed models for surgical planning of complex congenital heart defects: an international multicentre study. Eur. J. Cardiothorac. Surg. 52:1139–48
    [Google Scholar]
  9. 9. 
    Hoashi T, Ichikawa H, Nakata T, Shimada M, Ozawa H et al. 2018. Utility of a super-flexible three-dimensional printed heart model in congenital heart surgery. Interact. Cardiovasc. Thorac. Surg. 27:749–55
    [Google Scholar]
  10. 10. 
    Fatheree BH. 2004. The First 75 Years: History of Hydraulics Engineering at the Waterways Experiment Station Vicksburg, MS: US Army Corps Eng., Eng. Res. Dev. Cent.
  11. 11. 
    Am. Inst. Aeronaut. Astronaut 2002. Guide for the Verification and Validation of Computational Fluid Dynamics Simulations (AIAA G-077–1998(2002)) Am. Inst. Aeronaut. Astronaut.
    [Google Scholar]
  12. 12. 
    US Dept. Def 2018. Department of Defense Instruction: Number 5000.61 Washington, DC: Dept. Def.
  13. 13. 
    Breitling R. 2010. What is systems biology. Front. Physiol. 1:159
    [Google Scholar]
  14. 14. 
    Noble D. 2011. The aims of systems biology: between molecules and organisms. Pharmacopsychiatry 44:Suppl. 1S9–14
    [Google Scholar]
  15. 15. 
    Masters JR. 2002. HeLa cells 50 years on: the good, the bad and the ugly. Nat. Rev. Cancer 2:315–19
    [Google Scholar]
  16. 16. 
    Starfield B, Hyde J, Gervas J, Heath I 2008. The concept of prevention: a good idea gone astray. J. Epidemiol. Community Health 62:580–83
    [Google Scholar]
  17. 17. 
    Dhiman N, Kingshott P, Sumer H, Sharma CS, Rath SN 2019. On-chip anticancer drug screening—recent progress in microfluidic platforms to address challenges in chemotherapy. Biosens. Bioelectron. 137:236–54
    [Google Scholar]
  18. 18. 
    Perry D, Sang A, Yin Y, Zheng YY, Morel L 2011. Murine models of systemic lupus erythematosus. J. Biomed. Biotechnol. 2011:271694
    [Google Scholar]
  19. 19. 
    Kurtz TW, Morris RC, Pershadsingh HA 1989. The Zucker fatty rat as a genetic model of obesity and hypertension. Hypertension 13:896–901
    [Google Scholar]
  20. 20. 
    Perez C, Fanizza LJ, Sclafani A 1999. Flavor preferences conditioned by intragastric nutrient infusions in rats fed chow or a cafeteria diet. Appetite 32:155–70
    [Google Scholar]
  21. 21. 
    Ankeny RA, Leonelli S, Nelson NC, Ramsden E 2014. Making organisms model human behavior: situated models in North-American alcohol research, since 1950. Sci. Context 27:485–509
    [Google Scholar]
  22. 22. 
    Shelley C. 2010. Why test animals to treat humans? On the validity of animal models. Stud. Hist. Philos. Biol. Biomed. Sci. A 41:292–99
    [Google Scholar]
  23. 23. 
    Ramsden E. 2015. Making animals alcoholic: shifting laboratory models of addiction. J. Hist. Behav. Sci. 51:164–94
    [Google Scholar]
  24. 24. 
    Kim JH, Snider T, Abel M, Zemel MB 1994. Hypertension in young, healthy Zucker obese rats is not responsive to reduced salt intake. J. Nutr. 124:713–16
    [Google Scholar]
  25. 25. 
    Pamidimukkala J, Jandhyala BS. 2004. Effects of salt rich diet in the obese Zucker rats: studies on renal function during isotonic volume expansion. Clin. Exp. Hypertens. 26:55–67
    [Google Scholar]
  26. 26. 
    Morgan DA, Anderson EA, Mark AL 1995. Renal sympathetic nerve activity is increased in obese Zucker rats. Hypertension 25:834–38
    [Google Scholar]
  27. 27. 
    Carlson SH, Shelton J, White CR, Wyss JM 2000. Elevated sympathetic activity contributes to hypertension and salt sensitivity in diabetic obese Zucker rats. Hypertension 35:403–8
    [Google Scholar]
  28. 28. 
    Clement K, Vaisse C, Lahlou N, Cabrol S, Pelloux V et al. 1998. A mutation in the human leptin receptor gene causes obesity and pituitary dysfunction. Nature 392:398–401
    [Google Scholar]
  29. 29. 
    Matsuoka N, Ogawa Y, Hosoda K, Matsuda J, Masuzaki H et al. 1997. Human leptin receptor gene in obese Japanese subjects: evidence against either obesity-causing mutations or association of sequence variants with obesity. Diabetologia 40:1204–10
    [Google Scholar]
  30. 30. 
    Rolland V, Clement K, Dugail I, Guy-Grand B, Basdevant A et al. 1998. Leptin receptor gene in a large cohort of massively obese subjects: no indication of the fa/fa rat mutation. Detection of an intronic variant with no association with obesity. Obes. Res. 6:122–27
    [Google Scholar]
  31. 31. 
    Nilsson C, Raun K, Yan FF, Larsen MO, Tang-Christensen M 2012. Laboratory animals as surrogate models of human obesity. Acta Pharmacol. Sin. 33:173–81
    [Google Scholar]
  32. 32. 
    Bokulich A. 2011. How scientific models can explain. Synthese 180:33–45
    [Google Scholar]
  33. 33. 
    Guyton AC, Coleman TG, Cowley AV Jr., Scheel KW, Manning RD Jr., Norman RA Jr 1972. Arterial pressure regulation: overriding dominance of the kidneys in long-term regulation and in hypertension. Am. J. Med 52:584–94
    [Google Scholar]
  34. 34. 
    Guyton AC, Coleman TG, Fourcade JC, Navar LG 1969. Physiologic control of arterial pressure. Bull. N.Y. Acad. Med. 45:811–30
    [Google Scholar]
  35. 35. 
    Guyton AC, Coleman TG, Granger HJ 1972. Circulation: overall regulation. Annu. Rev. Physiol. 34:13–46
    [Google Scholar]
  36. 36. 
    Clemmer JS, Pruett WA, Hester RL, Iliescu R, Lohmeier TE 2018. Role of the heart in blood pressure lowering during chronic baroreflex activation: insight from an in silico analysis. Am. J. Physiol. Heart Circ. Physiol. 315:H1368–82
    [Google Scholar]
  37. 37. 
    Beard DA, Pettersen KH, Carlson BE, Omholt SW, Bugenhagen SM 2013. A computational analysis of the long-term regulation of arterial pressure. F1000Research 2:208
    [Google Scholar]
  38. 38. 
    Kurtz TW, DiCarlo SE, Pravenec M, Jezek F, Silar J et al. 2018. Testing computer models predicting human responses to a high-salt diet. Hypertension 72:1407–16
    [Google Scholar]
  39. 39. 
    Strange K. 2005. The end of “naive reductionism”: rise of systems biology or renaissance of physiology. Am. J. Physiol. Cell Physiol. 288:C968–74
    [Google Scholar]
  40. 40. 
    McShea DW, Wang SC, Brandon RN 2019. A quantitative formulation of biology's first law. Evolution 73:1101–15
    [Google Scholar]
  41. 41. 
    McShea DW, Brandon RN. 2010. Biology's First Law: The Tendency for Diversity and Complexity to Increase in Evolutionary Systems Chicago: Univ. Chicago Press
  42. 42. 
    Mokwe E, Ohmit SE, Nasser SA, Shafi T, Saunders E et al. 2004. Determinants of blood pressure response to quinapril in black and white hypertensive patients: the Quinapril Titration Interval Management Evaluation trial. Hypertension 43:1202–7
    [Google Scholar]
  43. 43. 
    Hester RL, Iliescu R, Summers R, Coleman TG 2011. Systems biology and integrative physiological modelling. J. Physiol. 589:1053–60
    [Google Scholar]
  44. 44. 
    Ahn AC, Tewari M, Poon CS, Phillips RS 2006. The limits of reductionism in medicine: Could systems biology offer an alternative. PLOS Med 3:e208
    [Google Scholar]
  45. 45. 
    Winberg E. 2010. Science in the Age of Computer Simulation Chicago: Univ. Chicago Press
  46. 46. 
    Oreskes N, Shrader-Frechette K, Belitz K 1994. Verification, validation, and confirmation of numerical models in the Earth sciences. Science 263:641–46
    [Google Scholar]
  47. 47. 
    Rudiger D, Kupke SY, Laske T, Zmora P, Reichl U 2019. Multiscale modeling of influenza A virus replication in cell cultures predicts infection dynamics for highly different infection conditions. PLOS Comput. Biol. 15:e1006819
    [Google Scholar]
  48. 48. 
    Bonnaffoux A, Herbach U, Richard A, Guillemin A, Gonin-Giraud S et al. 2019. WASABI: a dynamic iterative framework for gene regulatory network inference. BMC Bioinform 20:220
    [Google Scholar]
  49. 49. 
    Dura-Bernal S, Suter BA, Gleeson P, Cantarelli M, Quintana A et al. 2019. NetPyNE, a tool for data-driven multiscale modeling of brain circuits. eLife 8:e44494
    [Google Scholar]
  50. 50. 
    Clancy CE, An G, Cannon WR, Liu Y, May EE et al. 2016. Multiscale modeling in the clinic: drug design and development. Ann. Biomed. Eng. 44:2591–610
    [Google Scholar]
  51. 51. 
    Collins FS. 2011. Reengineering translational science: The time is right. Sci. Transl. Med. 3:90cm17
    [Google Scholar]
  52. 52. 
    Scruggs SB, Watson K, Su AI, Hermjakob H, Yates JR 3rd et al. 2015. Harnessing the heart of big data. Circ. Res. 116:1115–19
    [Google Scholar]
  53. 53. 
    Longtin R. 2005. An integrated approach: systems biology seeks order in complexity. J. Natl. Cancer Inst. 97:476–78
    [Google Scholar]
  54. 54. 
    Krogh A. 1919. The number and distribution of capillaries in muscles with calculations of the oxygen pressure head necessary for supplying the tissue. J. Physiol. 52:409–15
    [Google Scholar]
  55. 55. 
    Hodgkin AL, Huxley AF. 1952. A quantitative description of membrane current and its application to conduction and excitation in nerve. J. Physiol. 117:500–44
    [Google Scholar]
  56. 56. 
    Starling EH. 1899. The glomerular functions of the kidney. J. Physiol. 24:317–30
    [Google Scholar]
  57. 57. 
    Deen WM, Robertson CR, Brenner BM 1972. A model of glomerular ultrafiltration in the rat. Am. J. Physiol. 223:1178–83
    [Google Scholar]
  58. 58. 
    Chang RS, Robertson CR, Deen WM, Brenner BM 1975. Permselectivity of the glomerular capillary wall to macromolecules. I. Theoretical considerations. Biophys. J. 15:861–86
    [Google Scholar]
  59. 59. 
    Kim SW, Cho HG, Park CR 2009. Fabrication of unagglomerated polypyrrole nanospheres with controlled sizes from a surfactant-free emulsion system. Langmuir 25:9030–36
    [Google Scholar]
  60. 60. 
    Yildirim N, Santillan M, Horike D, Mackey MC 2004. Dynamics and bistability in a reduced model of the lac operon. Chaos 14:279–92
    [Google Scholar]
  61. 61. 
    Veliz-Cuba A, Stigler B. 2011. Boolean models can explain bistability in the lac operon. J. Comput. Biol. 18:783–94
    [Google Scholar]
  62. 62. 
    Dreisigmeyer DW, Stajic J, Nemenman I, Hlavacek WS, Wall ME 2008. Determinants of bistability in induction of the Escherichia coli lac operon. IET Syst. Biol. 2:293–303
    [Google Scholar]
  63. 63. 
    Coleman TG, Randall JE. 1983. HUMAN: a comprehensive physiological model. Physiologist 26:15–21
    [Google Scholar]
  64. 64. 
    Abram SR, Hodnett BL, Summers RL, Coleman TG, Hester RL 2007. Quantitative Circulatory Physiology: an integrative mathematical model of human physiology for medical education. Adv. Physiol. Educ. 31:2202–10
    [Google Scholar]
  65. 65. 
    Summers R, Montani J. 1989. Mathematical model of glucose homeostasis for the study of metabolic states. J. Miss. Acad. Sci. 34:25–32
    [Google Scholar]
  66. 66. 
    Summers RL, Montani JP, Woodward LH, Coleman TG, Hall JE 1997. Theoretical analysis of the mechanisms of chronic hyperinsulinemia. Comput. Biol. Med. 27:249–56
    [Google Scholar]
  67. 67. 
    Guyton AC, Coleman TG, Manning RD Jr., Hall JE 1984. Some problems and solutions for modeling overall cardiovascular regulation. Math. Biosci. 72:141–55
    [Google Scholar]
  68. 68. 
    Pruett WA, Clemmer JS, Hester RL 2016. Validation of an integrative mathematical model of dehydration and rehydration in virtual humans. Physiol. Rep. 4:e13015
    [Google Scholar]
  69. 69. 
    Summers RL, Martin DS, Meck JV, Coleman TG 2007. Computer systems analysis of spaceflight induced changes in left ventricular mass. Comput. Biol. Med. 37:358–63
    [Google Scholar]
  70. 70. 
    Summers RL, Ward KR, Witten T, Convertino VA, Ryan KL et al. 2009. Validation of a computational platform for the analysis of the physiologic mechanisms of a human experimental model of hemorrhage. Resuscitation 80:1405–10
    [Google Scholar]
  71. 71. 
    Clemmer JS, Pruett WA, Hester RL, Iliescu R, Lohmeier TE 2018. Role of the heart in blood pressure lowering during chronic baroreflex activation: insight from an in silico analysis. Am. J. Physiol. Heart Circ. Physiol. 315:H1368–82
    [Google Scholar]
  72. 72. 
    Shanks N, Greek R, Greek J 2009. Are animal models predictive for humans. Philos. Ethics Humanit. Med. 4:2
    [Google Scholar]
  73. 73. 
    Drake CG, Rozzo SJ, Vyse TJ, Palmer E, Kotzin BL 1995. Genetic contributions to lupus-like disease in (NZB×NZW)F1 mice. Immunol. Rev. 144:51–74
    [Google Scholar]
  74. 74. 
    Drake CG, Rozzo SJ, Hirschfeld HF, Smarnworawong NP, Palmer E, Kotzin BL 1995. Analysis of the New Zealand Black contribution to lupus-like renal disease: multiple genes that operate in a threshold manner. J. Immunol. 154:2441–47
    [Google Scholar]
  75. 75. 
    Helyer BJ, Howie JB. 1963. Renal disease associated with positive lupus erythematosus tests in a cross-bred strain of mice. Nature 197:197
    [Google Scholar]
  76. 76. 
    Burnet FM, Holmes MC. 1965. The natural history of the NZB/NZW F1 hybrid mouse: a laboratory model of systemic lupus erythematosus. Australas. Ann. Med. 14:185–91
    [Google Scholar]
  77. 77. 
    Van Dam D, De Deyn PP 2006. Drug discovery in dementia: the role of rodent models. Nat. Rev. Drug Discov. 5:956–70
    [Google Scholar]
  78. 78. 
    Willner P. 1984. The validity of animal models of depression. Psychopharmacology 83:1–16
    [Google Scholar]
  79. 79. 
    Royal K. 2016. “Face validity” is not a legitimate type of validity evidence!. Am. J. Surg. 212:1026–27
    [Google Scholar]
  80. 80. 
    O'Collins VE, Macleod MR, Donnan GA, Horky LL, van der Worp BH, Howells DW 2006. 1,026 experimental treatments in acute stroke. Ann. Neurol. 59:467–77
    [Google Scholar]
  81. 81. 
    Kaitin KI, DiMasi JA. 2011. Pharmaceutical innovation in the 21st century: new drug approvals in the first decade, 2000–2009. Clin. Pharmacol. Ther. 89:183–88
    [Google Scholar]
  82. 82. 
    Pevarello P. 2009. Recent drug approvals from the US FDA and EMEA: what the future holds. Future Med. Chem. 1:35–48
    [Google Scholar]
  83. 83. 
    Gabrielsson J, Green AR. 2009. Quantitative pharmacology or pharmacokinetic pharmacodynamic integration should be a vital component in integrative pharmacology. J. Pharmacol. Exp. Ther. 331:767–74
    [Google Scholar]
  84. 84. 
    Wendler A, Wehling M. 2012. Translatability scoring in drug development: eight case studies. J. Transl. Med. 10:39
    [Google Scholar]
  85. 85. 
    Prabhakar S. 2012. Translational research challenges: finding the right animal models. J. Investig. Med. 60:1141–46
    [Google Scholar]
  86. 86. 
    Wendler A, Wehling M. 2017. Translatability score revisited: differentiation for distinct disease areas. J. Transl. Med. 15:226
    [Google Scholar]
  87. 87. 
    US FDA (Food Drug Adm.) 2006. Guidance for Industry: Nonclinical Safety Evaluation of Drugs or Biologic Combinations Rockville, MD: FDA
  88. 88. 
    US FDA (Food Drug Adm.) 2010. Guidance for Industry and FDA staff: General Considerations for Animal Studies for Cardiovascular Devices Rockville, MD: FDA
  89. 89. 
    Lowenstein PR, Castro MG. 2009. Uncertainty in the translation of preclinical experiments to clinical trials. Why do most phase III clinical trials fail. Curr. Gene Ther. 9:368–74
    [Google Scholar]
  90. 90. 
    Mak IW, Evaniew N, Ghert M 2014. Lost in translation: animal models and clinical trials in cancer treatment. Am. J. Transl. Res. 6:114–18
    [Google Scholar]
  91. 91. 
    US FDA (Food Drug Adm.) 2004. Innovation Stagnation: Challenge and Opportunity on the Critical Path to New Medical Technologies Rockville, MD: FDA
  92. 92. 
    Adams CP, Brantner VV. 2006. Estimating the cost of new drug development: Is it really $802 million. Health Aff 25:420–28
    [Google Scholar]
  93. 93. 
    DiMasi JA, Grabowski HG, Hansen RW 2015. The cost of drug development. N. Engl. J. Med. 372:1972
    [Google Scholar]
  94. 94. 
    DiMasi JA, Grabowski HG, Hansen RW 2016. Innovation in the pharmaceutical industry: new estimates of R&D costs. J. Health Econ. 47:20–33
    [Google Scholar]
  95. 95. 
    DiMasi JA, Hansen RW, Grabowski HG 2003. The price of innovation: new estimates of drug development costs. J. Health Econ. 22:151–85
    [Google Scholar]
  96. 96. 
    DiMasi JA, Hansen RW, Grabowski HG, Lasagna L 1991. Cost of innovation in the pharmaceutical industry. J. Health Econ. 10:107–42
    [Google Scholar]
  97. 97. 
    DiMasi JA, Hansen RW, Grabowski HG, Lasagna L 1995. Research and development costs for new drugs by therapeutic category: a study of the US pharmaceutical industry. Pharmacoeconomics 7:152–69
    [Google Scholar]
  98. 98. 
    van der Worp HB, Howells DW, Sena ES, Porritt MJ, Rewell S et al. 2010. Can animal models of disease reliably inform human studies. PLOS Med 7:e1000245
    [Google Scholar]
  99. 99. 
    Hughes RIG. 1999. The Ising model, computer simulation, and universal physics. Models as Mediators: Perspectives on Natural and Social Science MS Morgan, M Morrison 97–145 Cambridge: Cambridge Univ. Press
    [Google Scholar]
  100. 100. 
    Wu KK, Huan Y. 2008. Streptozotocin-induced diabetic models in mice and rats. Curr. Protoc. Pharmacol. 5:47.1–20
    [Google Scholar]
  101. 101. 
    Duhem P. 1954. The Aim and Structure of Physical Theory Princeton: Princeton Univ. Press
  102. 102. 
    Patterson EA, Whelan MP. 2017. A framework to establish credibility of computational models in biology. Progress Biophys. Mol. Biol. 129:13–19
    [Google Scholar]
  103. 103. 
    Schruben LW. 1980. Establishing the credibility of simulations. Simulation 34:101–105
    [Google Scholar]
  104. 104. 
    Pathmanathan P, Gray RA. 2018. Validation and trustworthiness of multiscale models of cardiac electrophysiology. Front. Physiol. 9:106
    [Google Scholar]
  105. 105. 
    Roache PJ. 2009. Validation—What does it mean. J. Fluids Eng. 131:034503
    [Google Scholar]
  106. 106. 
    Morrison TM, Dreher ML, Nagaraja S, Angelone LM, Kainz W 2017. The role of computational modeling and simulation in the total product life cycle of peripheral vascular devices. J. Med. Device 11:024503
    [Google Scholar]
  107. 107. 
    Audi R. 2010. Epistemology: A Contemporary Introduction to the Theory of Knowledge New York: Routledge
  108. 108. 
    Kilkenny C, Browne W, Cuthill IC, Emerson M, Altman DG et al. 2010. Animal research: reporting in vivo experiments: the ARRIVE guidelines. Br. J. Pharmacol. 160:1577–79
    [Google Scholar]
  109. 109. 
    McGonigle P, Ruggeri B. 2014. Animal models of human disease: challenges in enabling translation. Biochem. Pharmacol. 87:162–71
    [Google Scholar]
  110. 110. 
    Masic I, Miokovic M, Muhamedagic B 2008. Evidence based medicine—new approaches and challenges. Acta Inform. Med. 16:219–25
    [Google Scholar]
  111. 111. 
    Ferreira GS, Veening-Griffioen DH, Boon WPC, Moors EHM, Gispen-de Wied CC et al. 2019. A standardised framework to identify optimal animal models for efficacy assessment in drug development. PLOS ONE 14:e0218014
    [Google Scholar]
  112. 112. 
    Sultana J, Cutroneo P, Trifiro G 2013. Clinical and economic burden of adverse drug reactions. J. Pharmacol. Pharmacother. 4:Suppl. 1S73–77
    [Google Scholar]
  113. 113. 
    US FDA (Food Drug Adm.) 2017. Qualification of Medical Device Development Tools: Guidance for Industry, Tool Developers, and Food and Drug Administrative Staff Rockville, MD: FDA
  114. 114. 
    US FDA (Food Drug Adm.) 2014. Guidance for Industry and FDA Staff: Qualification Process for Drug Development Tools Rockville MD: FDA
  115. 115. 
    US FDA (Food Drug Adm.) 2015. Product Development Under the Animal Rule—Guidance for Industry Rockville MD: FDA
  116. 116. 
    Woodcock J, Buckman S, Goodsaid F, Walton MK, Zineh I 2011. Qualifying biomarkers for use in drug development: a US Food and Drug Administration overview. Expert Opin. Med. Diagn. 5:369–74
    [Google Scholar]
  117. 117. 
    Gottlieb S. 2017. How FDA plans to help consumers capitalize on advances in science. FDA Blog July 7. https://www.fda.gov/news-events/fda-voices-perspectives-fda-leadership-and-experts/how-fda-plans-help-consumers-capitalize-advances-science
    [Google Scholar]
  118. 118. 
    Subcomm. Health 2018. Hearing on “21st century cures implementation: updates from FDA and NIH.”. Committee on Energy and Commerce Washington, DC: Subcommittee on Health. https://www.nih.gov/about-nih/who-we-are/nih-director/testimony-21st-century-cures-implementation-updates-fda-nih
    [Google Scholar]
  119. 119. 
    US FDA (Food Drug Adm.) 2018. Benefit-Risk Assessment in Drug Regulatory Decision-Making: Draft PDUFA VI Implementation Plan (FY 2018–2022) Rockville, MD: FDA
  120. 120. 
    NASA (Natl. Aeronaut. Space Adm) 2009. Standard for Models and Simulations Washington, DC: NASA
  121. 121. 
    ASME (Am. Soc. Mech. Eng.) 2018. Assessing Credibility of Computational Modeling through Verification and Validation: Application to Medical Devices New York: ASME
/content/journals/10.1146/annurev-bioeng-082219-051740
Loading
/content/journals/10.1146/annurev-bioeng-082219-051740
Loading

Data & Media loading...

  • Article Type: Review Article
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error