1932
0
  1. Home
  2. A-Z Publications
  3. Annual Review of Political Science
  4. Volume 24, 2021
  5. Article

Annual Review of Political Science

Volume 24, 2021

Ethics of Field Experiments

Abstract

Political scientists are increasingly conducting field experiments that raise ethical issues that standard review criteria and processes are ill equipped to address. Field experiments can answer important questions, but they can also present various harms to individuals, communities, and political processes; undermine autonomy; introduce partnerships that present complex questions of responsibility; and damage the public's trust in the discipline. This article reviews published empirical and theoretical research, professional guidelines, and media accounts, blog posts, and other sources when appropriate. It characterizes the state of the field regarding the identification of ethical problems, relevant normative guidance, proposed strategies for managing ethical concerns, and issues on the horizon. It concludes that the discipline is making good progress, with robust guidelines and strategies for conducting field experiments ethically. However, there is still much work to be done in refining and expanding current guidance, addressing remaining issues, and promoting norms. This review concludes with some general recommendations for researchers conducting political science field experiments.

Keyword(s): autonomy, consent, ethics, field experiments, human subjects, institutional review boards, IRBs
Loading

Article metrics loading...

/content/journals/10.1146/annurev-polisci-041719-101956
2021-05-11
2025-04-20
Loading full text...

Full text loading...

/deliver/fulltext/polisci/24/1/annurev-polisci-041719-101956.html?itemId=/content/journals/10.1146/annurev-polisci-041719-101956&mimeType=html&fmt=ahah

Literature Cited

  1. APSA (Am. Political Sci. Assoc.) 2020. Principles and Guidance for Human Subjects Research. https://connect.apsanet.org/hsr/principles-and-guidance/
    [Google Scholar]
  2. APSR Editors 2021. Notes from the editors. Am. Political Sci. Rev. 115:1v–viii
     [Google Scholar]
  3. Baele SJ. 2013. The ethics of new development economics: is the experimental approach to development economics morally wrong?. J. Philos. Econ. 7:2–42
     [Google Scholar]
  4. Banerjee AV, Duflo E. 2017a. Introduction. See Banerjee & Duflo 2017b 1–24
  5. Banerjee AV, Duflo E 2017b. Handbook of Economic Field Experiments, Vol. 1 Amsterdam/Oxford: North-Holland
     [Google Scholar]
  6. Beach G, Phillips T. 2020. Survey on research ethics with human subjects: executive summary Rep. Ad Hoc Comm. Hum. Subj. Res. https://www.apsanet.org/Portals/54/goverance/Executive%20Summary%20of%20the%20Survey%20of%20Membership.pdf?ver=2019-08-19-153221-817
    [Google Scholar]
  7. Beauchamp TL, Childress JF. 2019. Principles of Biomedical Ethics New York: Oxford Univ. Press. , 8th ed..
     [Google Scholar]
  8. Carlson E. 2020. Field experiments and behavioral theories: science and ethics. PS: Political Sci. Politics 53:89–93
     [Google Scholar]
  9. Coville A, Galiani S, Gertler P, Yoshida S. 2020. Enforcing payment for water and sanitation services in Nairobi's slums NBER Work. Pap27569
     [Google Scholar]
  10. De La O AL, Wantchekon L 2011. Experimental research on democracy and development. See Druckman et al. 2011 384–96
  11. Deaton A. 2020. Randomization in the tropics revisited: a theme and eleven variations NBER Work. Pap. 27600
    [Google Scholar]
  12. Desposato S. 2016a. Conclusion and recommendations. See Desposato 2016c 267–89
  13. Desposato S. 2016b. Introduction. See Desposato 2016c 1–22
  14. Desposato S 2016c. Ethics and Experiments: Problems and Solutions for Social Scientists and Policy Professionals New York: Routledge
     [Google Scholar]
  15. Desposato S. 2018. Subjects and scholars’ views on the ethics of political science field experiments. Perspect. Politics 16:739–50
     [Google Scholar]
  16. Desposato S. 2021. The ethical challenges of political science field experiments. See Iltis & MacKay 2021. In press
  17. Dionne KY, Harawa A, Honde H. 2016. The ethics of exclusion when experimenting in impoverished settings. See Desposato 2016c 25–41
  18. Driscoll J. 2016. Prison states and games of chicken. See Desposato 2016c 81–96
  19. Druckman J, Green DP 2021. Advances in Experimental Political Science Cambridge, UK: Cambridge Univ. Press In press
    [Google Scholar]
  20. Druckman JN, Green DP, Kuklinski JH, Lupia A 2011. Cambridge Handbook of Experimental Political Science Cambridge, UK: Cambridge Univ. Press
     [Google Scholar]
  21. EGAP (Evid. Governance Politics) 2011. EGAP Research Principles. https://egap.org/wp-content/uploads/2020/05/egap-research-principles.pdf
    [Google Scholar]
  22. Feinberg J. 1984. Harm to Others: The Moral Limits of the Criminal Law New York: Oxford Univ. Press
     [Google Scholar]
  23. Findley M, Nielson DL, Desposato S. 2016. Obligated to deceive? Aliases, confederates, and the common rule in international field experiments. See Desposato 2016c 151–70
  24. Freedman B. 1987. Equipoise and the ethics of clinical research. N. Engl. J. Med. 317:141–45
     [Google Scholar]
  25. Fujii LA. 2012. Research ethics 101: dilemmas and responsibilities. PS: Political Sci. Politics 45:717–23
     [Google Scholar]
  26. Gelman A. 2010. $63,000 worth of abusive research…or just a really stupid waste of time?. Stat. Model. Causal Inference Soc. Sci. Blog May 6. https://statmodeling.stat.columbia.edu/2010/05/06/63000_worth_of/
    [Google Scholar]
  27. Gerber AS. 2011. Field experiments in political science See Druckman et al. 2011 115–38
     [Google Scholar]
  28. Gerber AS, Green DP. 2012. Field Experiments: Design, Analysis, and Interpretation New York: W.W. Norton
     [Google Scholar]
  29. Glennerster R, Powers S 2016. Balancing risk and benefit: ethical tradeoffs in running randomized evaluations. The Oxford Handbook of Professional Economic Ethics GF DeMartino, D McCloskey New York: Oxford Univ. Press
     [Google Scholar]
  30. Grimmelmann J. 2015. The law and ethics of experiments on social media users. Colo. Technol. Law J. 13:219–72
     [Google Scholar]
  31. Gubler J, Selway J. 2016. Considering the political consequences of comparative politics experiments. See Desposato 2016c 171–82
  32. Hauck RJP. 2008. Protecting human research participants, IRBs, and political science redux: editor's introduction. PS: Political Sci. Politics 41:475–76
     [Google Scholar]
  33. Humphreys M. 2011. Ethical challenges of embedded experimentation. APSA Comp. Democr. 9:1023–29
     [Google Scholar]
  34. Humphreys M. 2014. How to make field experiments more ethical. Washington Post Monkey Cage Blog Nov. 17. https://www.washingtonpost.com/news/monkey-cage/wp/2014/11/02/how-to-make-field-experiments-more-ethical/
    [Google Scholar]
  35. Humphreys M. 2015. Reflections on the ethics of social experimentation. J. Glob. Dev. 6:87–112
     [Google Scholar]
  36. Iltis A, MacKay DP. 2021. Oxford Handbook of Research Ethics. Oxford Univ. Press In press
    [Google Scholar]
  37. Israel BA, Eng E, Schulz AJ, Parker EA. 2012. Methods for Community-Based Participatory Research for Health San Francisco: Wiley
     [Google Scholar]
  38. Johnson JB. 2018. Protecting the community: lessons from the Montana Flyer Project. PS: Political Sci. Politics 51:615–19
     [Google Scholar]
  39. King G, Sands M. 2015. How human subjects research rules mislead you and your university, and what to do about it. Work. Pap., Harvard Univ., Cambridge, MA https://gking.harvard.edu/files/gking/files/irb_politics_paper_1.pdf
    [Google Scholar]
  40. King N. 2000. Defining and describing benefit appropriately in clinical trials. J. Law Med. Ethics 28:332–43
     [Google Scholar]
  41. Kwek A. 2020. Crowdsourced research: vulnerability, autonomy, and exploitation. Ethics Hum. Res. 42:22–35
     [Google Scholar]
  42. Lagunes P, Seim B. 2021. The state of experimental research on corruption control. See Druckman & Green 2021. In press
  43. Landgrave M. 2020. Can we reduce deception in elite field experiments? Evidence from a field experiment with state legislative offices. State Politics Policy Q 20:489–507
     [Google Scholar]
  44. MacKay DP. 2018. The ethics of public policy RCTs: the principle of policy equipoise. Bioethics 32:59–67
     [Google Scholar]
  45. McDermott R, Hatemi PK 2020. Ethics in field experimentation: a call to establish new standards to protect the public from unwanted manipulation and real harms. PNAS 117:30014–21
     [Google Scholar]
  46. Michelson MR. 2016. The risk of over-reliance on the Institutional Review Board: an approved project is not always an ethical project. PS: Political Sci. Politics 49:299–303
     [Google Scholar]
  47. Morton RB, Rogers J. 2016. Religion, experiments, and ethical concerns. See Desposato 2016c 66–80
  48. Morton RB, Williams KC. 2010. Experimental Political Science and the Study of Causality: From Nature to the Lab Cambridge, UK: Cambridge Univ. Press
     [Google Scholar]
  49. Nathan NL, White A. 2021. Experiments on and with street-level bureaucrats. See Druckman & Green 2021. In press
  50. Natl. Comm. Prot. Hum. Subj. Biomed. Behav. Res 1979. The Belmont Report: Ethical Principles and Guidelines for the Protection of Human Subjects of Research Washington, DC: Gov. Print. Off.
     [Google Scholar]
  51. Naurin E, Öhberg P. 2019. Ethics in elite experiments: a perspective of officials and voters. Br. J. Political Sci. https://doi.org/10.1017/S0007123418000583
    [Crossref] [Google Scholar]
  52. Nickerson DW, Hyde S. 2016. Conducting research with NGOs: relevant counterfactuals from the perspective of subjects. See Desposato 2016c 198–216
  53. Nielson RA. 2016. Ethics for experimental manipulation of religion. See Desposato 2016c 42–65
  54. Nozick R 1969. Coercion. Philosophy, Science, and Method: Essays in Honor of Ernest Nagel S Morgenbesser, P Suppes, M White 440–72 New York: St. Martin's
     [Google Scholar]
  55. Pan J. 2021. Experiments on political activity governments want to keep hidden. See Druckman & Green 2021. In press
  56. Peyton K. 2013. Ethics and politics in field experiments. Exp. Political Sci. 3:20–36
     [Google Scholar]
  57. Phillips T. 2021. Coercion, exploitation, and undue inducement. See Iltis & MacKay 2021. In press
  58. Rasmussen LM. 2021. Research ethics in citizen science. See Iltis & MacKay 2021. In press
  59. Rawls J. 1971. A Theory of Justice Cambridge, MA: Harvard Univ. Press
     [Google Scholar]
  60. Rolston H, Geyer J, Locke G. 2013. Final report: evaluation of the Homebase Community Prevention Program Rep., NYC Dep. Homeless Serv., New York, NY https://www.abtassociates.com/insights/publications/report/evaluation-of-the-homebase-community-prevention-program-final-report
    [Google Scholar]
  61. Schroeder D, Chatfield K, Singh M, Chennells R, Herissone-Kelly P 2019. The San code of research ethics. Equitable Research Partnerships: A Global Code of Conduct to Counter Ethics Dumping D Schroeder, K Chatfield, M Singh, R Chennells, P Herissone-Kelly 73–87 Cham: Springer
     [Google Scholar]
  62. Slough T. 2018. Bureaucrats driving inequality in access: experimental evidence from Colombia Work. Pap., Columbia Univ. New York, NY: http://taraslough.com/assets/pdf/JMP.pdf
    [Google Scholar]
  63. Slough T. 2019. The ethics of electoral experimentation: design-based recommendations Work. Pap., Columbia Univ. New York, N:Y. http://taraslough.com/assets/pdf/eee.pdf
    [Google Scholar]
  64. Teele DL 2014. Reflections on the ethics of field experiments. Field Experiments and Their Critics: Essays on the Uses and Abuses of Experimentation in the Social Sciences DL Teele 115–40 New Haven/London: Yale Univ. Press
     [Google Scholar]
  65. Teele DL. 2021. Virtual consent: the bronze standard for experimental ethics. See Druckman & Green 2021. In press
  66. Whitfield G. 2019. TRENDS: Toward a separate ethics of political field experiments. Political Res. Q. 72:527–38
     [Google Scholar]
  67. Williamson V. 2016. On the ethics of crowdsourced research. PS: Political Sci. Politics 49:77–81
     [Google Scholar]
  68. Willis D. 2014. Professors’ research project stirs political outrage in Montana. NY Times Nov. 17. https://www.nytimes.com/2014/10/29/upshot/professors-research-project-stirs-political-outrage-in-montana.html
    [Google Scholar]
  69. Wilson J, Hunter D. 2010. Research exceptionalism. Am. J. Bioethics 10:45–54
     [Google Scholar]
  70. Yanow D, Schwartz-Shea P. 2016. Encountering your IRB 2.0: what political scientists need to know. PS: Political Sci. Politics 49:277–86
     [Google Scholar]
  71. Zechmeister EJ. 2016. Ethics and research in political science: the responsibilities of the researcher and the profession. See Desposato 2016c 255–61
  72. Zimmerman B. 2016. Information and power: ethical considerations of political information experiments. See Desposato 2016c 183–97
/content/journals/10.1146/annurev-polisci-041719-101956
Loading
  • Article Type: Review Article

Most Cited Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error