1932

Abstract

Understanding how biases originate in medical technologies and developing safeguards to identify, mitigate, and remove their harms are essential to ensuring equal performance in all individuals. Drawing upon examples from pulmonary medicine, this article describes how bias can be introduced in the physical aspects of the technology design, via unrepresentative data, or by conflation of biological with social determinants of health. It then can be perpetuated by inadequate evaluation and regulatory standards. Research demonstrates that pulse oximeters perform differently depending on patient race and ethnicity. Pulmonary function testing and algorithms used to predict healthcare needs are two additional examples of medical technologies with racial and ethnic biases that may perpetuate health disparities.

Loading

Article metrics loading...

/content/journals/10.1146/annurev-med-043021-024004
2023-01-27
2024-12-11
Loading full text...

Full text loading...

/deliver/fulltext/med/74/1/annurev-med-043021-024004.html?itemId=/content/journals/10.1146/annurev-med-043021-024004&mimeType=html&fmt=ahah

Literature Cited

  1. 1.
    Sjoding M, Iwashyna TJ, Valley TS. 2021. More on racial bias in pulse oximetry measurement. Reply. N. Engl. J. Med. 384:1278
    [Google Scholar]
  2. 2.
    Benjamin R. 2019. Race After Technology: Abolitionist Tools for the New Jim Code Medford, MA: Polity
    [Google Scholar]
  3. 3.
    Fussell S. 2017. Why can't this soap dispenser identify dark skin?. Gizmodo https://gizmodo.com/why-cant-this-soap-dispenser-identify-dark-skin-1797931773
    [Google Scholar]
  4. 4.
    Buolamwini J, Gebru T. 2018. Gender shades: intersectional accuracy disparities in commercial gender classification. Paper presented at the Conference on Fairness, Accountability, and Transparency New York, NY: Feb 23–24
    [Google Scholar]
  5. 5.
    Bartlett R, Morse A, Stanton R, Wallace N 2019. Consumer-lending discrimination in the FinTech era NBER Work. Pap. 25943
    [Google Scholar]
  6. 6.
    Angwin J, Larson J, Mattu S, Kirchner L. 2016. Machine bias. Propublica https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing
    [Google Scholar]
  7. 7.
    Braveman PA, Arkin E, Proctor D et al. 2022. Systemic and structural racism: definitions, examples, health damages, and approaches to dismantling. Health Aff 41:171–78
    [Google Scholar]
  8. 8.
    Bailey ZD, Feldman JM, Bassett MT. 2021. How structural racism works—racist policies as a root cause of U.S. racial health inequities. N. Engl. J. Med. 384:768–73
    [Google Scholar]
  9. 9.
    Chapman EN, Kaatz A, Carnes M. 2013. Physicians and implicit bias: how doctors may unwittingly perpetuate health care disparities. J. Gen. Intern. Med. 28:1504–10
    [Google Scholar]
  10. 10.
    Smedley BD, Stith AY, Nelson AR, eds. 2003. Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care Washington, DC: Natl. Acad. Press
    [Google Scholar]
  11. 11.
    Braveman P. 2014. What are health disparities and health equity? We need to be clear. Public Health Rep 129:Suppl. 25–8
    [Google Scholar]
  12. 12.
    AHRQ 2019. 2018 National healthcare quality and disparities report Agency Healthc. Res. Qual. Rockville, MD: https://www.ahrq.gov/research/findings/nhqrdr/nhqdr18/index.html
    [Google Scholar]
  13. 13.
    Severinghaus JW, Astrup PB. 1986. History of blood gas analysis. VI. Oximetry. J. Clin. Monitor. 2:270–88
    [Google Scholar]
  14. 14.
    Neff TA. 1988. Routine oximetry. A fifth vital sign?. Chest 94:227
    [Google Scholar]
  15. 15.
    Severinghaus JW. 2007. Takuo Aoyagi: discovery of pulse oximetry. Anesth. Analg. 105:S1–S4
    [Google Scholar]
  16. 16.
    Greenhalgh T, Knight M, Inada-Kim M et al. 2021. Remote management of covid-19 using home pulse oximetry and virtual ward support. BMJ 372:n677
    [Google Scholar]
  17. 17.
    Schnapp LM, Cohen NH. 1990. Pulse oximetry. Uses and abuses. Chest 98:1244–50
    [Google Scholar]
  18. 18.
    Mannheimer PD. 2007. The light-tissue interaction of pulse oximetry. Anesth. Analg. 105:S10–S17
    [Google Scholar]
  19. 19.
    Jubran A, Tobin MJ. 1990. Reliability of pulse oximetry in titrating supplemental oxygen therapy in ventilator-dependent patients. Chest 97:1420–25
    [Google Scholar]
  20. 20.
    Bickler PE, Feiner JR, Severinghaus JW. 2005. Effects of skin pigmentation on pulse oximeter accuracy at low saturation. Anesthesiology 102:715–19
    [Google Scholar]
  21. 21.
    Feiner JR, Severinghaus JW, Bickler PE. 2007. Dark skin decreases the accuracy of pulse oximeters at low oxygen saturation: the effects of oximeter probe type and gender. Anesth. Analg. 105:S18–S23
    [Google Scholar]
  22. 22.
    Sjoding MW, Dickson RP, Iwashyna TJ et al. 2020. Racial bias in pulse oximetry measurement. N. Engl. J. Med. 383:2477–78
    [Google Scholar]
  23. 23.
    Batchelder PB, Raley DM. 2007. Maximizing the laboratory setting for testing devices and understanding statistical output in pulse oximetry. Anesth. Analg. 105:S85–S94
    [Google Scholar]
  24. 24.
    Natl. Hum. Genome Res. Inst 2022. Race. Natl. Hum. Genom Res. Inst. Talking Glossary of Genetic Terms https://www.genome.gov/genetics-glossary/Race. Accessed Mar. 21, 2022
    [Google Scholar]
  25. 25.
    Taylor SC. 2002. Skin of color: biology, structure, function, and implications for dermatologic disease. J. Am. Acad. Dermatol. 46:S41–S62
    [Google Scholar]
  26. 26.
    Keith VM, Herring C. 1991. Skin tone and stratification in the Black community. Am. J. Sociol. 97:760–78
    [Google Scholar]
  27. 27.
    FDA 2021. Pulse oximeter accuracy and limitations: FDA safety communication Saf. Commun., US Food Drug Adm. Silver Spring, MD: https://www.fda.gov/medical-devices/safety-communications/pulse-oximeter-accuracy-and-limitations-fda-safety-communication
    [Google Scholar]
  28. 28.
    Valbuena VSM, Barbaro RP, Claar D et al. 2021. Racial bias in pulse oximetry measurement among patients about to undergo extracorporeal membrane oxygenation in 2019–2020: a retrospective cohort study. Chest 161:971–78
    [Google Scholar]
  29. 29.
    Wong AI, Charpignon M, Kim H et al. 2021. Analysis of discrepancies between pulse oximetry and arterial oxygen saturation measurements by race and ethnicity and association with organ dysfunction and mortality. JAMA 4:e2131674
    [Google Scholar]
  30. 30.
    Henry NR, Hanson AC, Schulte PJ et al. 2022. Disparities in hypoxemia detection by pulse oximetry across self-identified racial groups and associations with clinical outcomes. Crit. Care Med. 50:204–11
    [Google Scholar]
  31. 31.
    Johnson JD, Theurer WM. 2014. A stepwise approach to the interpretation of pulmonary function tests. Am. Fam. Phys. 89:359–66
    [Google Scholar]
  32. 32.
    Pellegrino R, Viegi G, Brusasco V et al. 2005. Interpretative strategies for lung function tests. Eur. Respir. J. 26:948–68
    [Google Scholar]
  33. 33.
    Hankinson JL, Odencrantz JR, Fedan KB. 1999. Spirometric reference values from a sample of the general U.S. population. Am. J. Respir. Crit. Care Med. 159:179–87
    [Google Scholar]
  34. 34.
    Quanjer PH, Stanojevic S, Cole TJ et al. 2012. Multi-ethnic reference values for spirometry for the 3–95-yr age range: the global lung function 2012 equations. Eur. Respir. J. 40:1324–43
    [Google Scholar]
  35. 35.
    Braun L. 2015. Race, ethnicity and lung function: a brief history. Can. J. Respir. Ther. 51:99–101
    [Google Scholar]
  36. 36.
    Vyas DA, Eisenstein LG, Jones DS. 2020. Hidden in plain sight—reconsidering the use of race correction in clinical algorithms. N. Engl. J. Med. 383:874–82
    [Google Scholar]
  37. 37.
    Schluger NW, Dozor AJ, Jung YEG. 2022. Rethinking the race adjustment in pulmonary function testing. Ann. Am. Thorac. Soc. 19:353–56
    [Google Scholar]
  38. 38.
    Baugh AD, Shiboski S, Hansel NN et al. 2021. Reconsidering the utility of race-specific lung function prediction equations. Am. J. Respir. Crit. Care Med. 205:819–29
    [Google Scholar]
  39. 39.
    Jones PW, Quirk FH, Baveystock CM. 1991. The St. George's respiratory questionnaire. Resp. Med. 85(Suppl. B):2531
    [Google Scholar]
  40. 40.
    Patel BD, Coxson HO, Pillai SG et al. 2008. Airway wall thickening and emphysema show independent familial aggregation in chronic obstructive pulmonary disease. Am. J. Respir. Crit. Care Med. 178:500–5
    [Google Scholar]
  41. 41.
    Elmaleh-Sachs A, Balte P, Oelsener EC et al. 2022. Race/ethnicity, spirometry reference equations, and prediction of incident clinical events: the Multi-Ethnic Study of Atherosclerosis (MESA) lung study. Am. J. Respir. Crit. Care Med. 205:700–10
    [Google Scholar]
  42. 42.
    Braun L. 2021. Race correction and spirometry: why history matters. Chest 159:1670–75
    [Google Scholar]
  43. 43.
    Hileman G, Steele S. 2016. Accuracy of claims-based risk scoring models: Society of Actuaries. https://www.soa.org/globalassets/assets/Files/Research/research-2016-accuracy-claims-based-risk-scoring-models.pdf
  44. 44.
    Bates DW, Saria S, Ohno-Machado L et al. 2014. Big data in health care: using analytics to identify and manage high-risk and high-cost patients. Health Aff 33:1123–31
    [Google Scholar]
  45. 45.
    Obermeyer Z, Powers B, Vogeli C, Mullainathan S. 2019. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366:447–53
    [Google Scholar]
  46. 46.
    Wiens J, Price WN 2nd, Sjoding MW 2020. Diagnosing bias in data-driven algorithms for healthcare. Nat. Med. 26:25–26
    [Google Scholar]
  47. 47.
    Passi S, Barocas S. 2019. Problem formulation and fairness. Paper presented at the Conference on Fairness, Accountability, and Transparency Atlanta, GA: Jan 29–31
    [Google Scholar]
  48. 48.
    Long P, Abrams M, Milstein A et al. 2017. Effective Care for High-Need Patients: Opportunities for Improving Outcomes, Value, and Health Washington, DC: Natl. Acad. Med.
    [Google Scholar]
  49. 49.
    Benjamin R. 2019. Assessing risk, automating racism. Science 366:421–22
    [Google Scholar]
  50. 50.
    Jubran A. 2015. Pulse oximetry. Crit. Care 19:272
    [Google Scholar]
  51. 51.
    Ross PA, Newth CJ, Khemani RG. 2014. Accuracy of pulse oximetry in children. Pediatrics 133:22–29
    [Google Scholar]
  52. 52.
    Andrist E, Nuppnau M, Barbaro RP et al. 2022. Association of race with pulse oximetry accuracy in hospitalized children. JAMA 5:e224584
    [Google Scholar]
  53. 53.
    Inacio MC, Ake CF, Paxton EW et al. 2013. Sex and risk of hip implant failure: assessing total hip arthroplasty outcomes in the United States. JAMA Intern. Med. 173:435–41
    [Google Scholar]
  54. 54.
    Chen A, Paxton L, Zhen X et al. 2021. Association of sex with risk of 2-year revision among patients undergoing total hip arthroplasty. JAMA 4:e2110687
    [Google Scholar]
  55. 55.
    Musher DM, Rueda AM, Kaka AS, Mapara SM. 2007. The association between pneumococcal pneumonia and acute cardiac events. Clin. Infect. Dis. 45:158–65
    [Google Scholar]
  56. 56.
    Han H, Jain AK 2014. Age, gender and race estimation from unconstrained face images Tech. Rep., Dep. Comput. Sci. Eng., Mich. State Univ., East Lansing, MI: http://biometrics.cse.msu.edu/Publications/Face/HanJain_UnconstrainedAgeGenderRaceEstimation_MSUTechReport2014.pdf
    [Google Scholar]
  57. 57.
    Graves JL. 2018. Biological theories of race beyond the millennium. Reconsidering Race: Social Science Perspectives on Racial Categories in the Age of Genomics K Suzuki, D Von Vacano 21–31 New York: Oxford Univ. Press
    [Google Scholar]
  58. 58.
    Deyrup A, Graves JL Jr. 2022. Racial biology and medical misconceptions. N. Engl. J. Med. 386:501–3
    [Google Scholar]
  59. 59.
    Am. Assoc. Biol. Anthropol 2019. AABA statement on race and racism Position statement, Am. Assoc. Biol. Anthropol Herndon, VA: https://physanth.org/about/position-statements/aapa-statement-race-and-racism-2019/
    [Google Scholar]
  60. 60.
    Inker LA, Eneanya ND, Coresh J et al. 2021. New creatinine- and cystatin c-based equations to estimate GFR without race. N. Engl. J. Med. 385:1737–49
    [Google Scholar]
  61. 61.
    Grobman WA, Sandoval G, Murguia Rice M et al. 2021. Prediction of vaginal birth after cesarean delivery in term gestations: a calculator without race and ethnicity. Am. J. Obstet. Gynecol. 225:664e661–e667
    [Google Scholar]
  62. 62.
    Sorenson C, Drummond M. 2014. Improving medical device regulation: the United States and Europe in perspective. Milbank Q 92:114–50
    [Google Scholar]
  63. 63.
    Fox-Rawlings SR, Gottschalk LB, Doamekpor LA, Zuckerman DM. 2018. Diversity in medical device clinical trials: Do we know what works for which patients?. Milbank Q 96:499–529
    [Google Scholar]
  64. 64.
    FDA Pulse oximeters—premarket notification submissions [510(k)s]: guidance for industry and Food and Drug Administration staff Guidance, US Food Drug Adm. Silver Spring, MD: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/pulse-oximeters-premarket-notification-submissions-510ks-guidance-industry-and-food-and-drug
    [Google Scholar]
  65. 65.
    Okunlola OE, Lipnick MS, Batchelder PB et al. 2022. Pulse oximeter performance, racial inequity, and the work ahead. Respir. Care 67:252–57
    [Google Scholar]
  66. 66.
    Int. Med. Device Regulat. Forum 2014. “Software as a medical device”: possible framework for risk categorization and corresponding considerations https://www.imdrf.org/sites/default/files/docs/imdrf/final/technical/imdrf-tech-140918-samd-framework-risk-categorization-141013.pdf
    [Google Scholar]
  67. 67.
    Int. Med. Device Regulat. Forum 2017. Software as a medical device (SAMD): clinical evaluation. US Dep. Health Hum. Serv. Food Drug Adm. Cent. Devices Radiol. Health https://www.fda.gov/files/medical%20devices/published/Software-as-a-Medical-Device-%28SAMD%29--Clinical-Evaluation---Guidance-for-Industry-and-Food-and-Drug-Administration-Staff.pdf
    [Google Scholar]
  68. 68.
    Hardeman RR, Medina EM, Kozhimannil KB. 2016. Structural racism and supporting black lives—the role of health professionals. N. Engl. J. Med. 375:2113–15
    [Google Scholar]
  69. 69.
    Hammonds EM, Reverby SM. 2019. Toward a historically informed analysis of racial health disparities since 1619. Am. J. Public Health 109:1348–49
    [Google Scholar]
/content/journals/10.1146/annurev-med-043021-024004
Loading
/content/journals/10.1146/annurev-med-043021-024004
Loading

Data & Media loading...

  • Article Type: Review Article
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error