Dissecting racial bias in an algorithm used to manage the health of populations
- PMID: 31649194
- DOI: 10.1126/science.aax2342
Dissecting racial bias in an algorithm used to manage the health of populations
Abstract
Health systems rely on commercial prediction algorithms to identify and help patients with complex health needs. We show that a widely used algorithm, typical of this industry-wide approach and affecting millions of patients, exhibits significant racial bias: At a given risk score, Black patients are considerably sicker than White patients, as evidenced by signs of uncontrolled illnesses. Remedying this disparity would increase the percentage of Black patients receiving additional help from 17.7 to 46.5%. The bias arises because the algorithm predicts health care costs rather than illness, but unequal access to care means that we spend less money caring for Black patients than for White patients. Thus, despite health care cost appearing to be an effective proxy for health by some measures of predictive accuracy, large racial biases arise. We suggest that the choice of convenient, seemingly effective proxies for ground truth can be an important source of algorithmic bias in many contexts.
Copyright © 2019 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works.
Comment in
-
Assessing risk, automating racism.Science. 2019 Oct 25;366(6464):421-422. doi: 10.1126/science.aaz3873. Science. 2019. PMID: 31649182 No abstract available.
-
Millions of black people affected by racial bias in health-care algorithms.Nature. 2019 Oct;574(7780):608-609. doi: 10.1038/d41586-019-03228-6. Nature. 2019. PMID: 31664201 No abstract available.
-
SARS-CoV-2- Impfung: Wenn Algorithmen entscheiden ….MMW Fortschr Med. 2021 Feb;163(2):19. doi: 10.1007/s15006-021-9574-7. MMW Fortschr Med. 2021. PMID: 33527271 Free PMC article. German. No abstract available.
Similar articles
-
Actual Racial/Ethnic Disparities in COVID-19 Mortality for the Non-Hispanic Black Compared to Non-Hispanic White Population in 35 US States and Their Association with Structural Racism.J Racial Ethn Health Disparities. 2022 Jun;9(3):886-898. doi: 10.1007/s40615-021-01028-1. Epub 2021 Apr 27. J Racial Ethn Health Disparities. 2022. PMID: 33905110 Free PMC article.
-
Actual Racial/Ethnic Disparities in COVID-19 Mortality for the Non-Hispanic Black Compared to Non-Hispanic White Population in 353 US Counties and Their Association with Structural Racism.J Racial Ethn Health Disparities. 2022 Oct;9(5):1697-1725. doi: 10.1007/s40615-021-01109-1. Epub 2021 Aug 30. J Racial Ethn Health Disparities. 2022. PMID: 34462902 Free PMC article.
-
Separate and unequal: Structural racism and infant mortality in the US.Health Place. 2017 May;45:140-144. doi: 10.1016/j.healthplace.2017.03.012. Epub 2017 Mar 28. Health Place. 2017. PMID: 28363132
-
Racial disparities in coronary heart disease: a sociological view of the medical literature on physician bias.Ethn Dis. 2004 Summer;14(3):360-71. Ethn Dis. 2004. PMID: 15328937 Review.
-
A Systematic Review of the Impact of Physician Implicit Racial Bias on Clinical Decision Making.Acad Emerg Med. 2017 Aug;24(8):895-904. doi: 10.1111/acem.13214. Epub 2017 Jun 19. Acad Emerg Med. 2017. PMID: 28472533 Review.
Cited by
-
From theory to practice: Harmonizing taxonomies of trustworthy AI.Health Policy Open. 2024 Sep 5;7:100128. doi: 10.1016/j.hpopen.2024.100128. eCollection 2024 Dec 15. Health Policy Open. 2024. PMID: 39497918 Free PMC article.
-
Learning and diSentangling patient static information from time-series Electronic hEalth Records (STEER).PLOS Digit Health. 2024 Oct 21;3(10):e0000640. doi: 10.1371/journal.pdig.0000640. eCollection 2024 Oct. PLOS Digit Health. 2024. PMID: 39432484 Free PMC article.
-
Artificial General Intelligence for the Detection of Neurodegenerative Disorders.Sensors (Basel). 2024 Oct 16;24(20):6658. doi: 10.3390/s24206658. Sensors (Basel). 2024. PMID: 39460138 Free PMC article. Review.
-
Ensuring that biomedical AI benefits diverse populations.EBioMedicine. 2021 May;67:103358. doi: 10.1016/j.ebiom.2021.103358. Epub 2021 May 4. EBioMedicine. 2021. PMID: 33962897 Free PMC article. Review.
-
Equity in essence: a call for operationalising fairness in machine learning for healthcare.BMJ Health Care Inform. 2021 Apr;28(1):e100289. doi: 10.1136/bmjhci-2020-100289. BMJ Health Care Inform. 2021. PMID: 33910923 Free PMC article. No abstract available.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical