Large language models propagate race-based medicine

Large language models (LLMs) are being integrated into healthcare systems; but these models may recapitulate harmful, race-based medicine. The objective of this study is to assess whether four commercially available large language models (LLMs) propagate harmful, inaccurate, race-based content when responding to eight different scenarios that check for race-based medicine or widespread misconceptions around race. Questions were derived from discussions among four physician experts and prior work on race-based medical misconceptions believed by medical trainees. We assessed four large language models with nine different questions that were interrogated five times each with a total of 45 responses per model. All…

• MS
  Memorial Sloan-Kettering Cancer Center

  Award: CA008748
• NI
  National Institutes of Health

  Award: P30 CA008748
• NC
  National Cancer Institute

  Awards: U24CA264369, CA008748, P30 CA008748