Using ChatGPT to evaluate cancer myths and misconceptions: artificial intelligence and cancer information
University of Utah · Huntsman Cancer Institute · +7 more institutions
Abstract
Data about the quality of cancer information that chatbots and other artificial intelligence systems provide are limited. Here, we evaluate the accuracy of cancer information on ChatGPT compared with the National Cancer Institute's (NCI's) answers by using the questions on the "Common Cancer Myths and Misconceptions" web page. The NCI's answers and ChatGPT answers to each question were blinded, and then evaluated for accuracy (accurate: yes vs no). Ratings were evaluated independently for each question, and then compared between the blinded NCI and ChatGPT answers. Additionally, word count and Flesch-Kincaid readability grade level for each individual response were evaluated. Following expert review, the…
Citation impact
- FWCI
- 10.48
- Percentile
- 100%
- References
- 6
Authors
6- SBSkyler B. JohnsonCorresponding
University of Utah, Huntsman Cancer Institute
- AJAndy J. King
University of Utah, Huntsman Cancer Institute
- ELEcho L. Warner
University of Utah, Huntsman Cancer Institute
- SASanjay Aneja
Yale University
- BHBenjamin H. Kann
Brigham and Women's Hospital, Harvard University, Dana-Farber Cancer Institute, Dana-Farber Brigham Cancer Center
Topics & keywords
- Readability
- Medicine
- Cancer
- Mythology
- Artificial intelligence
- Questions and answers
- Medical physics
- Natural language processing
- Quality Education