Reliability of Medical Information Provided by ChatGPT: Assessment Against Clinical Guidelines and Patient Information Quality Instrument

Walker, Harriet Louise; Ghani, Shahi; Kuemmerli, Christoph; Nebiker, Christian A.; Müller‐Stich, Beat P.; Raptis, Dimitri Aristotle; Staubli, Sebastian M.

doi:10.2196/47479

articleJournal of Medical Internet ResearchJun 15, 2023GOLD OA

Reliability of Medical Information Provided by ChatGPT: Assessment Against Clinical Guidelines and Patient Information Quality Instrument

HLHarriet Louise Walker SGShahi Ghani CKChristoph Kuemmerli CAChristian A. Nebiker BPBeat P. Müller‐Stich

Royal Free London NHS Foundation Trust · University Hospital of Basel · +2 more institutions

PubMed

Indexed incrossrefdoajpubmed

Abstract

Background

ChatGPT-4 is the latest release of a novel artificial intelligence (AI) chatbot able to answer freely formulated and complex questions. In the near future, ChatGPT could become the new standard for health care professionals and patients to access medical information. However, little is known about the quality of medical information provided by the AI.

Objective

We aimed to assess the reliability of medical information provided by ChatGPT.

Citation impact

332

total citations

FWCI: 12.04
Percentile: 100%
References: 24

Citations per year

Authors

7

Topics & keywords

Topics

Keywords

Medicine
Inter-rater reliability
Reliability (semiconductor)
Information quality
Medical physics
Guideline
Health information
Family medicine

No related works found for this paper.