articleJMIR Medical EducationJun 14, 2023GOLD OA

Performance of GPT-3.5 and GPT-4 on the Japanese Medical Licensing Examination: Comparison Study

Shimane University · University of Michigan · +2 more institutions

PubMed
Indexed incrossrefdoajpubmed

Abstract

Background

The competence of ChatGPT (Chat Generative Pre-Trained Transformer) in non-English languages is not well studied.

Objective

This study compared the performances of GPT-3.5 (Generative Pre-trained Transformer) and GPT-4 on the Japanese Medical Licensing Examination (JMLE) to evaluate the reliability of these models for clinical reasoning and medical knowledge in non-English languages.

Citation impact

288
total citations
FWCI
10.41
Percentile
100%
References
21
Citations per year

Authors

4

Topics & keywords

Keywords
  • Transformer
  • Competence (human resources)
  • Generative grammar
  • Computer science
  • Psychology
  • Medical education
  • Internal medicine
  • Artificial intelligence
UN Sustainable Development Goals
  • Quality Education
No related works found for this paper.

Funding