Integrated image-based deep learning and language models for primary diabetes care
Shanghai Jiao Tong University · Shanghai Sixth People's Hospital · +48 more institutions
Abstract
Primary diabetes care and diabetic retinopathy (DR) screening persist as major public health challenges due to a shortage of trained primary care physicians (PCPs), particularly in low-resource settings. Here, to bridge the gaps, we developed an integrated image-language system (DeepDR-LLM), combining a large language model (LLM module) and image-based deep learning (DeepDR-Transformer), to provide individualized diabetes management recommendations to PCPs. In a retrospective evaluation, the LLM module demonstrated comparable performance to PCPs and endocrinology residents when tested in English and outperformed PCPs and had comparable performance to endocrinology residents in Chinese. For identifying…
Citation impact
- FWCI
- 73.63
- Percentile
- 100%
- References
- 71
Authors
93Topics & keywords
- Medicine
- Primary care
- Referral
- Diabetes mellitus
- Diabetes management
- Economic shortage
- Family medicine
- Type 2 diabetes
Funding
- JHJohns Hopkins University
- SMShanghai Municipal Health Commission
- SESingapore Eye Research Institute
- SGSingapore General Hospital
- NNNational Natural Science Foundation of ChinaAwards: SHSMU-ZDCX20212700, 62272298, 82388101, 92357305, 2021SHZDZX0102
- SYSun Yat-sen UniversityAward: 92357305
- CMCapital Medical University
- AMAnhui Medical University
- FUFudan University
- TUTongji University
- UMUniversiti Malaya
- NUNingbo University
- MOMinistry of Education, India
- CUChinese University of Hong Kong
- SJShanghai Jiao Tong University
- RURangsit University
- SKState Key Laboratory of Ophthalmology
- SOSchool of Medicine, Duke University
- SOSchool of Medicine, Shanghai Jiao Tong University
- MRMajor Research Plan
- YSYoung Scientists Fund
- NKNational Key Research and Development Program of ChinaAwards: 2022YFA1004804, 2022YFC2502800
- NCNIH Clinical Center