Navigating the landscape of multimodal AI in medicine: A scoping review on technical challenges and clinical applications
Radboud University Nijmegen · Radboud University Medical Center · +4 more institutions
Abstract
Recent technological advances in healthcare have led to unprecedented growth in patient data quantity and diversity. While artificial intelligence (AI) models have shown promising results in analyzing individual data modalities, there is increasing recognition that models integrating multiple complementary data sources, so-called multimodal AI, could enhance clinical decision-making. This scoping review examines the landscape of deep learning-based multimodal AI applications across the medical domain, analyzing 432 papers published between 2018 and 2024. We provide an extensive overview of multimodal AI development across different medical disciplines, examining various architectural approaches, fusion…
Citation impact
- FWCI
- 32.69
- Percentile
- 100%
- References
- 140
Authors
8- DSDaan SchoutenCorresponding
Radboud University Nijmegen, Radboud University Medical Center, Radboud Institute for Molecular Life Sciences
- GNGiulia Nicoletti
Department of Medical Sciences
- BDBas Dille
Radboud University Nijmegen, Erasmus MC, Radboud University Medical Center
- CMCatherine M. Chia
Radboud University Nijmegen, Erasmus MC, Radboud University Medical Center
- PVPierpaolo Vendittelli
Radboud University Nijmegen, Radboud University Medical Center
Topics & keywords
- Computer science
- Artificial intelligence
- Field (mathematics)
- Modalities
- Multimodal learning
- Data science
- Deep learning
- Key (lock)