articleNature CancerJun 6, 2025HYBRID OA

Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology

DFDyke FerberOSOmar S. M. El NahhasGWGeorg WölfleinICIsabella C. WiestJCJan Clusmann

Heidelberg University · University Hospital Heidelberg · +15 more institutions

PubMed
Indexed incrossrefpubmed

Abstract

Clinical decision-making in oncology is complex, requiring the integration of multimodal data and multidomain expertise. We developed and evaluated an autonomous clinical artificial intelligence (AI) agent leveraging GPT-4 with multimodal precision oncology tools to support personalized clinical decision-making. The system incorporates vision transformers for detecting microsatellite instability and KRAS and BRAF mutations from histopathology slides, MedSAM for radiological image segmentation and web-based search tools such as OncoKB, PubMed and Google. Evaluated on 20 realistic multimodal patient cases, the AI agent autonomously used appropriate tools with 87.5% accuracy, reached correct clinical conclusions…

Citation impact

94
total citations
FWCI
103.76
Percentile
100%
References
57
Citations per year

Authors

14

Topics & keywords

Topics
Keywords
  • Artificial intelligence
  • Clinical decision making
  • Computer science
  • KRAS
  • Precision oncology
  • Clinical microbiology
  • Medical physics
  • Precision medicine
UN Sustainable Development Goals
  • Peace, Justice and strong institutions
No related works found for this paper.

Funding