Vision–language foundation model for echocardiogram interpretation

The development of robust artificial intelligence models for echocardiography has been limited by the availability of annotated clinical data. Here, to address this challenge and improve the performance of cardiac imaging models, we developed EchoCLIP, a vision-language foundation model for echocardiography, that learns the relationship between cardiac ultrasound images and the interpretations of expert cardiologists across a wide range of patients and indications for imaging. After training on 1,032,975 cardiac ultrasound videos and corresponding expert text, EchoCLIP performs well on a diverse range of benchmarks for cardiac image interpretation, despite not having been explicitly trained for individual…

• CM
  Cedars-Sinai Medical Center
• NI
  National Institutes of Health
• NH
  National Heart, Lung, and Blood Institute

  Awards: 4R00HL157421-03, R00HL157421