A multimodal whole-slide foundation model for pathology
Broad Institute · Harvard University · +19 more institutions
Abstract
The field of computational pathology has been transformed with recent advances in foundation models that encode histopathology region-of-interests (ROIs) into versatile and transferable feature representations via self-supervised learning. However, translating these advancements to address complex clinical challenges at the patient and slide level remains constrained by limited clinical data in disease-specific cohorts, especially for rare clinical conditions. We propose Transformer-based pathology Image and Text Alignment Network (TITAN), a multimodal whole-slide foundation model pretrained using 335,645 whole-slide images via visual self-supervised learning and vision-language alignment with corresponding…
Citation impact
- FWCI
- 104.81
- Percentile
- 100%
- References
- 108
Authors
29- TDTong DingCorresponding
Broad Institute, Harvard University, Dana-Farber Cancer Institute, Mass General Brigham
- SJSophia J. Wagner
Harvard University, Center for Environmental Health, Helmholtz Zentrum München, Mass General Brigham, Technical University of Munich
- AHAndrew H. Song
Broad Institute, Harvard University, Dana-Farber Cancer Institute, Mass General Brigham
- RJRichard J. Chen
Broad Institute, Harvard University, Dana-Farber Cancer Institute, Mass General Brigham
- MYMing Y. Lu
Broad Institute, Harvard University, Dana-Farber Cancer Institute, Mass General Brigham, Massachusetts Institute of Technology
Topics & keywords
- Foundation (evidence)
- Digital pathology
- Feature (linguistics)
- Deep learning
- Generative grammar
- Titan (rocket family)
- Clinical science
- Field (mathematics)