Transformer-based biomarker prediction from colorectal cancer histology: A large-scale multicentric study
Helmholtz Zentrum München · Fresenius (Germany) · +38 more institutions
Abstract
Deep learning (DL) can accelerate the prediction of prognostic biomarkers from routine pathology slides in colorectal cancer (CRC). However, current approaches rely on convolutional neural networks (CNNs) and have mostly been validated on small patient cohorts. Here, we develop a new transformer-based pipeline for end-to-end biomarker prediction from pathology slides by combining a pre-trained transformer encoder with a transformer network for patch aggregation. Our transformer-based approach substantially improves the performance, generalizability, data efficiency, and interpretability as compared with current state-of-the-art algorithms. After training and evaluating on a large multicenter cohort of over…
Citation impact
- FWCI
- 51.36
- Percentile
- 100%
- References
- 78
Authors
68- SJSophia J. WagnerCorresponding
Helmholtz Zentrum München, Fresenius (Germany), Technical University of Munich
- DRDaniel Reisenbüchler
Center for Environmental Health, Helmholtz Zentrum München
- NPNicholas P. West
Johannes Gutenberg University Mainz, University Medical Center of the Johannes Gutenberg University Mainz
- JNJan Niehues
Fresenius (Germany)
- JZJiefu Zhu
Fresenius (Germany)
Topics & keywords
- Interpretability
- Generalizability theory
- Computer science
- Colorectal cancer
- Medicine
- Microsatellite instability
- Deep learning
- Artificial intelligence
Funding
- BRBaton Rouge Area Foundation
- AAmgen
- PFPreeclampsia FoundationAward: F-87701-41-01
- RRoche
- CDConnecticut Department of Energy and Environmental ProtectionAward: ZMVI1-2520DAT111
- JHJoachim Herz Stiftung
- YCYorkshire Cancer Research
- CRCancer Research UKAwards: A25142, C6716/A13941, C551/A8283, C6716/A9894, C26642/A27963
- NINational Institute for Health and Care ResearchAward: 14/140/84
- DODepartment of Health and Social Care
- ECEuropean CommissionAwards: 101096312, 101057091; GENIAL, 101057091
- RTRosetrees Trust
- MOMinistry of Science and Innovation, New Zealand
- FEFriedrich-Alexander-Universität Erlangen-Nürnberg
- DADeutscher Akademischer AustauschdienstAwards: 57616814, SECAI, 57616814
- DFDeutsche ForschungsgemeinschaftAwards: BR 1704/6-3, HE 5998/2-, BR 1704/6-4, BR 1704/17-2, FO 942/2-1, RO 2270/8-1, HE 5998/2-2, KL 2354/3-1, BR 1704/6-1, BR 1704/17-1, HE 5998/2-1, HO 5117/2-1, RO 2270/8-, KL 2354/3-2, CH 117/1-1, 01ER1505A, RO 2270/8-2, HO 5117/2-2, BR 1704/6-1, BR 1704/6-3, BR 1704/6-4, BR 1704/6-1, BR 1704/6-3, BR 1704/6-4, CH 117/1-1
- BFBundesministerium für Bildung und ForschungAwards: 01KH0404, 01ER0814, 01ER0815, 01ER1505A and 01ER1505B, 01KD2215A; TRANSFORM LIVER, 01KD2104A, 01KD2215A, 01EO2101, 01ER1505A, 01VSF21048, 01ER0814, 01ER0815, SWAG, 01KD2215A, 57616814, TRANSFORM LIVER, 031L0312A, 01KD2104C, 031L0312A, 01EO2101; SWAG, 01KH0404
- CCancerfonden
- BFBundesministerium für GesundheitAwards: ZMVI1-2520DAT111, 2520DAT111, DEEP LIVER, ZMVI1-2520DAT111
- NONederlandse Organisatie voor Wetenschappelijk OnderzoekAwards: 184.021.007, NWO 184.021.007
- KKKWF KankerbestrijdingAwards: KWF 11044, 11044
- DKDeutsche KrebshilfeAwards: 70113864, 2520DAT111
- HAHelmholtz Association
- IZInterdisziplinäres Zentrum für Klinische Forschung, Universitätsklinikum Würzburg
- GBGemeinsame BundesausschussAward: 01VSF21048
- NINational Institutes of HealthAwards: 184.021.007, R01 CA263318, NIH R01
- IEImperial Experimental Cancer Medicine Centre
- HEHORIZON EUROPE Framework ProgrammeAward: 101057091
- MRMedical Research CouncilAward: G0601705
- NINIHR Imperial Biomedical Research Centre
- LBLeeds Biomedical Research Centre