Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference

Warner, Benjamin C.; Chaffin, Antoine; Clavié, Benjamin; Weller, Orion; Hallström, Oskar; Taghadouini, Said; Gallagher, Alexis; Biswas, Raja; Ladhak, Faisal; Aarsen, Tom; Adams, Griffin; Howard, Jeremy; Poli, Iacopo

doi:10.18653/v1/2025.acl-long.127

articleJan 1, 2025GOLD OA

Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference

BCBenjamin C. Warner ACAntoine Chaffin BCBenjamin Clavié OWOrion Weller OHOskar Hallström

Indexed incrossref

Abstract

Benjamin Warner, Antoine Chaffin, Benjamin Clavié, Orion Weller, Oskar Hallström, Said Taghadouini, Alexis Gallagher, Raja Biswas, Faisal Ladhak, Tom Aarsen, Griffin Thomas Adams, Jeremy Howard, Iacopo Poli. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.

Citation impact

115

total citations

FWCI: 115.50
Percentile: 100%
References: 0

Citations per year

Authors

13

Topics & keywords

Topics

Keywords

Computer science
Inference
Context (archaeology)
Encoder
Parallel computing
Artificial intelligence
Operating system

No related works found for this paper.