RWKV: Reinventing RNNs for the Transformer Era

Peng, Bo; Alcaide, Eric; Anthony, Quentin; Albalak, Alon; Arcadinho, Samuel; Biderman, Stella; Cao, Huanqi; Cheng, Xin; Chung, Michael; Derczynski, Leon; Du, Xingjian; Grella, Matteo; GV, Kranthi Kiran; He, Xuzheng; Hou, Haowen; Kazienko, Przemysław; Kocoń, Jan; Kong, Jiaming; Koptyra, Bartłomiej; Lau, H.C.W.; Lin, Jiaju; Mantri, Krishna Sri Ipsit; Mom, Ferdinand; Saito, Atsushi; Song, Guangyu; Tang, Xiangru; Wind, Johan S.; Woźniak, Stanisław; Zhang, Zhenyuan; Zhou, Qinghua; Zhu, Jian; Zhu, Ruijie

doi:10.18653/v1/2023.findings-emnlp.936

articleJan 1, 2023GOLD OA

RWKV: Reinventing RNNs for the Transformer Era

BPBo Peng EAEric Alcaide QAQuentin Anthony AAAlon Albalak SASamuel Arcadinho

Universitat de Barcelona · State Library of Ohio · +9 more institutions

Indexed incrossref

Abstract

Bo Peng, Eric Alcaide, Quentin Anthony, Alon Albalak, Samuel Arcadinho, Stella Biderman, Huanqi Cao, Xin Cheng, Michael Chung, Leon Derczynski, Xingjian Du, Matteo Grella, Kranthi Gv, Xuzheng He, Haowen Hou, Przemyslaw Kazienko, Jan Kocon, Jiaming Kong, Bartłomiej Koptyra, Hayden Lau, Jiaju Lin, Krishna Sri Ipsit Mantri, Ferdinand Mom, Atsushi Saito, Guangyu Song, Xiangru Tang, Johan Wind, Stanisław Woźniak, Zhenyuan Zhang, Qinghua Zhou, Jian Zhu, Rui-Jie Zhu. Findings of the Association for Computational Linguistics: EMNLP 2023. 2023.

Citation impact

298

total citations

FWCI: 49.25
Percentile: 100%
References: 63

Citations per year

Authors

32

Topics & keywords

Topics

Natural Language Processing Techniques96%

Keywords

STELLA (programming language)
Zhàng
Art history
Art
Humanities
Philosophy
History
Archaeology

UN Sustainable Development Goals

Quality Education

No related works found for this paper.