Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes

Hsieh, Cheng-Yu; Li, Chunliang; Yeh, Chih‐Kuan; Nakhost, Hootan; Fujii, Yasuhisa; Ratner, Alex; Krishna, Ranjay; Lee, Chen-Yu; Pfister, Tomas

doi:10.18653/v1/2023.findings-acl.507

articleJan 1, 2023GOLD OA

Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes

CHCheng-Yu Hsieh CLChunliang Li CYChih‐Kuan Yeh HNHootan Nakhost YFYasuhisa Fujii

University of Washington · Google (United States)

Indexed incrossref

Abstract

Cheng-Yu Hsieh, Chun-Liang Li, Chih-kuan Yeh, Hootan Nakhost, Yasuhisa Fujii, Alex Ratner, Ranjay Krishna, Chen-Yu Lee, Tomas Pfister. Findings of the Association for Computational Linguistics: ACL 2023. 2023.

Citation impact

242

total citations

FWCI: 40.43
Percentile: 100%
References: 51

Citations per year

Authors

9

Topics & keywords

Topics

Keywords

Chen
Association (psychology)
Computer science
Natural language processing
Artificial intelligence
Data modeling
Computational linguistics
Algorithm

UN Sustainable Development Goals

Quality Education

No related works found for this paper.