GPT-NeoX-20B: An Open-Source Autoregressive Language Model

Black, Sidney; Biderman, Stella; Hallahan, Eric; Anthony, Quentin; Gao, Leo; Golding, Laurence; He, Horace; Leahy, Connor; McDonell, Kyle; Phang, Jason; Pieler, Michael; Prashanth, USVSN Sai; Purohit, Shivanshu; Reynolds, Laria; Tow, Jonathan; Wang, Ben; Weinbach, Samuel

doi:10.18653/v1/2022.bigscience-1.9

articleJan 1, 2022GOLD OA

GPT-NeoX-20B: An Open-Source Autoregressive Language Model

SBSidney Black SBStella Biderman EHEric Hallahan QAQuentin Anthony LGLeo Gao

Machine Intelligence Research Labs

Indexed incrossref

Abstract

Sidney Black, Stella Biderman, Eric Hallahan, Quentin Anthony, Leo Gao, Laurence Golding, Horace He, Connor Leahy, Kyle McDonell, Jason Phang, Michael Pieler, Usvsn Sai Prashanth, Shivanshu Purohit, Laria Reynolds, Jonathan Tow, Ben Wang, Samuel Weinbach. Proceedings of BigScience Episode #5 -- Workshop on Challenges & Perspectives in Creating Large Language Models. 2022.

Citation impact

388

total citations

FWCI: 52.46
Percentile: 100%
References: 31

Citations per year

Authors

17

Topics & keywords

Topics

Topic Modeling95%

Keywords

STELLA (programming language)
Open source
Computer science
Art history
Art
Programming language

UN Sustainable Development Goals

Quality Education

No related works found for this paper.