Sid Black
Lead developer of GPT-NeoX-20B; co-founder of EleutherAI and Conjecture; co-author of The Pile
Sid Black co-founded EleutherAI in 2020 with Connor Leahy and co-founded Conjecture in March 2022, according to Conjecture's history page. Black is first author of the GPT-NeoX-20B paper, whose contributions appendix names Black as the lead developer and overall point person for the project, with credits for training infrastructure, scaling experiments, positional embeddings, and the tokenizer. Black is also a co-author of The Pile and is listed in the citation entries for both the GPT-NeoX library and the LM Evaluation Harness.12345
Work
GPT-NeoX and GPT-NeoX-20BOpen-source code
First author of the GPT-NeoX-20B paper; Appendix A names Black the lead developer and overall point person, credited with training infrastructure, scaling experiments and optimization, positional embeddings, the tokenizer, and evaluations. Black is also listed in the citation entry for the Apache-2.0 GPT-NeoX library.24
The PilePublished research
Listed as the third author of The Pile paper (2020), which introduced an 825 GiB English text corpus for training large language models.3
LM Evaluation HarnessOpen-source code
Listed among the authors in the project's citation entry for the evaluation framework.5
Other documented roles
Roles the sources document but that are not confirmed as current.
- Co-founder (2020), EleutherAI1
- Co-founder (founded March 2022), Conjecture1
This profile covers public professional work only, from the sources below. It is not an endorsement or a ranking. To correct or remove it, use the correction form.