EleutherAI is founded: a community to replicate GPT-3 in the open
In one sentence Connor Leahy, Sid Black, and Leo Gao found EleutherAI on Discord with the goal of replicating GPT-3 and releasing models, code, and datasets in the open, kicking off projects like GPT-Neo, GPT-J, and The Pile.
OpenAI releases GPT-3 as a closed, paid API only. A group of independent researchers decides this isn't enough: they want large models, but open, so anyone can download, study, and improve them.
They organize in an unusual way: no company, no office, just a Discord server. A few months in, hundreds of volunteer researchers are involved, and they start building a huge free-text dataset (The Pile) and writing code to train an open GPT-3.
The concrete result will come the next year with GPT-Neo and GPT-J, but a new AI-research model starts here: open, decentralized, community-driven.
Companies
EleutherAI
Tools
GPT-Neo
Tags
Sources