Liam Fedus
On the Periodic Labs team; first author of Switch Transformers; in OpenAI o1 reasoning research leadership
- Listed under "Who we are" on the Periodic Labs homepage, Periodic Labs1
Liam Fedus is a machine learning researcher listed on the team of Periodic Labs, a company building AI models and autonomous laboratories for the physical sciences. At Google, Fedus was first author of Switch Transformers (2021), which simplifies mixture-of-experts routing to train large sparse language models efficiently. At OpenAI, the GPT-4 Technical Report credits Fedus as data flywheel lead, and the OpenAI o1 System Card lists Fedus in the reasoning research leadership.1234
Work
Switch Transformers (external site: arxiv.org)Published research
Equal-contribution first author, as William Fedus, of "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity" (2021), written with a Google affiliation.2
OpenAI o1 and GPT-4 (external site: arxiv.org)Proprietary product
Listed under reasoning research leadership in the OpenAI o1 System Card (2024) and credited as data flywheel lead in the GPT-4 Technical Report (2023).43
Other documented roles
Roles the sources document but that are not confirmed as current.
This profile covers public professional work only, from the sources below. It is not an endorsement or a ranking. To correct or remove it, use the correction form.