Jacob Steinhardt
UC Berkeley associate professor of Statistics and EECS; founder and CEO of the nonprofit lab Transluce
- Associate Professor of Statistics and EECS, University of California, Berkeley1
- Founder & CEO, Transluce12
Jacob Steinhardt is an Associate Professor of Statistics and EECS at UC Berkeley, part of BAIR and CLIMB, and the Founder and CEO of Transluce, a nonprofit research lab building open technology for understanding frontier AI systems. Steinhardt's research focuses on ensuring machine learning systems are understood by and aligned with humans, including work on models' latent activations and on systems that summarize large datasets in natural language. Steinhardt co-authored the MMLU benchmark paper and the indirect object identification circuit study in GPT-2 small, and spent a postdoc year at OpenAI and Open Philanthropy.1234
Work
Measuring Massive Multitask Language Understanding (MMLU) (external site: arxiv.org)Published research
Last-listed author of the 2020 paper proposing a test of a text model's multitask accuracy across 57 tasks, including elementary mathematics and law.3
Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small (external site: arxiv.org)Published research
Last-listed author of the 2022 paper explaining how GPT-2 small performs indirect object identification in terms of groups of attention heads.4
Transluce (external site: transluce.org)
Founder and CEO of Transluce, which describes itself as a non-profit research lab building the public tech stack for scalable oversight of AI.12
Earlier roles
This profile covers public professional work only, from the sources below. It is not an endorsement or a ranking. To correct or remove it, use the correction form.