Beren Millidge
Co-founder and Chief Scientist of Zyphra; senior author of the Zamba, Zamba2 and Zamba2-VL reports
Beren Millidge is a co-founder of Zyphra, where Millidge's CV lists the role of Chief Scientist since July 2023 and Millidge's site says Millidge leads the company's technical teams. Millidge is the senior (last-listed) author of the technical reports for Zyphra's open-weight Zamba (2024), Zamba2 (2024) and Zamba2-VL (2026) hybrid state-space models. Before Zyphra, Millidge was a co-founder of Apollo Research, Head of Research at Conjecture, and a postdoctoral researcher in computational neuroscience at the University of Oxford.12345
Career
Millidge completed a PhD in machine learning and computational neuroscience at the University of Edinburgh (2017 to 2021) and then worked as a postdoctoral researcher at the University of Oxford with Rafal Bogacz on predictive coding and learning in the brain. Millidge was later a senior research scientist at Verses Research Lab and Head of Research at Conjecture, where the CV describes technical alignment research focused on interpretability of large language models.21
In 2023 Millidge was one of four co-founders of Apollo Research before leaving to start Zyphra, where Millidge has served as co-founder and Chief Scientist since July 2023.2
Research at Zyphra
At Zyphra, Millidge is the last-listed author on the Zamba (2024) and Zamba2 (2024) technical reports, which describe hybrid models that pair Mamba state-space blocks with shared attention layers. Millidge is also the senior author of the 2026 Zamba2-VL report, which extends the Zamba2 backbone to vision-language tasks.345
Millidge's CV also lists Zyphra work on BlackMamba, a mixture-of-experts state-space model, and on Tree Attention, a topology-aware decoding method for long-context attention on GPU clusters.2
Work
ZambaOpen weights
Senior author of the Zamba technical report, which describes a 7B model combining a Mamba backbone with a single shared attention module and releases its weights and checkpoints.36
Zamba2-7BOpen weights
Senior author of the Zamba2 suite technical report, which covers the 1.2B, 2.7B and 7.4B hybrid Mamba2-transformer models and their open weights.4
Zamba2-VL-7BOpen weights
Senior author of the Zamba2-VL technical report and release post for Zyphra's vision-language models built on the Zamba2 backbone at 1.2B, 2.7B and 7B parameters.57
Career timeline
2017
Began a PhD in machine learning and computational neuroscience at the University of Edinburgh.2
Apr 2021
Joined the University of Oxford as a postdoctoral researcher working with Rafal Bogacz.2
Sep 2022
Became Head of Research at Conjecture.2
May 2023
Co-founded Apollo Research as one of four co-founders.2
Jul 2023
Co-founded Zyphra and became its Chief Scientist.2
May 2024
Released the Zamba technical report as senior author.3
Nov 2024
Released the Zamba2 suite technical report as senior author.4
May 2026
Released the Zamba2-VL technical report as senior author.5
Other documented roles
Roles the sources document but that are not confirmed as current.
Related people
More sourced profiles at the same organization, in the same field, or from the same school.
- Krithik PuthalathAlso at Zyphra
- Akshita BhagiaLanguage models
- Aidan GomezAlso from Oxford
- Albert GuLanguage models
- Alexei A. EfrosAlso from Oxford
- Arthur MenschLanguage models
- Amanda AskellAlso from Oxford
- Barret ZophLanguage models
- Andrea VedaldiAlso from Oxford
- Bryan CatanzaroLanguage models
- Azeem AzharAlso from Oxford
- Ce ZhangTraining systems
Is this you?
Profiles cover public professional work only, and every line cites a source. If something is out of date, missing or wrong, send a correction with a link to an official page and we will update it. Suggest a correction
Add this badge to your website or GitHub profile README. It links back to this page. It is not an endorsement or a rating.
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/people/beren-millidge/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/people/beren-millidge/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/profile.svg" alt="Beren Millidge — Profile on USASI" height="20"></a>
This profile covers public professional work only, from the sources below. It is not an endorsement or a ranking. To correct or remove it, use the correction form.