Research

Ai2's Bolmo byte-level language model research is published in Nature, with new checkpoints

Event: Oct 7, 2026 · Published: Oct 13, 2026

Ai2 said on October 7, 2026 that the research behind Bolmo, its family of fully open byte-level language models introduced the previous December, has been published in Nature. Ai2 writes that the paper applies the same "byteifying" process to Qwen 3 8B and Llama 3 8B to create two new byte-level models, Bwen 8B and Blama 8B, and that it is releasing new checkpoints, including Stage 1 checkpoints, on Hugging Face. The Bwen 8B model card describes it as Qwen3 8B Base retrofitted to operate over bytes instead of tokens and lists the Apache 2.0 license. USASI has not tested these models.1 2

Ai2 (Allen Institute for AI)

Sources

1.
Now in Nature: Retrofitting language models to operate over bytes (external site: allenai.org)
Ai2 · Announcement · published Oct 7, 2026 · accessed Oct 13, 2026
2.
allenai/Bwen-8B model card (external site: huggingface.co)
Ai2 (Hugging Face) · Model card · accessed Oct 13, 2026

Email a correction Report a correction Edit this entry

All news

Cite this page

APA style

USASI. (2026, October 13). Ai2's Bolmo byte-level language model research is published in Nature, with new checkpoints. United States of America Superintelligence. https://unitedstatesofamericasuperintelligence.com/news/ai2-bolmo-research-published-in-nature/

BibTeX

@misc{usasi_news_ai2_bolmo_research_published_in_nature,
  author = {{USASI}},
  title = {Ai2's Bolmo byte-level language model research is published in Nature, with new checkpoints},
  year = {2026},
  month = oct,
  howpublished = {\url{https://unitedstatesofamericasuperintelligence.com/news/ai2-bolmo-research-published-in-nature/}},
  note = {United States of America Superintelligence. Last updated 2026-10-13}
}

The date is when this page was last updated. Add the date you read it if your style needs one.

Related catalog entries

Sources

Share or cite this page

Support Us