Tülu
Family overview — summarizes releases; licenses and availability belong to each release.
Maintained by Ai2 (Allen Institute for AI)15
Tülu is Ai2's line of instruction-following models together with the open post-training recipe used to produce them. Tülu 3 (November 2024) applied supervised fine-tuning, Direct Preference Optimization, and reinforcement learning with verifiable rewards (RLVR) to Meta's Llama 3.1 base models at 8B and 70B, followed by a 405B model in January 2025 and by Tülu 3.1 8B, which changed only the final RL stage (from PPO to GRPO).12345
- Website: Tülu project page (external site: allenai.org)
- Paper: Tülu 3 technical report (arXiv 2411.15124) (external site: arxiv.org)
- Repository: open-instruct post-training code (external site: github.com)
- Release notes: Tülu 3 announcement (external site: allenai.org)
Releases assessed
| Release | Weights | Tier (USASI rubric v0.1) | License | Released |
|---|---|---|---|---|
| Llama 3.1 Tülu 3.1 8B | Weights: Public | Model-disclosure tier (USASI rubric v0.1): Open-stack | Llama 3.1 Community License Agreement, Apache-2.0 | Unknown |
What it is useful for
Organization context
Provenance and derivatives
The Tülu 3 models are post-trained from Meta's Llama 3.1 base models (8B, 70B, and 405B); the Tülu cards state that the size and composition of the Llama 3.1 pretraining corpus is unknown. Ai2 supplies the post-training data (the Tülu 3 SFT mixture, preference mixtures, and RLVR prompts), code, and recipe.265
- Derived from: Llama 3.1 base models (Meta) — Base models for Tülu 3 at 8B, 70B, and 405B.
U.S. eligibility
Eligible · basis: U.S. nonprofit or lab
The Tülu models and recipe are developed and released by Ai2 (Allen Institute for AI), which describes itself as a Seattle-based non-profit AI research institute. The Tülu 3 models are fine-tunes of Meta's Llama 3.1 base models; the base models are recorded as provenance. Eligibility of each release is assessed on the release record.157
Sources
This listing is not an endorsement, a safety assessment, or a federal approval.