Model release

Zamba2-7B

Zamba2-7B is an open-weight model release in the Zamba family from Zyphra1 2, version Zamba2-7B, released Oct 14, 2024. Its weights can be downloaded by the public1 8 9 under the Apache License 2.01 3.

The 7B base model in Zyphra's Zamba2 series, announced in October 2024. It interleaves Mamba2 blocks with two shared attention blocks in an alternating pattern and adds LoRA projectors to the shared MLP blocks so that each shared block can specialize by depth.2 1

Model hub: Model card (Hugging Face) (external site: huggingface.co)
Release notes: Zamba2-7B announcement (external site: zyphra.com)
Repository: Zamba2 standalone PyTorch implementation (external site: github.com)
Documentation: Zamba2 in Hugging Face Transformers (external site: huggingface.co)

On AI on Hugging Face: Zyphra/Zamba2-7B

Last reviewedSep 29, 2026Entry updated Sep 29, 2026Documented release Oct 14, 2024

Availability and license

Overall availability

Public

The Hugging Face repository is gated: users must agree to share their contact information before they can access the files. The Hugging Face metadata lists the gating mode as automatic approval, under which access is granted as soon as the request is sent.1 8 9

Availability fact review: not separately recorded

Availability is separate from permission: read the license before using or redistributing.

Apache License 2.0 (external site: huggingface.co)1 3
Applies to: Weights · SPDX Apache-2.0 · on the rubric’s OSI-approved software-license list · fact-level rights review not recorded
Plain-language guide to the Apache License 2.0
Apache License 2.0 (Zamba2 PyTorch implementation) (external site: raw.githubusercontent.com)5
Applies to: Code · SPDX Apache-2.0 · on the rubric’s OSI-approved software-license list · fact-level rights review not recorded
Plain-language guide to the Apache License 2.0

Component reuse rights

A readable or downloadable component is not automatically reusable. These indicators concern recorded license evidence, not system certification.

weights: Unknown — no complete fact-level rights review
code: Unknown — no complete fact-level rights review
data: Unknown — no complete fact-level rights review
documentation: Unknown — no complete fact-level rights review

No complete system-rights review is recorded for this release.

Model-disclosure tier

Computed from the checklist below using USASI rubric v0.2. An editorial category, not a certification.

Open-weight

The model parameters for this release can be downloaded by the public. License terms may still restrict use, redistribution, or commercial use.

How tiers are computed

Public materials checklist

Items for a model under USASI rubric v0.2. Unknown means unassessed or insufficient evidence.

Public materials checklist for Zamba2-7B
Item	Status	Notes and evidence
WeightsCan the general public download the model parameters for this release?	Public	Downloadable from Hugging Face after agreeing to share contact information; access is approved automatically.1 8 9
Inference codeIs code for running the model published?	Public	Supported in Hugging Face Transformers from version 4.48.0; Zyphra also publishes a standalone PyTorch implementation of the Zamba2 models on GitHub.3 4 2
Training codeIs the code used to train the model published?	Unknown	Zyphra's announcement says training used an internal framework built on Megatron-LM; this catalog found no public release of that framework.2
Training-data informationDoes the information cover provenance, scope, acquisition, selection, labeling, processing, and where data or alternatives can be obtained? Access alone does not establish completeness.	Unknown	Not assessed.
Training-data accessCan the training data be obtained? This is independent of information completeness and reuse rights; original unshareable data need not be downloadable.	Unknown	Not assessed.
Complete training pipelineIs the complete base-training and preprocessing pipeline published, including configuration? Fine-tuning code or an inference SDK alone is insufficient.	Unknown	Not assessed.
Legacy data assessment (v0.1)Historical assessment combining download access and disclosure. Preserved for traceability; excluded from the v0.2 tier calculation. See the new separate assessments above.	Partial	The model card says pretraining used text and code from open web datasets, including Zyphra's Zyda (which is downloadable), followed by an annealing phase on a smaller high-quality mixture. No complete list of the mixture was found.1 6
Training recipeAre the training configuration and procedure documented in enough detail to follow?	Partial	Two-phase pretraining (main pretraining, then annealing) and the architecture are described at a high level in the model card and announcement.1 2
Evaluation materialsPublic = evaluation code or prompts that let others re-run the evaluations are published. Partial = results only.	Unknown	Not assessed.

What it is useful for

The model card presents it as a general-purpose base model for efficient inference with low memory use on consumer hardware. It is not tuned for instruction following or chat and has no moderation; Zyphra released a separate instruction-tuned Zamba2-7B-Instruct.1 2

Run and use notes

Documented facts only. No hardware or performance claims are made without a cited source and stated assumptions.

The model card's quick start installs mamba-ssm (v2.1.0) and causal-conv1d for the optimized Mamba2 kernels and loads the model with Transformers on a CUDA device in bfloat16. It says running without those kernels is not recommended because latency and memory use are significantly higher.1

Organization context

Zyphra

Provenance and derivatives

A Zyphra base model pretrained on open web text and code, including Zyphra's Zyda dataset, using the Mistral v0.1 tokenizer. It serves as the language backbone of Zamba2-VL-7B.1 3 6 7

Derived from: Zyda (external site: huggingface.co) — Zyphra pretraining dataset named in the model card.

Catalog records that name this entry in their provenance:

Zamba2-VL-7B

Other releases in the Zamba family

Zamba2-VL-7BModel-disclosure tier (USASI rubric v0.2): Open-weight

Zamba family overview

What this catalog does not know

Unknown means the sources reviewed for this record do not document it. It is not evidence that something does not exist.

Training code: unknown.
Training-data information: unknown.
Training-data access: unknown.
Complete training pipeline: unknown.
Evaluation materials: unknown.

Have a primary source? How to report a correction.

U.S. eligibility

Project eligibility rests on documented governing or maintaining entities, not on contributors.

Eligible · basis: U.S. headquarters

Developed and published by Zyphra, whose terms of use name Zyphra Technologies, Inc. at 415 Mission Street, San Francisco, and whose May 2026 announcement describes it as headquartered in San Francisco.1 10 11

Assessed Sep 29, 2026

Sources

1.
Zyphra/Zamba2-7B model card (external site: huggingface.co)
Zyphra · Model card · accessed Sep 29, 2026
2.
Zamba2-7B (external site: zyphra.com)
Zyphra · Announcement · published Oct 14, 2024 · accessed Sep 29, 2026
3.
Zamba2 | Hugging Face Transformers documentation (external site: huggingface.co)
Hugging Face · Documentation · accessed Sep 29, 2026
4.
Zyphra/Zamba2 README (external site: github.com)
Zyphra · Repository · accessed Sep 29, 2026
5.
Zyphra/Zamba2 LICENSE (external site: raw.githubusercontent.com)
Zyphra · License · accessed Sep 29, 2026
6.
Zyphra/Zyda dataset card (external site: huggingface.co)
Zyphra · Dataset card · accessed Sep 29, 2026
7.
Zyphra/Zamba2-VL-7B model card (external site: huggingface.co)
Zyphra · Model card · accessed Sep 29, 2026
8.
Zyphra/Zamba2-7B (Hugging Face model metadata) (external site: huggingface.co)
Hugging Face · Repository · accessed Sep 29, 2026
9.
Gated models | Hugging Face Hub documentation (external site: huggingface.co)
Hugging Face · Documentation · accessed Sep 29, 2026
10.
Terms of Use | Zyphra (external site: zyphra.com)
Zyphra Technologies, Inc. · Official page · published May 4, 2026 · accessed Sep 29, 2026
11.
Zyphra Releases ZAYA1-8B, a Reasoning Model trained on AMD and Optimized for Maximum Intelligence Density per Parameter (external site: zyphra.com)
Zyphra · Announcement · published May 6, 2026 · accessed Sep 29, 2026

Email a correction Report a correction Edit this entry

This listing is not an endorsement, a safety assessment, or a federal approval.

Cite this page

APA style

USASI. (2026, September 29). Zamba2-7B. United States of America Superintelligence. https://unitedstatesofamericasuperintelligence.com/open/zamba2-7b/

BibTeX

@misc{usasi_zamba2_7b,
  author = {{USASI}},
  title = {Zamba2-7B},
  year = {2026},
  month = sep,
  howpublished = {\url{https://unitedstatesofamericasuperintelligence.com/open/zamba2-7b/}},
  note = {United States of America Superintelligence. Last updated 2026-09-29}
}

The date is when this page was last updated. Add the date you read it if your style needs one.

For maintainers: a “Listed in USASI” badge

Links to this page. It says the entry is listed, not endorsed or rated. About the badge

Markdown (for a README)

[![Listed in the USASI catalog](https://unitedstatesofamericasuperintelligence.com/badges/listed.svg)](https://unitedstatesofamericasuperintelligence.com/open/zamba2-7b/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/open/zamba2-7b/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/listed.svg" alt="Listed in the USASI catalog" height="20"></a>