Independent project. Not a U.S. government website.

Support our project (opens Buy Me a Coffee)
USASI

Research

Marin begins pretraining Marin 535B-A23B, a mixture-of-experts model

Event: · Published:

In a launch note dated September 3, 2026, first published on the Open Athena blog and mirrored by Marin, Marin said it had started pretraining Marin 535B-A23B a couple of weeks earlier. The note describes a mixture-of-experts model with 535 billion total parameters and 23 billion active, planned to pretrain for about three months on 18 trillion tokens, and says the team ported its infrastructure and training stack from Google TPUs on GCP to NVIDIA GPUs on CoreWeave before launch, with post-training to follow. It says the entire run, including architecture, data, and predicted loss, is documented on GitHub; it does not give a date or license for releasing the model's weights.1

Sources

  1. 1.
    Marin 535B-A23B launch note (external site: marin.community)

    Marin · Announcement · published Sep 3, 2026 · accessed Oct 13, 2026

Share or cite this page

Cite this page

APA style

USASI. (2026, October 13). Marin begins pretraining Marin 535B-A23B, a mixture-of-experts model. United States of America Superintelligence. https://unitedstatesofamericasuperintelligence.com/news/marin-begins-pretraining-535b-a23b-model/

BibTeX

@misc{usasi_news_marin_begins_pretraining_535b_a23b_model,
  author = {{USASI}},
  title = {Marin begins pretraining Marin 535B-A23B, a mixture-of-experts model},
  year = {2026},
  month = oct,
  howpublished = {\url{https://unitedstatesofamericasuperintelligence.com/news/marin-begins-pretraining-535b-a23b-model/}},
  note = {United States of America Superintelligence. Last updated 2026-10-13}
}

The date is when this page was last updated. Add the date you read it if your style needs one.

Support Us

Help keep USASI useful.

Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).

About supporting this project