nomic-embed-text-v2-moe
nomic-embed-text-v2-moe is an open-weight model release in the Nomic Embed family from Nomic AI1, version nomic-embed-text-v2-moe, released Feb 2025. Its weights can be downloaded by the public1 under the Apache License 2.01.
A multilingual text embedding model that uses a mixture-of-experts design (8 experts, top-2 routing), with 475M total and 305M active parameters. It covers about 100 languages, produces 768-dimensional embeddings that can be truncated to 256 through Matryoshka training, and accepts inputs of up to 512 tokens. Nomic released it in February 2025.123
- Model hub: Model card (Hugging Face) (external site: huggingface.co)
- Model hub: GGUF build (external site: huggingface.co)
- Paper: Technical report (arXiv 2502.07972) (external site: arxiv.org)
- Repository: contrastors training code (external site: github.com)
On AI on Hugging Face: nomic-ai/nomic-embed-text-v2-moe, nomic-ai/nomic-embed-text-v2-moe-GGUF
Availability and license
Overall availability
Downloadable from Hugging Face without gating.1
Availability is separate from permission: read the license before using or redistributing.
Component reuse rights
- weights
- Unknown — no complete fact-level rights review
- code
- Unknown — no complete fact-level rights review
- data
- Unknown — no complete fact-level rights review
- documentation
- Unknown — no complete fact-level rights review
No complete system-rights review is recorded for this release.
Model-disclosure tier
The model parameters for this release can be downloaded by the public. License terms may still restrict use, redistribution, or commercial use.
Public materials checklist
| Item | Status | Notes and evidence |
|---|---|---|
| WeightsCan the general public download the model parameters for this release? | Public | 1 |
| Inference codeIs code for running the model published? | Public | The card documents use with Sentence Transformers and Transformers (with trust_remote_code for the custom architecture) and recommends Nomic's megablocks fork for GPU performance.1 |
| Training codeIs the code used to train the model published? | Public | The card and technical report point to the contrastors repository.126 |
| Training-data informationDoes the information cover provenance, scope, acquisition, selection, labeling, processing, and where data or alternatives can be obtained? Access alone does not establish completeness. | Unknown | Not assessed. |
| Training-data accessCan the training data be obtained? This is independent of information completeness and reuse rights; original unshareable data need not be downloadable. | Unknown | Not assessed. |
| Complete training pipelineIs the complete base-training and preprocessing pipeline published, including configuration? Fine-tuning code or an inference SDK alone is insufficient. | Unknown | Not assessed. |
| Legacy data assessment (v0.1)Historical assessment combining download access and disclosure. Preserved for traceability; excluded from the v0.2 tier calculation. See the new separate assessments above. | Partial | The card says training used 1.6 billion multilingual pairs and that the training data is released, pointing to the contrastors repository. That README documents access (with a Nomic Atlas account) to the nomic-embed-text-v1 dataset but does not separately describe the v2 multilingual data.16 |
| Training recipeAre the training configuration and procedure documented in enough detail to follow? | Partial | The card summarizes the recipe: weakly supervised contrastive pretraining, then supervised fine-tuning, with consistency filtering and Matryoshka representation learning; the technical report gives details.12 |
| Evaluation materialsPublic = evaluation code or prompts that let others re-run the evaluations are published. Partial = results only. | Public | The technical report's abstract says code, models, and evaluation data are open sourced; the card shows BEIR and MIRACL results.21 |
What it is useful for
Multilingual retrieval, including retrieval-augmented generation. Queries and documents must carry the task prefixes search_query and search_document.1
Run and use notes
- The card recommends the 256-dimension embeddings when storage or compute is a concern and notes that the mixture-of-experts architecture may need more resources than comparable dense models.1
Organization context
Provenance and derivatives
Trained by Nomic from nomic-xlm-2048, which Nomic made by swapping XLM-RoBERTa Base's learned position embeddings for rotary embeddings and training further on CC100. The released model is fine-tuned from the contrastively pretrained checkpoint nomic-embed-text-v2-moe-unsupervised.145
- Derived from: nomic-embed-text-v2-moe-unsupervised (external site: huggingface.co) — Contrastive-pretraining checkpoint from Nomic.
- Derived from: nomic-xlm-2048 (external site: huggingface.co) — Nomic's RoPE variant of FacebookAI/xlm-roberta-base.
Other releases in the Nomic Embed family
- nomic-embed-text-v1.5Model-disclosure tier (USASI rubric v0.2): Open-weight
What this catalog does not know
- Training-data information: unknown.
- Training-data access: unknown.
- Complete training pipeline: unknown.
Have a primary source? How to report a correction.
U.S. eligibility
Sources
This listing is not an endorsement, a safety assessment, or a federal approval.
Share or cite this page
- X (opens X)
- Bluesky (opens Bluesky)
- LinkedIn (opens LinkedIn)
- Reddit (opens Reddit)
- Hacker News (opens Hacker News)
- Email (opens your email app)
- RSS updates
Cite this page
APA style
USASI. (2026, September 29). nomic-embed-text-v2-moe. United States of America Superintelligence. https://unitedstatesofamericasuperintelligence.com/open/nomic-embed-text-v2-moe/
BibTeX
@misc{usasi_nomic_embed_text_v2_moe,
author = {{USASI}},
title = {nomic-embed-text-v2-moe},
year = {2026},
month = sep,
howpublished = {\url{https://unitedstatesofamericasuperintelligence.com/open/nomic-embed-text-v2-moe/}},
note = {United States of America Superintelligence. Last updated 2026-09-29}
}The date is when this page was last updated. Add the date you read it if your style needs one.
For maintainers: a “Listed in USASI” badge
Links to this page. It says the entry is listed, not endorsed or rated. About the badge
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/open/nomic-embed-text-v2-moe/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/open/nomic-embed-text-v2-moe/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/listed.svg" alt="Listed in the USASI catalog" height="20"></a>