Release

Common Crawl releases experimental web graph embeddings for web hosts

Event: Sep 7, 2026 · Published: Oct 13, 2026

On September 7, 2026, Common Crawl published an experimental dataset of 128-dimensional embeddings for web hosts, learned from hyperlinks alone in its host-level web graph for the November 2025, December 2025, and January 2026 crawls. The model uses no page text, metadata, or hostnames and was trained only on hosts with at least eight links. The data is published as Parquet files on Common Crawl's S3 bucket and on Hugging Face, where the dataset card says its use is subject to the Common Crawl Terms of Use; the source code is on GitHub. Common Crawl says it is yet to be seen whether it will publish graph embeddings on a regular basis.1 2

Sources

1.
Web Graph Embeddings: An Experimental Dataset Release (external site: commoncrawl.org)
Common Crawl Foundation · Announcement · published Sep 7, 2026 · accessed Oct 13, 2026
2.
commoncrawl/web-graph-embeddings dataset card (external site: huggingface.co)
Common Crawl Foundation (Hugging Face) · Documentation · accessed Oct 13, 2026

Email a correction Report a correction Edit this entry

All news

Cite this page

APA style

USASI. (2026, October 13). Common Crawl releases experimental web graph embeddings for web hosts. United States of America Superintelligence. https://unitedstatesofamericasuperintelligence.com/news/common-crawl-releases-web-graph-embeddings/

BibTeX

@misc{usasi_news_common_crawl_releases_web_graph_embeddings,
  author = {{USASI}},
  title = {Common Crawl releases experimental web graph embeddings for web hosts},
  year = {2026},
  month = oct,
  howpublished = {\url{https://unitedstatesofamericasuperintelligence.com/news/common-crawl-releases-web-graph-embeddings/}},
  note = {United States of America Superintelligence. Last updated 2026-10-13}
}

The date is when this page was last updated. Add the date you read it if your style needs one.

Related catalog entries

Sources

Share or cite this page

Support Us