OLMo — USASI news https://unitedstatesofamericasuperintelligence.com/open/olmo/ Dated, sourced news items in the USASI catalog that mention OLMo. Independent project. Not a United States government website. en-us Thu, 01 Oct 2026 12:00:00 GMT Ai2 releases OLMo-core 3, its open training library, with mixture-of-experts support https://unitedstatesofamericasuperintelligence.com/news/ai2-releases-olmo-core-3/ https://unitedstatesofamericasuperintelligence.com/news/ai2-releases-olmo-core-3/ Thu, 01 Oct 2026 12:00:00 GMT release Ai2 released version 3 of OLMo-core, the PyTorch training library behind its Olmo models, on October 1, 2026. The release redesigns the library's mixture-of-experts training system, adding expert and pipeline parallelism, a distributed optimizer, grouped matrix multiplication for experts, and support for the MXFP8 number format; Ai2 says it is designed to scale mixture-of-experts training into the trillion-parameter range. The code is licensed under Apache 2.0, and the repository includes Ai2's official training scripts for Olmo 3.