mixture-of-experts

Repository facts

Stars

1,256

Forks

112

Open issues and pull requests

6

Primary language

Python

License

GNU General Public License v3.0 (GPL-3.0)

Owner

davidmrau · Personal account

Created

Jul 19, 2019

Last push

Apr 19, 2024

Topics

• mixture-of-experts
• moe
• pytorch
• re-implementation
• sparsely-gated-mixture-of-experts

Rank #5,217 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 6,008

  Rank 6,008: microsoft/Tutel

  Tutel MoE: Optimized Mixture-of-Experts Library, Support GLM/Kimi/Gpt/DeepSeek/Qwen using FP8/NVFP4/MXFP4

  1,028 starsCMITLast push Oct 4, 2026

• 3,246

  Rank 3,246: PKU-YuanGroup/MoE-LLaVA

  【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models

  2,321 starsPythonApache-2.0Last push Jul 15, 2025

• 6,099

  Rank 6,099: pjlab-sys4nlp/llama-moe

  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)

  1,005 starsPythonApache-2.0Last push Dec 6, 2024

• 8,395

  Rank 8,395: ymcui/Chinese-Mixtral

  中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）

  613 starsPythonApache-2.0Last push Apr 19, 2026

• 908

  Rank 908: FareedKhan-dev/kimi-k3-in-c

  A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

  9,094 starsCApache-2.0Last push Oct 2, 2026

• 6,027

  Rank 6,027: mw00/project-maya

  Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-co…

  1,023 starsC++MITLast push Oct 16, 2026