MoE-LLaVA

Repository facts

Stars

2,321

Forks

139

Open issues and pull requests

65

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

PKU-YuanGroup · Organization

Created

Dec 14, 2023

Last push

Jul 15, 2025

Topics

• large-vision-language-model
• mixture-of-experts
• moe
• multi-modal

Rank #3,246 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 5,217

  Rank 5,217: davidmrau/mixture-of-experts

  PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538

  1,256 starsPythonGPL-3.0Last push Apr 19, 2024

• 6,099

  Rank 6,099: pjlab-sys4nlp/llama-moe

  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)

  1,005 starsPythonApache-2.0Last push Dec 6, 2024

• 8,395

  Rank 8,395: ymcui/Chinese-Mixtral

  中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）

  613 starsPythonApache-2.0Last push Apr 19, 2026

• 908

  Rank 908: FareedKhan-dev/kimi-k3-in-c

  A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

  9,094 starsCApache-2.0Last push Oct 2, 2026

• 6,008

  Rank 6,008: microsoft/Tutel

  Tutel MoE: Optimized Mixture-of-Experts Library, Support GLM/Kimi/Gpt/DeepSeek/Qwen using FP8/NVFP4/MXFP4

  1,028 starsCMITLast push Oct 4, 2026

• 6,027

  Rank 6,027: mw00/project-maya

  Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-co…

  1,023 starsC++MITLast push Oct 16, 2026