llama-moe

Repository facts

Stars

1,005

Forks

60

Open issues and pull requests

7

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

pjlab-sys4nlp · Organization

Created

Jul 24, 2023

Last push

Dec 6, 2024

Topics

• continual-pre-training
• expert-partition
• llama
• llm
• mixture-of-experts
• moe

Rank #6,099 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 8,395

  Rank 8,395: ymcui/Chinese-Mixtral

  中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）

  613 starsPythonApache-2.0Last push Apr 19, 2026

• 43

  Rank 43: vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  94,068 starsPythonApache-2.0Last push Oct 18, 2026

• 64

  Rank 64: hiyouga/LlamaFactory

  Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

  75,561 starsPythonApache-2.0Last push Oct 10, 2026

• 185

  Rank 185: sgl-project/sglang

  SGLang is a high-performance serving framework for large language models and multimodal models.

  37,276 starsPythonApache-2.0Last push Oct 18, 2026

• 513

  Rank 513: modelscope/ms-swift

  Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3…

  15,871 starsPythonApache-2.0Last push Oct 18, 2026

• 908

  Rank 908: FareedKhan-dev/kimi-k3-in-c

  A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

  9,094 starsCApache-2.0Last push Oct 2, 2026