
Tutel
by microsoft (organization)
Tutel MoE: Optimized Mixture-of-Experts Library, Support GLM/Kimi/Gpt/DeepSeek/Qwen using FP8/NVFP4/MXFP4 (description from the project’s GitHub page)
Repository facts
- Stars
- 1,028
- Forks
- 111
- Open issues and pull requests
- 55
- Primary language
- C
- License
- MIT License (MIT)
- Owner
- microsoft · Organization
- Created
- Aug 6, 2021
- Last push
- Oct 4, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 908: FareedKhan-dev/kimi-k3-in-c
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
9,094 starsCApache-2.0Last push Oct 2, 2026
Rank 5,217: davidmrau/mixture-of-experts
PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538
1,256 starsPythonGPL-3.0Last push Apr 19, 2024
Rank 6,027: mw00/project-maya
Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-co…
1,023 starsC++MITLast push Oct 16, 2026
Rank 6,099: pjlab-sys4nlp/llama-moe
⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
1,005 starsPythonApache-2.0Last push Dec 6, 2024
Rank 8,244: Helldez/BigMoeOnEdge
Run MoE models bigger than your RAM. Frontier-size MoE on a 12 GB phone, lossless, on stock llama.cpp
631 starsC++Apache-2.0Last push Oct 18, 2026