
FreeToken
by FlashML-org (personal account)
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently. (description from the project’s GitHub page)
Repository facts
- Stars
- 14,572
- Forks
- 1,469
- Open issues and pull requests
- 436
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- FlashML-org · Personal account
- Created
- Jul 20, 2026
- Last push
- Oct 18, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 185: sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
37,276 starsPythonApache-2.0Last push Oct 18, 2026
Rank 4,833: GradientHQ/parallax
Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
1,397 starsPythonApache-2.0Last push Jul 1, 2026
Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 2,876: lightseekorg/tokenspeed
TokenSpeed is a speed-of-light LLM inference engine.
2,699 starsPythonMITLast push Oct 18, 2026
Rank 513: modelscope/ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3…
15,871 starsPythonApache-2.0Last push Oct 18, 2026
Rank 13: ollama/ollama
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
183,722 starsGoMITLast push Oct 18, 2026