
BigMoeOnEdge
by Helldez (personal account)
Run MoE models bigger than your RAM. Frontier-size MoE on a 12 GB phone, lossless, on stock llama.cpp (description from the project’s GitHub page)
Repository facts
- Stars
- 631
- Forks
- 81
- Open issues and pull requests
- 27
- Primary language
- C++
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- Helldez · Personal account
- Created
- Jul 10, 2026
- Last push
- Oct 18, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 4,946: feder-cr/jev
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
1,354 starsC++MITLast push Oct 16, 2026
Rank 3,960: AtomicBot-ai/Atomic-Chat
Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
1,810 starsTypeScriptOther licenseLast push Oct 17, 2026
Rank 43: vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
94,068 starsPythonApache-2.0Last push Oct 18, 2026
Rank 185: sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
37,276 starsPythonApache-2.0Last push Oct 18, 2026
Rank 882: oumi-ai/oumi
Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
9,403 starsPythonApache-2.0Last push Oct 15, 2026
Rank 787: RunanywhereAI/runanywhere-sdks
Production ready toolkit to run AI locally
10,330 starsC++Other licenseLast push Oct 18, 2026