qvac
by tetherto (organization)
Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS, Windows, Android, iOS. (description from the project’s GitHub page)
Repository facts
- Stars
- 697
- Forks
- 138
- Open issues and pull requests
- 100
- Primary language
- TypeScript
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- tetherto · Organization
- Created
- Jan 3, 2026
- Last push
- Oct 18, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 1,979: raullenchai/Rapid-MLX
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents.…
3,996 starsPythonOther licenseLast push Oct 18, 2026
Rank 2,959: youssofal/MTPLX
The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculati…
2,598 starsPythonApache-2.0Last push Oct 10, 2026
Rank 4,946: feder-cr/jev
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
1,354 starsC++MITLast push Oct 16, 2026
Rank 1,362: Michael-A-Kuykendall/shimmy
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
5,982 starsRustApache-2.0Last push Aug 30, 2026
Rank 2,336: nicedreamzapp/claude-code-local
Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gem…
3,369 starsPythonMITLast push Oct 15, 2026
Rank 310: mozilla-ai/llamafile
Distribute and run LLMs with a single file.
26,418 starsC++Other licenseLast push Oct 12, 2026