project-maya
by mw00 (personal account)
Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools. (description from the project’s GitHub page)
Repository facts
- Stars
- 1,023
- Forks
- 135
- Open issues and pull requests
- 76
- Primary language
- C++
- License
- MIT License (MIT)
- Owner
- mw00 · Personal account
- Created
- Oct 6, 2026
- Last push
- Oct 16, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 6,051: peonist-ai/halogen-flash-server
The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)
1,018 starsShellOther licenseLast push Oct 18, 2026
Rank 908: FareedKhan-dev/kimi-k3-in-c
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
9,094 starsCApache-2.0Last push Oct 2, 2026
Rank 7,564: pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
724 starsRustApache-2.0Last push Oct 17, 2026
Rank 7,888: ARahim3/kaggle-tpu-lab
Frontier-class open models on a free Kaggle TPU v5e-8: GLM-5.3-Flash 320B MoE (~165 tok/s, our own JAX engine) and Qwen3.8-27B bf16 (~130 tok/s), 262k context, prefix caching. Wor…
679 starsPythonMITLast push Oct 6, 2026
Rank 3,585: syv-ai/HyperQwen
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/…
2,054 starsPythonApache-2.0Last push Oct 18, 2026
Rank 7,815: travisvn/chatterbox-tts-api
Local, OpenAI-compatible text-to-speech (TTS) API using Chatterbox, enabling users to generate voice cloned speech anywhere the OpenAI API is used (e.g. Open WebUI, AnythingLLM, e…
690 starsPythonAGPL-3.0Last push Dec 23, 2025