HyperQwen
by syv-ai (organization)
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks. (description from the project’s GitHub page)
Repository facts
- Stars
- 2,054
- Forks
- 281
- Open issues and pull requests
- 4
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- syv-ai · Organization
- Created
- Aug 15, 2026
- Last push
- Oct 18, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 7,564: pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
724 starsRustApache-2.0Last push Oct 17, 2026
Rank 7,888: ARahim3/kaggle-tpu-lab
Frontier-class open models on a free Kaggle TPU v5e-8: GLM-5.3-Flash 320B MoE (~165 tok/s, our own JAX engine) and Qwen3.8-27B bf16 (~130 tok/s), 262k context, prefix caching. Wor…
679 starsPythonMITLast push Oct 6, 2026
Rank 2,959: youssofal/MTPLX
The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculati…
2,598 starsPythonApache-2.0Last push Oct 10, 2026
Rank 5,991: StayLameBro/backburner
Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable
1,033 starsPythonMITLast push Oct 13, 2026
Rank 6,051: peonist-ai/halogen-flash-server
The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)
1,018 starsShellOther licenseLast push Oct 18, 2026
Rank 1,389: gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
5,844 starsPythonApache-2.0Last push Oct 16, 2026