
atlas
by Avarok-Cybersecurity (organization)
Pure Rust Inference Engine (description from the project’s GitHub page)
Repository facts
- Stars
- 709
- Forks
- 106
- Open issues and pull requests
- 201
- Primary language
- Rust
- License
- GNU Affero General Public License v3.0 (AGPL-3.0)
- Owner
- Avarok-Cybersecurity · Organization
- Created
- May 5, 2026
- Last push
- Oct 18, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 7,564: pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
724 starsRustApache-2.0Last push Oct 17, 2026
Rank 7,888: ARahim3/kaggle-tpu-lab
Frontier-class open models on a free Kaggle TPU v5e-8: GLM-5.3-Flash 320B MoE (~165 tok/s, our own JAX engine) and Qwen3.8-27B bf16 (~130 tok/s), 262k context, prefix caching. Wor…
679 starsPythonMITLast push Oct 6, 2026
Rank 3,585: syv-ai/HyperQwen
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/…
2,054 starsPythonApache-2.0Last push Oct 18, 2026
Rank 1,362: Michael-A-Kuykendall/shimmy
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
5,982 starsRustApache-2.0Last push Aug 30, 2026
Rank 6,027: mw00/project-maya
Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-co…
1,023 starsC++MITLast push Oct 16, 2026
Rank 884: NVlabs/Sana
SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer
9,390 starsPythonApache-2.0Last push Oct 17, 2026