pegainfer

Repository facts

Stars

724

Forks

117

Open issues and pull requests

76

Primary language

Rust

License

Apache License 2.0 (Apache-2.0)

Owner

pegainfer-project · Organization

Created

Feb 17, 2026

Last push

Oct 17, 2026

Topics

• cuda
• cuda-kernels
• deepseek
• gpu
• inference
• inference-engine
• kimi
• kimi-k2
• kv-cache
• llm
• llm-inference
• llm-serving
• model-serving
• moe
• openai-api
• paged-attention
• qwen
• qwen3
• rust
• vllm

Rank #7,564 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 43

  Rank 43: vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  94,068 starsPythonApache-2.0Last push Oct 18, 2026

• 3,852

  Rank 3,852: SemiAnalysisAI/InferenceX

  Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

  1,874 starsPythonApache-2.0Last push Oct 18, 2026

• 1,389

  Rank 1,389: gpustack/gpustack

  A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

  5,844 starsPythonApache-2.0Last push Oct 16, 2026

• 9,341

  Rank 9,341: ome-projects/ome

  Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

  517 starsGoApache-2.0Last push Oct 18, 2026

• 3,585

  Rank 3,585: syv-ai/HyperQwen

  Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/…

  2,054 starsPythonApache-2.0Last push Oct 18, 2026

• 7,888

  Rank 7,888: ARahim3/kaggle-tpu-lab

  Frontier-class open models on a free Kaggle TPU v5e-8: GLM-5.3-Flash 320B MoE (~165 tok/s, our own JAX engine) and Qwen3.8-27B bf16 (~130 tok/s), 262k context, prefix caching. Wor…

  679 starsPythonMITLast push Oct 6, 2026