kvpress

Repository facts

Stars

1,233

Forks

190

Open issues and pull requests

12

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

NVIDIA · Organization

Created

Nov 6, 2024

Last push

Oct 6, 2026

Topics

• inference
• kv-cache
• kv-cache-compression
• large-language-models
• llm
• long-context
• python
• pytorch
• transformers

Rank #5,292 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 7,239

  Rank 7,239: haoliuhl/ringattention

  Large Context Attention

  774 starsPythonApache-2.0Last push Oct 13, 2025

• 669

  Rank 669: LMCache/LMCache

  LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

  12,108 starsPythonApache-2.0Last push Oct 18, 2026

• 851

  Rank 851: xorbitsai/inference

  Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unif…

  9,616 starsPythonApache-2.0Last push Oct 18, 2026

• 1,506

  Rank 1,506: superduper-io/superduper

  Superduper: End-to-end framework for building custom AI applications and agents.

  5,325 starsPythonApache-2.0Last push Sep 1, 2025

• 9,107

  Rank 9,107: underneathall/pinferencia

  Python + Inference - Model Deployment library in Python. Simplest model inference server ever.

  541 starsPythonApache-2.0Last push Feb 14, 2023

• 618

  Rank 618: neuml/txtai

  💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

  13,024 starsPythonApache-2.0Last push Oct 16, 2026