H2O

Repository facts

Stars

535

Forks

90

Open issues and pull requests

36

Primary language

Python

License

No license file detected

Owner

FMInference · Organization

Created

Jun 12, 2023

Last push

Aug 1, 2024

Topics

• gpt-3
• heavy-hitters
• high-throughput
• kv-cache
• large-language-models
• sparsity

Rank #9,154 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 2,853

  Rank 2,853: intel/neural-compressor

  SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

  2,722 starsPythonApache-2.0Last push Oct 16, 2026

• 5,292

  Rank 5,292: NVIDIA/kvpress

  LLM KV cache compression made easy

  1,233 starsPythonApache-2.0Last push Oct 6, 2026

• 1,731

  Rank 1,731: promptslab/Promptify

  Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

  4,643 starsPythonApache-2.0Last push Mar 27, 2026

• 4,832

  Rank 4,832: explosion/spacy-llm

  🦙 Integrating LLMs into structured NLP pipelines

  1,397 starsPythonMITLast push Sep 27, 2026

• 4,862

  Rank 4,862: zjunlp/KnowLM

  An Open-sourced Knowledgable Large Language Model Framework.

  1,385 starsPythonMITLast push Jan 11, 2025

• 7,789

  Rank 7,789: jimmyyhwu/tidybot

  TidyBot: Personalized Robot Assistance with Large Language Models

  693 starsPythonMITLast push Nov 10, 2023