ringattention

Repository facts

Stars

774

Forks

52

Open issues and pull requests

9

Primary language

Python

License

Apache License 2.0 (Apache-2.0)

Owner

haoliuhl · Personal account

Created

Jun 1, 2023

Last push

Oct 13, 2025

Topics

• large-language-models
• long-context
• memory-efficient
• transformers

Rank #7,239 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Related projects

Projects that share this one’s GitHub topics.

• 5,292

  Rank 5,292: NVIDIA/kvpress

  LLM KV cache compression made easy

  1,233 starsPythonApache-2.0Last push Oct 6, 2026

• 8,040

  Rank 8,040: lucidrains/MEGABYTE-pytorch

  Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

  657 starsPythonMITLast push Dec 27, 2024

• 2,887

  Rank 2,887: JIA-Lab-research/LongLoRA

  Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

  2,687 starsPythonApache-2.0Last push Aug 14, 2024

• 64

  Rank 64: hiyouga/LlamaFactory

  Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

  75,561 starsPythonApache-2.0Last push Oct 10, 2026

• 450

  Rank 450: NVIDIA/Megatron-LM

  Ongoing research training transformer models at scale

  18,188 starsPythonOther licenseLast push Oct 18, 2026

• 618

  Rank 618: neuml/txtai

  💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

  13,024 starsPythonApache-2.0Last push Oct 16, 2026