
rwkv.cpp
by RWKV (organization)
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model (description from the project’s GitHub page)
Repository facts
- Stars
- 1,587
- Forks
- 131
- Open issues and pull requests
- 36
- Primary language
- C++
- License
- MIT License (MIT)
- Owner
- RWKV · Organization
- Created
- Mar 30, 2023
- Last push
- Mar 23, 2025
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 4,827: RahulSChand/gpu_poor
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
1,400 starsJavaScriptNo license file detectedLast push Dec 3, 2024
Rank 8,807: Maknee/minigpt4.cpp
Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
572 starsC++MITLast push Aug 8, 2023
Rank 2,899: stochasticai/xTuring
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: ht…
2,674 starsPythonApache-2.0Last push Oct 18, 2026
Rank 3,232: dvmazur/mixtral-offloading
Run Mixtral-8x7B models in Colab or consumer desktops
2,336 starsPythonMITLast push Apr 8, 2024
Rank 551: BlinkDL/RWKV-LM
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combin…
14,748 starsPythonApache-2.0Last push Sep 28, 2026
Rank 3,546: guinmoon/LLMFarm
llama and other large language models on iOS and MacOS offline using GGML library.
2,081 starsCMITLast push Jan 30, 2026