rkllama
by NotPunchnox (personal account)
Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm ) (description from the project’s GitHub page)
Repository facts
- Stars
- 616
- Forks
- 102
- Open issues and pull requests
- 69
- Primary language
- Python
- License
- GNU General Public License v3.0 (GPL-3.0)
- Owner
- NotPunchnox · Personal account
- Created
- Dec 30, 2024
- Last push
- Aug 25, 2026
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 3,976: cosmo-wander-ai/cosmo-edge
Production-grade C++ edge AI engine for video analytics and on-device VLM across Sophon, Rockchip RKNN, and x86, with visual orchestration, real-time OSD, events, and reproducible…
1,802 starsCApache-2.0Last push Oct 16, 2026
Rank 8,868: jaylfc/taOS
Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framewor…
566 starsPythonAGPL-3.0Last push Oct 18, 2026
Rank 1,372: lemonade-sdk/lemonade
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
5,927 starsC++Apache-2.0Last push Oct 18, 2026
Rank 4,946: feder-cr/jev
jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
1,354 starsC++MITLast push Oct 16, 2026
Rank 1,796: gptme/gptme
Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!
4,456 starsPythonMITLast push Oct 18, 2026
Rank 7,333: raiyanyahya/recall
Stop wasting tokens and re-explaining your project every session. Recall gives Claude Code , Opencode durable memory — entirely offline.
759 starsPythonMITLast push Sep 7, 2026