
gpu_poor
by RahulSChand (personal account)
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization (description from the project’s GitHub page)
Repository facts
- Stars
- 1,400
- Forks
- 88
- Open issues and pull requests
- 8
- Primary language
- JavaScript
- License
- No license file detected
- Owner
- RahulSChand · Personal account
- Created
- Sep 12, 2023
- Last push
- Dec 3, 2024
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 2,627: ashishpatel26/LLM-Finetuning
LLM Finetuning with peft
2,990 starsJupyter NotebookNo license file detectedLast push Aug 1, 2025
Rank 4,406: RWKV/rwkv.cpp
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
1,587 starsC++MITLast push Mar 23, 2025
Rank 742: getumbrel/llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
10,921 starsTypeScriptMITLast push Apr 23, 2024
Rank 2,080: SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
3,813 starsC#MITLast push Oct 17, 2026
Rank 8,853: xNul/code-llama-for-vscode
Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.
568 starsPythonMITLast push Jul 31, 2024