Llama-2-Open-Source-LLM-CPU-Inference
by kennethleungty (personal account)
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A (description from the project’s GitHub page)
Repository facts
- Stars
- 971
- Forks
- 205
- Open issues and pull requests
- 15
- Primary language
- Python
- License
- MIT License (MIT)
- Owner
- kennethleungty · Personal account
- Created
- Jul 6, 2023
- Last push
- Nov 6, 2023
Topics
Related projects
Projects that share this one’s GitHub topics.
Rank 6,090: zjunlp/Prompt4ReasoningPapers
[ACL 2023] Reasoning with Language Model Prompting: A Survey
1,009 starsMITLast push May 21, 2025
Rank 6,566: The-FinAI/PIXIU
This repository introduces PIXIU, an open-source resource featuring the first financial large language models (LLMs), instruction tuning data, and evaluation benchmarks to holisti…
894 starsJupyter NotebookMITLast push Oct 8, 2026
Rank 8,119: webis-de/small-text
Active Learning for Text Classification in Python
647 starsPythonMITLast push Oct 12, 2026
Rank 9,068: EricFillion/happy-transformer
Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.
545 starsPythonApache-2.0Last push Jan 10, 2026
Rank 768: bigscience-workshop/petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
10,639 starsPythonMITLast push Sep 7, 2024
Rank 1,695: trigaten/Learn_Prompting
Prompt Engineering, Generative AI, and LLM Guide by Learn Prompting | Join our discord for the largest Prompt Engineering learning community
4,739 starsMDXOther licenseLast push Jan 14, 2025