
Rank #1,338 6,080 starsPython
lit-llama
by Lightning-AI (organization)
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed. (description from the project’s GitHub page)
Repository facts
- Stars
- 6,080
- Forks
- 517
- Open issues and pull requests
- 107
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- Lightning-AI · Organization
- Created
- Mar 22, 2023
- Last push
- Jul 1, 2025