
Rank #4,968 1,343 starsPython
LookaheadDecoding
by hao-ai-lab (organization)
[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding (description from the project’s GitHub page)
Repository facts
- Stars
- 1,343
- Forks
- 84
- Open issues and pull requests
- 34
- Primary language
- Python
- License
- Apache License 2.0 (Apache-2.0)
- Owner
- hao-ai-lab · Organization
- Created
- Nov 21, 2023
- Last push
- Mar 6, 2025