Illustration: the project’s public image, pixelated by RepoMasters. Credits
BetaRare

hao-ai-lab/LookaheadDecoding

[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

Owner
hao-ai-lab (organization)
Stars
Stars: 1,345
Forks
Forks: 84
Language
Python
License
Apache-2.0
Created
2023
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

More repos by hao-ai-lab

All 10 repos by hao-ai-lab

Nearby in Python

All Python repos