AlphaUncommon
Infini-AI-Lab/TriForce
[COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
- Owner
- Infini-AI-Lab (organization)
- Stars
- Stars: 280
- Forks
- Forks: 21
- Language
- Python
- License
- None
- Created
- 2024
- Topics
- accelerationllmlong-contextspeculative-decodingllm-inferenceefficiencyinference
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by Infini-AI-Lab
All 9 repos by Infini-AI-Lab- Infini-AI-Lab/hermitStars: 435PythonAlpha
- Infini-AI-Lab/SequoiaStars: 376PythonAlpha
- Infini-AI-Lab/MagicPIGStars: 256PythonAlpha
- Infini-AI-Lab/MagicDecStars: 162PythonPrototype
- Infini-AI-Lab/MonarchRTStars: 146PythonPrototype
- Infini-AI-Lab/UMbreLLaStars: 131PythonPrototype
Nearby in Python
All Python repos- MiaAI-Lab/DeepSeek-v4.1-Flash-EXL3-2x-DGX-SparksStars: 280PythonAlpha
- robosimstudio/robosimstudioStars: 280PythonAlpha
- yujian0815/fnmedia-extStars: 280PythonAlpha
- madisona/django-google-mapsStars: 280PythonAlpha
- posativ/acrylamidStars: 280PythonAlpha
- robertkrimen/gist-itStars: 280PythonAlpha