Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

Infini-AI-Lab/Sequoia

scalable and robust tree-based speculative decoding algorithm

Owner
Infini-AI-Lab (organization)
Stars
Stars: 376
Forks
Forks: 37
Language
Python
License
None
Created
2024
Topics
efficiencyinferencellmspeculative-decoding
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by Infini-AI-Lab

All 9 repos by Infini-AI-Lab

Nearby in Python

All Python repos