Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

lucidrains/speculative-decoding

Explorations into some recent techniques surrounding speculative decoding

Owner
lucidrains (personal account)
Stars
Stars: 308
Forks
Forks: 25
Language
Python
License
MIT
Created
2023
Topics
artificial-intelligencedeep-learningefficient-inferencetransformers
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by lucidrains

All 175 repos by lucidrains

Nearby in Python

All Python repos