Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

facebookresearch/LayerSkip

Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024

Owner
facebookresearch (organization)
Stars
Stars: 378
Forks
Forks: 47
Language
Python
License
None
Created
2024
Topics
llmoptimizationtransformersearly-exitlayer-dropspeculative-decoding
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by facebookresearch

All 640 repos by facebookresearch

Nearby in Python

All Python repos