Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

kyegomez/Mixture-of-Depths

Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"

Owner
kyegomez (personal account)
Stars
Stars: 124
Forks
Forks: 9
Language
Python
License
MIT
Created
2024
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by kyegomez

All 40 repos by kyegomez

Nearby in Python

All Python repos