PrototypeCommon
kyegomez/Mixture-of-Depths
Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
- Owner
- kyegomez (personal account)
- Stars
- Stars: 124
- Forks
- Forks: 9
- Language
- Python
- License
- MIT
- Created
- 2024
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by kyegomez
All 40 repos by kyegomez- kyegomez/OpenMythosStars: 14,924PythonStable
- kyegomez/swarmsStars: 7,350PythonStable
- kyegomez/tree-of-thoughtsStars: 4,593PythonRC
- kyegomez/BitNetStars: 1,949PythonBeta
- kyegomez/awesome-multi-agent-papersStars: 1,707TeXBeta
- kyegomez/Open-AF3Stars: 808PythonBeta
Nearby in Python
All Python repos- TttMc/mcd-budget-biteStars: 124PythonPrototype
- ant-intl/BizAgentBenchStars: 124PythonPrototype
- xyzhangxin/sony-a6700-powerfulStars: 124PythonPrototype
- labjack/LabJackPythonStars: 124PythonPrototype
- django-cms/cmsplugin-filerStars: 124PythonPrototype
- OpenTreeMap/otm-legacyStars: 124PythonPrototype