PrototypeCommon
astramind-ai/Mixture-of-depths
Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
- Owner
- astramind-ai (organization)
- Stars
- Stars: 176
- Forks
- Forks: 16
- Language
- Python
- License
- None
- Created
- 2024
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by astramind-ai
All 3 repos by astramind-ai- astramind-ai/AuralisStars: 623PythonAlpha
- astramind-ai/BitMatStars: 153PythonPrototype
Nearby in Python
All Python repos- seedleap/zing-world-modelStars: 176PythonPrototype
- Lucasuiii/modeling-workbenchStars: 176PythonPrototype
- GroundedCoreAI/nexusdeskStars: 176PythonPrototype
- MacSysadmin/pymacadminStars: 176PythonPrototype
- leah/python-oauthStars: 176PythonPrototype
- tobami/overmindStars: 176PythonPrototype