PrototypeCommon
kyegomez/SwitchTransformers
Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"
- Owner
- kyegomez (personal account)
- Stars
- Stars: 148
- Forks
- Forks: 17
- Language
- Python
- License
- MIT
- Created
- 2024
- Topics
- aigpt4llamamixture-of-expertsmlmoemulti-modalmixture-modelmixture-of-models
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by kyegomez
All 40 repos by kyegomez- kyegomez/OpenMythosStars: 14,917PythonStable
- kyegomez/swarmsStars: 7,341PythonStable
- kyegomez/tree-of-thoughtsStars: 4,594PythonRC
- kyegomez/BitNetStars: 1,949PythonBeta
- kyegomez/awesome-multi-agent-papersStars: 1,705TeXBeta
- kyegomez/Open-AF3Stars: 808PythonBeta
Nearby in Python
All Python repos- aaddrick/building-with-typesafe-jevStars: 148PythonPrototype
- KohakuBlueleaf/KohakuMossTrainerStars: 148PythonPrototype
- smarkyie/NSP-BoxStars: 148PythonPrototype
- ntt/eveapiStars: 148PythonPrototype
- neuroo/grabberStars: 148PythonPrototype
- TkTech/BurgerStars: 148PythonPrototype