BetaRare
lucidrains/mixture-of-experts
A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models
- Owner
- lucidrains (personal account)
- Stars
- Stars: 877
- Forks
- Forks: 70
- Language
- Python
- License
- MIT
- Created
- 2020
- Topics
- artificial-intelligencedeep-learningtransformermixture-of-experts
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by lucidrains
All 175 repos by lucidrains- lucidrains/vit-pytorchStars: 25,555PythonLTS
- lucidrains/DALLE2-pytorchStars: 11,306PythonStable
- lucidrains/denoising-diffusion-pytorchStars: 10,723PythonStable
- lucidrains/imagen-pytorchStars: 8,430PythonStable
- lucidrains/PaLM-rlhf-pytorchStars: 7,862PythonStable
- lucidrains/x-transformersStars: 5,962PythonStable
Nearby in Python
All Python repos- Git-on-my-level/codex-autorunnerStars: 877PythonBeta
- visualbruno/ComfyUI-Trellis2Stars: 877PythonBeta
- Tencent-Hunyuan/HY-EmbodiedStars: 877PythonBeta
- PySpice-org/PySpiceStars: 877PythonBeta
- ITCoders/Human-detection-and-TrackingStars: 877PythonBeta
- google/hdrnetStars: 877PythonBeta