# lucidrains/mixture-of-experts

<https://repo.masters-masters.com/en/repos/lucidrains/mixture-of-experts>

[Home](https://repo.masters-masters.com/en) › [lucidrains](https://repo.masters-masters.com/en/owners/lucidrains) › [mixture-of-experts](https://repo.masters-masters.com/en/repos/lucidrains/mixture-of-experts)

lucidrains/mixture-of-experts has 877 stars on GitHub. Its RepoMasters card: Beta tier. A Pytorch implementation of Sparsely-Gated Mixture of Experts, for…

| Field | Value |
| --- | --- |
| Owner | [lucidrains](https://repo.masters-masters.com/en/owners/lucidrains) |
| Stars | 877 |
| Forks | 70 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2020 |
| Topics | artificial-intelligence, deep-learning, transformer, mixture-of-experts |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [lucidrains/mixture-of-experts](https://github.com/lucidrains/mixture-of-experts) |

## Repository

A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by lucidrains

- [lucidrains/vit-pytorch · ★ 25,555 · Python · LTS](https://repo.masters-masters.com/en/repos/lucidrains/vit-pytorch)
- [lucidrains/DALLE2-pytorch · ★ 11,306 · Python · Stable](https://repo.masters-masters.com/en/repos/lucidrains/DALLE2-pytorch)
- [lucidrains/denoising-diffusion-pytorch · ★ 10,723 · Python · Stable](https://repo.masters-masters.com/en/repos/lucidrains/denoising-diffusion-pytorch)
- [lucidrains/imagen-pytorch · ★ 8,430 · Python · Stable](https://repo.masters-masters.com/en/repos/lucidrains/imagen-pytorch)
- [lucidrains/PaLM-rlhf-pytorch · ★ 7,862 · Python · Stable](https://repo.masters-masters.com/en/repos/lucidrains/PaLM-rlhf-pytorch)
- [lucidrains/x-transformers · ★ 5,962 · Python · Stable](https://repo.masters-masters.com/en/repos/lucidrains/x-transformers)

## Nearby in Python

- [Git-on-my-level/codex-autorunner · ★ 877 · Python · Beta](https://repo.masters-masters.com/en/repos/Git-on-my-level/codex-autorunner)
- [visualbruno/ComfyUI-Trellis2 · ★ 877 · Python · Beta](https://repo.masters-masters.com/en/repos/visualbruno/ComfyUI-Trellis2)
- [Tencent-Hunyuan/HY-Embodied · ★ 877 · Python · Beta](https://repo.masters-masters.com/en/repos/Tencent-Hunyuan/HY-Embodied)
- [PySpice-org/PySpice · ★ 877 · Python · Beta](https://repo.masters-masters.com/en/repos/PySpice-org/PySpice)
- [ITCoders/Human-detection-and-Tracking · ★ 877 · Python · Beta](https://repo.masters-masters.com/en/repos/ITCoders/Human-detection-and-Tracking)
- [google/hdrnet · ★ 877 · Python · Beta](https://repo.masters-masters.com/en/repos/google/hdrnet)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.