# kyegomez/SwitchTransformers

<https://repo.masters-masters.com/en/repos/kyegomez/SwitchTransformers>

[Home](https://repo.masters-masters.com/en) › [kyegomez](https://repo.masters-masters.com/en/owners/kyegomez) › [SwitchTransformers](https://repo.masters-masters.com/en/repos/kyegomez/SwitchTransformers)

kyegomez/SwitchTransformers has 148 stars on GitHub. Its RepoMasters card: Prototype tier. Implementation of Switch Transformers from the paper: "Switch…

| Field | Value |
| --- | --- |
| Owner | [kyegomez](https://repo.masters-masters.com/en/owners/kyegomez) |
| Stars | 148 |
| Forks | 17 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2024 |
| Topics | ai, gpt4, llama, mixture-of-experts, ml, moe, multi-modal, mixture-model, mixture-of-models |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [kyegomez/SwitchTransformers](https://github.com/kyegomez/SwitchTransformers) |

## Repository

Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by kyegomez

- [kyegomez/OpenMythos · ★ 14,924 · Python · Stable](https://repo.masters-masters.com/en/repos/kyegomez/OpenMythos)
- [kyegomez/swarms · ★ 7,350 · Python · Stable](https://repo.masters-masters.com/en/repos/kyegomez/swarms)
- [kyegomez/tree-of-thoughts · ★ 4,593 · Python · RC](https://repo.masters-masters.com/en/repos/kyegomez/tree-of-thoughts)
- [kyegomez/BitNet · ★ 1,949 · Python · Beta](https://repo.masters-masters.com/en/repos/kyegomez/BitNet)
- [kyegomez/awesome-multi-agent-papers · ★ 1,707 · TeX · Beta](https://repo.masters-masters.com/en/repos/kyegomez/awesome-multi-agent-papers)
- [kyegomez/Open-AF3 · ★ 808 · Python · Beta](https://repo.masters-masters.com/en/repos/kyegomez/Open-AF3)

## Nearby in Python

- [849879772/recruitops-agent · ★ 148 · Python · Prototype](https://repo.masters-masters.com/en/repos/849879772/recruitops-agent)
- [polaris-smart/mcd-agent-gourmet · ★ 148 · Python · Prototype](https://repo.masters-masters.com/en/repos/polaris-smart/mcd-agent-gourmet)
- [1314521gjy/ComfyUI-Local-Infinite-Canvas · ★ 148 · Python · Prototype](https://repo.masters-masters.com/en/repos/1314521gjy/ComfyUI-Local-Infinite-Canvas)
- [ntt/eveapi · ★ 148 · Python · Prototype](https://repo.masters-masters.com/en/repos/ntt/eveapi)
- [neuroo/grabber · ★ 148 · Python · Prototype](https://repo.masters-masters.com/en/repos/neuroo/grabber)
- [TkTech/Burger · ★ 148 · Python · Prototype](https://repo.masters-masters.com/en/repos/TkTech/Burger)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.