# kyegomez/Mixture-of-Depths

<https://repo.masters-masters.com/en/repos/kyegomez/Mixture-of-Depths>

[Home](https://repo.masters-masters.com/en) › [kyegomez](https://repo.masters-masters.com/en/owners/kyegomez) › [Mixture-of-Depths](https://repo.masters-masters.com/en/repos/kyegomez/Mixture-of-Depths)

kyegomez/Mixture-of-Depths has 124 stars on GitHub. Its RepoMasters card: Prototype tier. Implementation of the paper: "Mixture-of-Depths: Dynamically…

| Field | Value |
| --- | --- |
| Owner | [kyegomez](https://repo.masters-masters.com/en/owners/kyegomez) |
| Stars | 124 |
| Forks | 9 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2024 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [kyegomez/Mixture-of-Depths](https://github.com/kyegomez/Mixture-of-Depths) |

## Repository

Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by kyegomez

- [kyegomez/OpenMythos · ★ 14,924 · Python · Stable](https://repo.masters-masters.com/en/repos/kyegomez/OpenMythos)
- [kyegomez/swarms · ★ 7,350 · Python · Stable](https://repo.masters-masters.com/en/repos/kyegomez/swarms)
- [kyegomez/tree-of-thoughts · ★ 4,593 · Python · RC](https://repo.masters-masters.com/en/repos/kyegomez/tree-of-thoughts)
- [kyegomez/BitNet · ★ 1,949 · Python · Beta](https://repo.masters-masters.com/en/repos/kyegomez/BitNet)
- [kyegomez/awesome-multi-agent-papers · ★ 1,707 · TeX · Beta](https://repo.masters-masters.com/en/repos/kyegomez/awesome-multi-agent-papers)
- [kyegomez/Open-AF3 · ★ 808 · Python · Beta](https://repo.masters-masters.com/en/repos/kyegomez/Open-AF3)

## Nearby in Python

- [TttMc/mcd-budget-bite · ★ 124 · Python · Prototype](https://repo.masters-masters.com/en/repos/TttMc/mcd-budget-bite)
- [ant-intl/BizAgentBench · ★ 124 · Python · Prototype](https://repo.masters-masters.com/en/repos/ant-intl/BizAgentBench)
- [xyzhangxin/sony-a6700-powerful · ★ 124 · Python · Prototype](https://repo.masters-masters.com/en/repos/xyzhangxin/sony-a6700-powerful)
- [labjack/LabJackPython · ★ 124 · Python · Prototype](https://repo.masters-masters.com/en/repos/labjack/LabJackPython)
- [django-cms/cmsplugin-filer · ★ 124 · Python · Prototype](https://repo.masters-masters.com/en/repos/django-cms/cmsplugin-filer)
- [OpenTreeMap/otm-legacy · ★ 124 · Python · Prototype](https://repo.masters-masters.com/en/repos/OpenTreeMap/otm-legacy)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.