# astramind-ai/Mixture-of-depths

<https://repo.masters-masters.com/en/repos/astramind-ai/Mixture-of-depths>

[Home](https://repo.masters-masters.com/en) › [astramind-ai](https://repo.masters-masters.com/en/owners/astramind-ai) › [Mixture-of-depths](https://repo.masters-masters.com/en/repos/astramind-ai/Mixture-of-depths)

astramind-ai/Mixture-of-depths has 176 stars on GitHub. Its RepoMasters card: Prototype tier. Unofficial implementation for the paper "Mixture-of-Depths…

| Field | Value |
| --- | --- |
| Owner | [astramind-ai](https://repo.masters-masters.com/en/owners/astramind-ai) |
| Stars | 176 |
| Forks | 16 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2024 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [astramind-ai/Mixture-of-depths](https://github.com/astramind-ai/Mixture-of-depths) |

## Repository

Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by astramind-ai

- [astramind-ai/Auralis · ★ 623 · Python · Alpha](https://repo.masters-masters.com/en/repos/astramind-ai/Auralis)
- [astramind-ai/BitMat · ★ 153 · Python · Prototype](https://repo.masters-masters.com/en/repos/astramind-ai/BitMat)

## Nearby in Python

- [seedleap/zing-world-model · ★ 176 · Python · Prototype](https://repo.masters-masters.com/en/repos/seedleap/zing-world-model)
- [Lucasuiii/modeling-workbench · ★ 176 · Python · Prototype](https://repo.masters-masters.com/en/repos/Lucasuiii/modeling-workbench)
- [GroundedCoreAI/nexusdesk · ★ 176 · Python · Prototype](https://repo.masters-masters.com/en/repos/GroundedCoreAI/nexusdesk)
- [MacSysadmin/pymacadmin · ★ 176 · Python · Prototype](https://repo.masters-masters.com/en/repos/MacSysadmin/pymacadmin)
- [leah/python-oauth · ★ 176 · Python · Prototype](https://repo.masters-masters.com/en/repos/leah/python-oauth)
- [tobami/overmind · ★ 176 · Python · Prototype](https://repo.masters-masters.com/en/repos/tobami/overmind)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.