# facebookresearch/Mixture-of-Transformers

<https://repo.masters-masters.com/en/repos/facebookresearch/Mixture-of-Transformers>

[Home](https://repo.masters-masters.com/en) › [facebookresearch](https://repo.masters-masters.com/en/owners/facebookresearch) › [Mixture-of-Transformers](https://repo.masters-masters.com/en/repos/facebookresearch/Mixture-of-Transformers)

facebookresearch/Mixture-of-Transformers has 314 stars on GitHub. Its RepoMasters card: Alpha tier. Mixture-of-Transformers: A Sparse and Scalable…

| Field | Value |
| --- | --- |
| Owner | [facebookresearch](https://repo.masters-masters.com/en/owners/facebookresearch) |
| Stars | 314 |
| Forks | 12 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | BSD-3-Clause |
| Created | 2024 |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [facebookresearch/Mixture-of-Transformers](https://github.com/facebookresearch/Mixture-of-Transformers) |

## Repository

Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models. TMLR 2025.

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by facebookresearch

- [facebookresearch/segment-anything · ★ 55,098 · Jupyter Notebook · LTS](https://repo.masters-masters.com/en/repos/facebookresearch/segment-anything)
- [facebookresearch/faiss · ★ 41,256 · C++ · LTS](https://repo.masters-masters.com/en/repos/facebookresearch/faiss)
- [facebookresearch/detectron2 · ★ 34,966 · Python · LTS](https://repo.masters-masters.com/en/repos/facebookresearch/detectron2)
- [facebookresearch/fairseq · ★ 32,210 · Python · LTS](https://repo.masters-masters.com/en/repos/facebookresearch/fairseq)
- [facebookresearch/fastText · ★ 26,513 · HTML · LTS](https://repo.masters-masters.com/en/repos/facebookresearch/fastText)
- [facebookresearch/Detectron · ★ 26,341 · Python · LTS](https://repo.masters-masters.com/en/repos/facebookresearch/Detectron)

## Nearby in Python

- [salitronic/eda-agent · ★ 314 · Python · Alpha](https://repo.masters-masters.com/en/repos/salitronic/eda-agent)
- [Tencent-Hunyuan/Hy-Embodied-0.5-VLA · ★ 314 · Python · Alpha](https://repo.masters-masters.com/en/repos/Tencent-Hunyuan/Hy-Embodied-0.5-VLA)
- [bayshier/ghosttrack-zh · ★ 314 · Python · Alpha](https://repo.masters-masters.com/en/repos/bayshier/ghosttrack-zh)
- [pinax/pinax-badges · ★ 314 · Python · Alpha](https://repo.masters-masters.com/en/repos/pinax/pinax-badges)
- [rsennrich/Bleualign · ★ 314 · Python · Alpha](https://repo.masters-masters.com/en/repos/rsennrich/Bleualign)
- [makinacorpus/easydict · ★ 314 · Python · Alpha](https://repo.masters-masters.com/en/repos/makinacorpus/easydict)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.