# RobertCsordas/moe\_attention

<https://repo.masters-masters.com/en/repos/RobertCsordas/moe_attention>

[Home](https://repo.masters-masters.com/en) › [RobertCsordas](https://repo.masters-masters.com/en/owners/RobertCsordas) › [moe\_attention](https://repo.masters-masters.com/en/repos/RobertCsordas/moe_attention)

RobertCsordas/moe\_attention has 102 stars on GitHub. Its RepoMasters card: Prototype tier. Official repository for the paper "SwitchHead: Accelerating…

| Field | Value |
| --- | --- |
| Owner | [RobertCsordas](https://repo.masters-masters.com/en/owners/RobertCsordas) |
| Stars | 102 |
| Forks | 8 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2023 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [RobertCsordas/moe\_attention](https://github.com/RobertCsordas/moe_attention) |

## Repository

Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by RobertCsordas

- [RobertCsordas/RFCN-tensorflow · ★ 291 · Python · Alpha](https://repo.masters-masters.com/en/repos/RobertCsordas/RFCN-tensorflow)
- [RobertCsordas/OnyxNoteRenderer · ★ 115 · Python · Prototype](https://repo.masters-masters.com/en/repos/RobertCsordas/OnyxNoteRenderer)

## Nearby in Python

- [murrez/php2shell · ★ 102 · Python · Prototype](https://repo.masters-masters.com/en/repos/murrez/php2shell)
- [alexturkey/crisperwhisper-turkce-kelime-zamani · ★ 102 · Python · Prototype](https://repo.masters-masters.com/en/repos/alexturkey/crisperwhisper-turkce-kelime-zamani)
- [ilworkcn/MaiWeave · ★ 102 · Python · Prototype](https://repo.masters-masters.com/en/repos/ilworkcn/MaiWeave)
- [chb/indivo\_server · ★ 102 · Python · Prototype](https://repo.masters-masters.com/en/repos/chb/indivo_server)
- [irskep/pyglettutorial · ★ 102 · Python · Prototype](https://repo.masters-masters.com/en/repos/irskep/pyglettutorial)
- [willrjmarshall/AbletonDJTemplateUnsupported · ★ 102 · Python · Prototype](https://repo.masters-masters.com/en/repos/willrjmarshall/AbletonDJTemplateUnsupported)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.