# kyegomez/SparseAttention

<https://repo.masters-masters.com/en/repos/kyegomez/SparseAttention>

[Home](https://repo.masters-masters.com/en) › [kyegomez](https://repo.masters-masters.com/en/owners/kyegomez) › [SparseAttention](https://repo.masters-masters.com/en/repos/kyegomez/SparseAttention)

kyegomez/SparseAttention has 102 stars on GitHub. Its RepoMasters card: Prototype tier. Pytorch Implementation of the sparse attention from the paper…

| Field | Value |
| --- | --- |
| Owner | [kyegomez](https://repo.masters-masters.com/en/owners/kyegomez) |
| Stars | 102 |
| Forks | 7 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2023 |
| Topics | artificial-intelligence, attention-is-all-you-need, attention-mechanism, attention-mechanisms, machine-learning, sparse-matrix, sparse-attn |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [kyegomez/SparseAttention](https://github.com/kyegomez/SparseAttention) |

## Repository

Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by kyegomez

- [kyegomez/OpenMythos · ★ 14,924 · Python · Stable](https://repo.masters-masters.com/en/repos/kyegomez/OpenMythos)
- [kyegomez/swarms · ★ 7,350 · Python · Stable](https://repo.masters-masters.com/en/repos/kyegomez/swarms)
- [kyegomez/tree-of-thoughts · ★ 4,593 · Python · RC](https://repo.masters-masters.com/en/repos/kyegomez/tree-of-thoughts)
- [kyegomez/BitNet · ★ 1,949 · Python · Beta](https://repo.masters-masters.com/en/repos/kyegomez/BitNet)
- [kyegomez/awesome-multi-agent-papers · ★ 1,707 · TeX · Beta](https://repo.masters-masters.com/en/repos/kyegomez/awesome-multi-agent-papers)
- [kyegomez/Open-AF3 · ★ 808 · Python · Beta](https://repo.masters-masters.com/en/repos/kyegomez/Open-AF3)

## Nearby in Python

- [murrez/php2shell · ★ 102 · Python · Prototype](https://repo.masters-masters.com/en/repos/murrez/php2shell)
- [alexturkey/crisperwhisper-turkce-kelime-zamani · ★ 102 · Python · Prototype](https://repo.masters-masters.com/en/repos/alexturkey/crisperwhisper-turkce-kelime-zamani)
- [ilworkcn/MaiWeave · ★ 102 · Python · Prototype](https://repo.masters-masters.com/en/repos/ilworkcn/MaiWeave)
- [chb/indivo\_server · ★ 102 · Python · Prototype](https://repo.masters-masters.com/en/repos/chb/indivo_server)
- [irskep/pyglettutorial · ★ 102 · Python · Prototype](https://repo.masters-masters.com/en/repos/irskep/pyglettutorial)
- [willrjmarshall/AbletonDJTemplateUnsupported · ★ 102 · Python · Prototype](https://repo.masters-masters.com/en/repos/willrjmarshall/AbletonDJTemplateUnsupported)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.