# qiuzh20/gated\_attention

<https://repo.masters-masters.com/en/repos/qiuzh20/gated_attention>

[Home](https://repo.masters-masters.com/en) › [qiuzh20](https://repo.masters-masters.com/en/owners/qiuzh20) › [gated\_attention](https://repo.masters-masters.com/en/repos/qiuzh20/gated_attention)

qiuzh20/gated\_attention has 991 stars on GitHub. Its RepoMasters card: Beta tier. The official implementation for \[NeurIPS2025 Oral\] Gated Attention for Large…

| Field | Value |
| --- | --- |
| Owner | [qiuzh20](https://repo.masters-masters.com/en/owners/qiuzh20) |
| Stars | 991 |
| Forks | 61 |
| Language | [Jupyter Notebook](https://repo.masters-masters.com/en/languages/jupyter-notebook) |
| License | MIT |
| Created | 2025 |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [qiuzh20/gated\_attention](https://github.com/qiuzh20/gated_attention) |

## Repository

The official implementation for \[NeurIPS2025 Oral\] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## Nearby in Jupyter Notebook

- [ematvey/tensorflow-seq2seq-tutorials · ★ 991 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/ematvey/tensorflow-seq2seq-tutorials)
- [timsainb/tensorflow2-generative-models · ★ 991 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/timsainb/tensorflow2-generative-models)
- [TheCaduceus/WARP-UNLIMITED-ADVANCED · ★ 991 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/TheCaduceus/WARP-UNLIMITED-ADVANCED)
- [deanwampler/spark-scala-tutorial · ★ 990 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/deanwampler/spark-scala-tutorial)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.