Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
BetaRare

qiuzh20/gated_attention

The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free

Owner
qiuzh20 (personal account)
Stars
Stars: 991
Forks
Forks: 61
Language
Jupyter Notebook
License
MIT
Created
2025
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

Nearby in Jupyter Notebook

All Jupyter Notebook repos