# sail-sg/Attention-Sink

<https://repo.masters-masters.com/en/repos/sail-sg/Attention-Sink>

[Home](https://repo.masters-masters.com/en) › [sail-sg](https://repo.masters-masters.com/en/owners/sail-sg) › [Attention-Sink](https://repo.masters-masters.com/en/repos/sail-sg/Attention-Sink)

sail-sg/Attention-Sink has 164 stars on GitHub. Its RepoMasters card: Prototype tier. \[ICLR 2025\] When Attention Sink Emerges in Language Models: An Empirical…

| Field | Value |
| --- | --- |
| Owner | [sail-sg](https://repo.masters-masters.com/en/owners/sail-sg) |
| Stars | 164 |
| Forks | 5 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2024 |
| Topics | attention-mechanism, attention-sink, language-model, large-language-models |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [sail-sg/Attention-Sink](https://github.com/sail-sg/Attention-Sink) |

## Repository

\[ICLR 2025\] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by sail-sg

- [sail-sg/EditAnything · ★ 3,423 · Python · RC](https://repo.masters-masters.com/en/repos/sail-sg/EditAnything)
- [sail-sg/envpool · ★ 1,533 · C++ · Beta](https://repo.masters-masters.com/en/repos/sail-sg/envpool)
- [sail-sg/poolformer · ★ 1,367 · Python · Beta](https://repo.masters-masters.com/en/repos/sail-sg/poolformer)
- [sail-sg/understand-r1-zero · ★ 1,286 · Python · Beta](https://repo.masters-masters.com/en/repos/sail-sg/understand-r1-zero)
- [sail-sg/volo · ★ 947 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/sail-sg/volo)
- [sail-sg/Adan · ★ 825 · Python · Beta](https://repo.masters-masters.com/en/repos/sail-sg/Adan)

## Nearby in Python

- [thetahealth/mirobody-env · ★ 164 · Python · Prototype](https://repo.masters-masters.com/en/repos/thetahealth/mirobody-env)
- [VectifyAI/jev-doc-search · ★ 164 · Python · Prototype](https://repo.masters-masters.com/en/repos/VectifyAI/jev-doc-search)
- [matt-pio00p9/YouTube-Views-Boost-Free-View-Booster-Growth-Tool-2026 · ★ 164 · Python · Prototype](https://repo.masters-masters.com/en/repos/matt-pio00p9/YouTube-Views-Boost-Free-View-Booster-Growth-Tool-2026)
- [tjweir/liftbook · ★ 164 · Python · Prototype](https://repo.masters-masters.com/en/repos/tjweir/liftbook)
- [simonw/django-openid · ★ 164 · Python · Prototype](https://repo.masters-masters.com/en/repos/simonw/django-openid)
- [anirudhjoshi/lastpass2keepass · ★ 164 · Python · Prototype](https://repo.masters-masters.com/en/repos/anirudhjoshi/lastpass2keepass)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.