# IAAR-Shanghai/Awesome-Attention-Heads

<https://repo.masters-masters.com/en/repos/IAAR-Shanghai/Awesome-Attention-Heads>

[Home](https://repo.masters-masters.com/en) › [IAAR-Shanghai](https://repo.masters-masters.com/en/owners/IAAR-Shanghai) › [Awesome-Attention-Heads](https://repo.masters-masters.com/en/repos/IAAR-Shanghai/Awesome-Attention-Heads)

IAAR-Shanghai/Awesome-Attention-Heads has 413 stars on GitHub. Its RepoMasters card: Alpha tier. An awesome repository & A comprehensive survey on…

| Field | Value |
| --- | --- |
| Owner | [IAAR-Shanghai](https://repo.masters-masters.com/en/owners/IAAR-Shanghai) |
| Stars | 413 |
| Forks | 12 |
| Language | [TeX](https://repo.masters-masters.com/en/languages/tex) |
| License | None |
| Created | 2024 |
| Topics | attention-mechanism, awesome, interpretability, transformer, survey, attention-head-mining, circuit-analysis, cognitive-neuroscience, gpt, llm |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [IAAR-Shanghai/Awesome-Attention-Heads](https://github.com/IAAR-Shanghai/Awesome-Attention-Heads) |

## Repository

An awesome repository & A comprehensive survey on interpretability of LLM attention heads.

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by IAAR-Shanghai

- [IAAR-Shanghai/Awesome-AI-Memory · ★ 1,299 · Python · Beta](https://repo.masters-masters.com/en/repos/IAAR-Shanghai/Awesome-AI-Memory)
- [IAAR-Shanghai/SurveyX · ★ 996 · TeX · Beta](https://repo.masters-masters.com/en/repos/IAAR-Shanghai/SurveyX)
- [IAAR-Shanghai/CRUD\_RAG · ★ 419 · Python · Alpha](https://repo.masters-masters.com/en/repos/IAAR-Shanghai/CRUD_RAG)
- [IAAR-Shanghai/Meta-Chunking · ★ 278 · Python · Alpha](https://repo.masters-masters.com/en/repos/IAAR-Shanghai/Meta-Chunking)
- [IAAR-Shanghai/CTGSurvey · ★ 205 · TeX · Prototype](https://repo.masters-masters.com/en/repos/IAAR-Shanghai/CTGSurvey)
- [IAAR-Shanghai/UHGEval · ★ 184 · Python · Prototype](https://repo.masters-masters.com/en/repos/IAAR-Shanghai/UHGEval)

## Nearby in TeX

- [conal/talk-2015-essence-and-origins-of-frp · ★ 418 · TeX · Alpha](https://repo.masters-masters.com/en/repos/conal/talk-2015-essence-and-origins-of-frp)
- [Urinx/LaTeX-PPT-Template · ★ 418 · TeX · Alpha](https://repo.masters-masters.com/en/repos/Urinx/LaTeX-PPT-Template)
- [ryankeleti/ega · ★ 413 · TeX · Alpha](https://repo.masters-masters.com/en/repos/ryankeleti/ega)
- [norbusan/eagloss · ★ 412 · TeX · Alpha](https://repo.masters-masters.com/en/repos/norbusan/eagloss)
- [nuaatug/nuaathesis · ★ 412 · TeX · Alpha](https://repo.masters-masters.com/en/repos/nuaatug/nuaathesis)
- [brynhayder/reinforcement\_learning\_an\_introduction · ★ 411 · TeX · Alpha](https://repo.masters-masters.com/en/repos/brynhayder/reinforcement_learning_an_introduction)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.