# lena-voita/the-story-of-heads

<https://repo.masters-masters.com/en/repos/lena-voita/the-story-of-heads>

[Home](https://repo.masters-masters.com/en) › [lena-voita](https://repo.masters-masters.com/en/owners/lena-voita) › [the-story-of-heads](https://repo.masters-masters.com/en/repos/lena-voita/the-story-of-heads)

lena-voita/the-story-of-heads has 325 stars on GitHub. Its RepoMasters card: Alpha tier. This is a repository with the code for the ACL 2019 paper "Analyzing…

| Field | Value |
| --- | --- |
| Owner | [lena-voita](https://repo.masters-masters.com/en/owners/lena-voita) |
| Stars | 325 |
| Forks | 49 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2019 |
| Topics | transformer, attention-heads |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [lena-voita/the-story-of-heads](https://github.com/lena-voita/the-story-of-heads) |

## Repository

This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned" and the ACL 2021 paper "Analyzing Source and Target Contributions to NMT Predictions".

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by lena-voita

- [lena-voita/good-translation-wrong-in-context · ★ 101 · Python · Prototype](https://repo.masters-masters.com/en/repos/lena-voita/good-translation-wrong-in-context)

## Nearby in Python

- [qshanx/docs-governance · ★ 325 · Python · Alpha](https://repo.masters-masters.com/en/repos/qshanx/docs-governance)
- [alexan0618/zkky · ★ 325 · Python · Alpha](https://repo.masters-masters.com/en/repos/alexan0618/zkky)
- [erikwb/blueferry · ★ 325 · Python · Alpha](https://repo.masters-masters.com/en/repos/erikwb/blueferry)
- [PyMVPA/PyMVPA · ★ 325 · Python · Alpha](https://repo.masters-masters.com/en/repos/PyMVPA/PyMVPA)
- [phunt/zktop · ★ 325 · Python · Alpha](https://repo.masters-masters.com/en/repos/phunt/zktop)
- [last-partizan/pytils · ★ 325 · Python · Alpha](https://repo.masters-masters.com/en/repos/last-partizan/pytils)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.