AlphaUncommon
lena-voita/the-story-of-heads
This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned" and the ACL 2021 paper "Analyzing Source and Target Contributions to NMT Predictions".
- Owner
- lena-voita (personal account)
- Stars
- Stars: 325
- Forks
- Forks: 49
- Language
- Python
- License
- None
- Created
- 2019
- Topics
- transformerattention-heads
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by lena-voita
All 2 repos by lena-voita- lena-voita/good-translation-wrong-in-contextStars: 101PythonPrototype
Nearby in Python
All Python repos- qshanx/docs-governanceStars: 325PythonAlpha
- alexan0618/zkkyStars: 325PythonAlpha
- erikwb/blueferryStars: 325PythonAlpha
- PyMVPA/PyMVPAStars: 325PythonAlpha
- phunt/zktopStars: 325PythonAlpha
- last-partizan/pytilsStars: 325PythonAlpha