Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
BetaRare

tomaarsen/attention_sinks

Extend existing LLMs way beyond the original training length with constant memory usage, without retraining

Owner
tomaarsen (personal account)
Stars
Stars: 734
Forks
Forks: 43
Language
Python
License
Apache-2.0
Created
2023
Topics
llmllmsnlppythontransformers
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

More repos by tomaarsen

All 3 repos by tomaarsen

Nearby in Python

All Python repos