Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

whyNLP/LCKV

Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance. Accepted to ACL 2024.

Owner
whyNLP (organization)
Stars
Stars: 156
Forks
Forks: 14
Language
Python
License
None
Created
2024
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos