Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

snu-mllab/KVzip

[NeurIPS'25 Oral] Query-agnostic KV cache eviction: 3–4× reduction in memory and 2× decrease in latency (Qwen3/2.5, Gemma3, LLaMA3)

Owner
snu-mllab (organization)
Stars
Stars: 228
Forks
Forks: 15
Language
Python
License
MIT
Created
2025
Topics
kv-cache-compressionlarge-language-models
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by snu-mllab

All 4 repos by snu-mllab

Nearby in Python

All Python repos