Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

microsoft/RetrievalAttention

[VLDB 26, NeurIPS 25] Scalable long-context LLM decoding that leverages sparsity—by treating the KV cache as a vector storage system.

Owner
microsoft (organization)
Stars
Stars: 153
Forks
Forks: 36
Language
Python
License
MIT
Created
2024
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by microsoft

All 1,923 repos by microsoft

Nearby in Python

All Python repos