Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
BetaRare

thu-ml/SpargeAttn

[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.

Owner
thu-ml (organization)
Stars
Stars: 1,266
Forks
Forks: 108
Language
Cuda
License
Apache-2.0
Created
2025
Topics
ai-infraattentioninference-accelerationllmmlsysquantizationsparse-attentionvision-transformersageattentionvideo-generation
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

More repos by thu-ml

All 27 repos by thu-ml

Nearby in Cuda

All Cuda repos