Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

thu-nics/MoA

[CoLM'25] The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>

Owner
thu-nics (organization)
Stars
Stars: 163
Forks
Forks: 9
Language
Python
License
MIT
Created
2024
Topics
large-language-modelsmodel-compressionsparse-attention
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by thu-nics

All 10 repos by thu-nics

Nearby in Python

All Python repos