# thu-nics/MoA

<https://repo.masters-masters.com/en/repos/thu-nics/MoA>

[Home](https://repo.masters-masters.com/en) › [thu-nics](https://repo.masters-masters.com/en/owners/thu-nics) › [MoA](https://repo.masters-masters.com/en/repos/thu-nics/MoA)

thu-nics/MoA has 163 stars on GitHub. Its RepoMasters card: Prototype tier. \[CoLM'25\] The official implementation of the paper \<MoA: Mixture of Sparse…

| Field | Value |
| --- | --- |
| Owner | [thu-nics](https://repo.masters-masters.com/en/owners/thu-nics) |
| Stars | 163 |
| Forks | 9 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2024 |
| Topics | large-language-models, model-compression, sparse-attention |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [thu-nics/MoA](https://github.com/thu-nics/MoA) |

## Repository

\[CoLM'25\] The official implementation of the paper \<MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression\>

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by thu-nics

- [thu-nics/C2C · ★ 769 · Python · Beta](https://repo.masters-masters.com/en/repos/thu-nics/C2C)
- [thu-nics/awesome\_ai4eda · ★ 297 · Alpha](https://repo.masters-masters.com/en/repos/thu-nics/awesome_ai4eda)
- [thu-nics/MNSIM-2.0 · ★ 219 · Python · Prototype](https://repo.masters-masters.com/en/repos/thu-nics/MNSIM-2.0)
- [thu-nics/DiTFastAttn · ★ 192 · Jupyter Notebook · Prototype](https://repo.masters-masters.com/en/repos/thu-nics/DiTFastAttn)
- [thu-nics/AKV · ★ 171 · Python · Prototype](https://repo.masters-masters.com/en/repos/thu-nics/AKV)
- [thu-nics/ViDiT-Q · ★ 170 · Python · Prototype](https://repo.masters-masters.com/en/repos/thu-nics/ViDiT-Q)

## Nearby in Python

- [amathislab/terra · ★ 163 · Python · Prototype](https://repo.masters-masters.com/en/repos/amathislab/terra)
- [weike-zhang/architecture-canvas · ★ 163 · Python · Prototype](https://repo.masters-masters.com/en/repos/weike-zhang/architecture-canvas)
- [Zenith-3D-Team/Zenith · ★ 163 · Python · Prototype](https://repo.masters-masters.com/en/repos/Zenith-3D-Team/Zenith)
- [josephwilk/semanticpy · ★ 163 · Python · Prototype](https://repo.masters-masters.com/en/repos/josephwilk/semanticpy)
- [jimfunk/django-postgresql-netfields · ★ 163 · Python · Prototype](https://repo.masters-masters.com/en/repos/jimfunk/django-postgresql-netfields)
- [hydralabs/pyamf · ★ 163 · Python · Prototype](https://repo.masters-masters.com/en/repos/hydralabs/pyamf)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.