Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

ChenMnZ/PrefixQuant

An algorithm for weight-activation quantization (W4A4, W4A8) of LLMs, supporting both static and dynamic quantization

Owner
ChenMnZ (personal account)
Stars
Stars: 178
Forks
Forks: 19
Language
Python
License
Apache-2.0
Created
2024
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by ChenMnZ

All 2 repos by ChenMnZ

Nearby in Python

All Python repos