Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

wejoncy/QLLM

A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.

Owner
wejoncy (personal account)
Stars
Stars: 192
Forks
Forks: 19
Language
Python
License
Apache-2.0
Created
2023
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos