# ModelCloud/GPTQModel

<https://repo.masters-masters.com/en/repos/ModelCloud/GPTQModel>

[Home](https://repo.masters-masters.com/en) › [ModelCloud](https://repo.masters-masters.com/en/owners/ModelCloud) › [GPTQModel](https://repo.masters-masters.com/en/repos/ModelCloud/GPTQModel)

ModelCloud/GPTQModel has 1,284 stars on GitHub. Its RepoMasters card: Beta tier. LLM model quantization (compression) toolkit with HW acceleration support for…

| Field | Value |
| --- | --- |
| Owner | [ModelCloud](https://repo.masters-masters.com/en/owners/ModelCloud) |
| Stars | 1,284 |
| Forks | 213 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2024 |
| Topics | gptq, optimum, peft, quantization, sglang, transformers, vllm |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [ModelCloud/GPTQModel](https://github.com/ModelCloud/GPTQModel) |

## Repository

LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## Nearby in Python

- [YuanxunLu/LiveSpeechPortraits · ★ 1,284 · Python · Beta](https://repo.masters-masters.com/en/repos/YuanxunLu/LiveSpeechPortraits)
- [dcharatan/pixelsplat · ★ 1,284 · Python · Beta](https://repo.masters-masters.com/en/repos/dcharatan/pixelsplat)
- [Visual-Agent/DeepEyes · ★ 1,284 · Python · Beta](https://repo.masters-masters.com/en/repos/Visual-Agent/DeepEyes)
- [ForensicArtifacts/artifacts · ★ 1,284 · Python · Beta](https://repo.masters-masters.com/en/repos/ForensicArtifacts/artifacts)
- [Prinsphield/Wechat\_AutoJump · ★ 1,284 · Python · Beta](https://repo.masters-masters.com/en/repos/Prinsphield/Wechat_AutoJump)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.