# turboderp-org/exllamav3

<https://repo.masters-masters.com/en/repos/turboderp-org/exllamav3>

[Home](https://repo.masters-masters.com/en) › [turboderp-org](https://repo.masters-masters.com/en/owners/turboderp-org) › [exllamav3](https://repo.masters-masters.com/en/repos/turboderp-org/exllamav3)

turboderp-org/exllamav3 has 1,785 stars on GitHub. Its RepoMasters card: Beta tier. An optimized quantization and inference library for running LLMs locally…

| Field | Value |
| --- | --- |
| Owner | [turboderp-org](https://repo.masters-masters.com/en/owners/turboderp-org) |
| Stars | 1,785 |
| Forks | 282 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2025 |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [turboderp-org/exllamav3](https://github.com/turboderp-org/exllamav3) |

## Repository

An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by turboderp-org

- [turboderp-org/exllamav2 · ★ 4,649 · Python · RC](https://repo.masters-masters.com/en/repos/turboderp-org/exllamav2)
- [turboderp-org/exui · ★ 517 · JavaScript · Alpha](https://repo.masters-masters.com/en/repos/turboderp-org/exui)

## Nearby in Python

- [ZainCheung/netease-cloud · ★ 1,785 · Python · Beta](https://repo.masters-masters.com/en/repos/ZainCheung/netease-cloud)
- [IntelLabs/fastRAG · ★ 1,785 · Python · Beta](https://repo.masters-masters.com/en/repos/IntelLabs/fastRAG)
- [Simple-Efficient/RL-Factory · ★ 1,785 · Python · Beta](https://repo.masters-masters.com/en/repos/Simple-Efficient/RL-Factory)
- [googleprojectzero/domato · ★ 1,785 · Python · Beta](https://repo.masters-masters.com/en/repos/googleprojectzero/domato)
- [mrh0wl/Cloudmare · ★ 1,785 · Python · Beta](https://repo.masters-masters.com/en/repos/mrh0wl/Cloudmare)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.