# turboderp-org/exllamav2

<https://repo.masters-masters.com/en/repos/turboderp-org/exllamav2>

[Home](https://repo.masters-masters.com/en) › [turboderp-org](https://repo.masters-masters.com/en/owners/turboderp-org) › [exllamav2](https://repo.masters-masters.com/en/repos/turboderp-org/exllamav2)

turboderp-org/exllamav2 has 4,649 stars on GitHub. Its RepoMasters card: RC tier. A fast inference library for running LLMs locally on modern consumer-class…

| Field | Value |
| --- | --- |
| Owner | [turboderp-org](https://repo.masters-masters.com/en/owners/turboderp-org) |
| Stars | 4,649 |
| Forks | 348 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2023 |
| Tier | [RC (2,000 to 4,999 ★)](https://repo.masters-masters.com/en/ranks/blockbuster) |
| View on GitHub | [turboderp-org/exllamav2](https://github.com/turboderp-org/exllamav2) |

## Repository

A fast inference library for running LLMs locally on modern consumer-class GPUs

The tier for repos with 2,000 to 4,999 ★. Published odds per card pulled: 3%. Rarity: Epic.

## More repos by turboderp-org

- [turboderp-org/exllamav3 · ★ 1,785 · Python · Beta](https://repo.masters-masters.com/en/repos/turboderp-org/exllamav3)
- [turboderp-org/exui · ★ 517 · JavaScript · Alpha](https://repo.masters-masters.com/en/repos/turboderp-org/exui)

## Nearby in Python

- [sweetice/Deep-reinforcement-learning-with-pytorch · ★ 4,653 · Python · RC](https://repo.masters-masters.com/en/repos/sweetice/Deep-reinforcement-learning-with-pytorch)
- [ReversecLabs/drozer · ★ 4,649 · Python · RC](https://repo.masters-masters.com/en/repos/ReversecLabs/drozer)
- [Seeed-Projects/reBot-DevArm · ★ 4,649 · Python · RC](https://repo.masters-masters.com/en/repos/Seeed-Projects/reBot-DevArm)
- [tlkh/asitop · ★ 4,645 · Python · RC](https://repo.masters-masters.com/en/repos/tlkh/asitop)
- [promptslab/Promptify · ★ 4,645 · Python · RC](https://repo.masters-masters.com/en/repos/promptslab/Promptify)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.