# turboderp/exllama

<https://repo.masters-masters.com/en/repos/turboderp/exllama>

[Home](https://repo.masters-masters.com/en) › [turboderp](https://repo.masters-masters.com/en/owners/turboderp) › [exllama](https://repo.masters-masters.com/en/repos/turboderp/exllama)

turboderp/exllama has 2,946 stars on GitHub. Its RepoMasters card: RC tier. A more memory-efficient rewrite of the HF transformers implementation of Llama for…

| Field | Value |
| --- | --- |
| Owner | [turboderp](https://repo.masters-masters.com/en/owners/turboderp) |
| Stars | 2,946 |
| Forks | 219 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2023 |
| Tier | [RC (2,000 to 4,999 ★)](https://repo.masters-masters.com/en/ranks/blockbuster) |
| View on GitHub | [turboderp/exllama](https://github.com/turboderp/exllama) |

## Repository

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

The tier for repos with 2,000 to 4,999 ★. Published odds per card pulled: 3%. Rarity: Epic.

## Nearby in Python

- [microsoft/table-transformer · ★ 2,948 · Python · RC](https://repo.masters-masters.com/en/repos/microsoft/table-transformer)
- [memodb-io/memobase · ★ 2,946 · Python · RC](https://repo.masters-masters.com/en/repos/memodb-io/memobase)
- [Vincentwei1021/mg-styles-15 · ★ 2,946 · Python · RC](https://repo.masters-masters.com/en/repos/Vincentwei1021/mg-styles-15)
- [jamesmawm/High-Frequency-Trading-Model-with-IB · ★ 2,945 · Python · RC](https://repo.masters-masters.com/en/repos/jamesmawm/High-Frequency-Trading-Model-with-IB)
- [ehForwarderBot/ehForwarderBot · ★ 2,945 · Python · RC](https://repo.masters-masters.com/en/repos/ehForwarderBot/ehForwarderBot)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.