# IsaacRe/vllm-kvcompress

<https://repo.masters-masters.com/en/repos/IsaacRe/vllm-kvcompress>

[Home](https://repo.masters-masters.com/en) › [IsaacRe](https://repo.masters-masters.com/en/owners/IsaacRe) › [vllm-kvcompress](https://repo.masters-masters.com/en/repos/IsaacRe/vllm-kvcompress)

IsaacRe/vllm-kvcompress has 163 stars on GitHub. Its RepoMasters card: Prototype tier. KV cache compression for high-throughput LLM inference Language: Python.

| Field | Value |
| --- | --- |
| Owner | [IsaacRe](https://repo.masters-masters.com/en/owners/IsaacRe) |
| Stars | 163 |
| Forks | 7 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2024 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [IsaacRe/vllm-kvcompress](https://github.com/IsaacRe/vllm-kvcompress) |

## Repository

KV cache compression for high-throughput LLM inference

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## Nearby in Python

- [amathislab/terra · ★ 163 · Python · Prototype](https://repo.masters-masters.com/en/repos/amathislab/terra)
- [weike-zhang/architecture-canvas · ★ 163 · Python · Prototype](https://repo.masters-masters.com/en/repos/weike-zhang/architecture-canvas)
- [Zenith-3D-Team/Zenith · ★ 163 · Python · Prototype](https://repo.masters-masters.com/en/repos/Zenith-3D-Team/Zenith)
- [josephwilk/semanticpy · ★ 163 · Python · Prototype](https://repo.masters-masters.com/en/repos/josephwilk/semanticpy)
- [jimfunk/django-postgresql-netfields · ★ 163 · Python · Prototype](https://repo.masters-masters.com/en/repos/jimfunk/django-postgresql-netfields)
- [hydralabs/pyamf · ★ 163 · Python · Prototype](https://repo.masters-masters.com/en/repos/hydralabs/pyamf)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.