# jy-yuan/KIVI

<https://repo.masters-masters.com/en/repos/jy-yuan/KIVI>

[Home](https://repo.masters-masters.com/en) › [jy-yuan](https://repo.masters-masters.com/en/owners/jy-yuan) › [KIVI](https://repo.masters-masters.com/en/repos/jy-yuan/KIVI)

jy-yuan/KIVI has 438 stars on GitHub. Its RepoMasters card: Alpha tier. \[ICML 2024\] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

| Field | Value |
| --- | --- |
| Owner | [jy-yuan](https://repo.masters-masters.com/en/owners/jy-yuan) |
| Stars | 438 |
| Forks | 57 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2024 |
| Topics | inference, large-language-models, llama, llm, natural-language-processing, quantization, transformer |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [jy-yuan/KIVI](https://github.com/jy-yuan/KIVI) |

## Repository

\[ICML 2024\] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## Nearby in Python

- [chi2liu/ABC-GRPO · ★ 438 · Python · Alpha](https://repo.masters-masters.com/en/repos/chi2liu/ABC-GRPO)
- [blessonism/search-skills · ★ 438 · Python · Alpha](https://repo.masters-masters.com/en/repos/blessonism/search-skills)
- [guilyx/grip · ★ 438 · Python · Alpha](https://repo.masters-masters.com/en/repos/guilyx/grip)
- [furious-luke/django-address · ★ 438 · Python · Alpha](https://repo.masters-masters.com/en/repos/furious-luke/django-address)
- [jvantuyl/sublime\_diagram\_plugin · ★ 438 · Python · Alpha](https://repo.masters-masters.com/en/repos/jvantuyl/sublime_diagram_plugin)
- [emanuele/kaggle\_pbr · ★ 438 · Python · Alpha](https://repo.masters-masters.com/en/repos/emanuele/kaggle_pbr)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.