# dipampaul17/KVSplit

<https://repo.masters-masters.com/en/repos/dipampaul17/KVSplit>

[Home](https://repo.masters-masters.com/en) › [dipampaul17](https://repo.masters-masters.com/en/owners/dipampaul17) › [KVSplit](https://repo.masters-masters.com/en/repos/dipampaul17/KVSplit)

dipampaul17/KVSplit has 361 stars on GitHub. Its RepoMasters card: Alpha tier. Run larger LLMs with longer contexts on Apple Silicon by using differentiated…

| Field | Value |
| --- | --- |
| Owner | [dipampaul17](https://repo.masters-masters.com/en/owners/dipampaul17) |
| Stars | 361 |
| Forks | 13 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2025 |
| Topics | apple-silicon, generative-ai, kv-cache, llama-cpp, llm, m1, m2, m3, memory-optimization, metal |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [dipampaul17/KVSplit](https://github.com/dipampaul17/KVSplit) |

## Repository

Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with \<1% quality loss. Includes benchmarking, visualization, and one-command setup. Optimized for M1/M2/M3 Macs with M…

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by dipampaul17

- [dipampaul17/AgentGuard · ★ 173 · JavaScript · Prototype](https://repo.masters-masters.com/en/repos/dipampaul17/AgentGuard)

## Nearby in Python

- [xjli360/sealeap-amazon-skills · ★ 361 · Python · Alpha](https://repo.masters-masters.com/en/repos/xjli360/sealeap-amazon-skills)
- [ikevss/wechat-ai-memory · ★ 361 · Python · Alpha](https://repo.masters-masters.com/en/repos/ikevss/wechat-ai-memory)
- [roboterax/video-prediction-policy-2 · ★ 361 · Python · Alpha](https://repo.masters-masters.com/en/repos/roboterax/video-prediction-policy-2)
- [pyelasticsearch/pyelasticsearch · ★ 361 · Python · Alpha](https://repo.masters-masters.com/en/repos/pyelasticsearch/pyelasticsearch)
- [github/pycon2011 · ★ 361 · Python · Alpha](https://repo.masters-masters.com/en/repos/github/pycon2011)
- [inconshreveable/sqltap · ★ 361 · Python · Alpha](https://repo.masters-masters.com/en/repos/inconshreveable/sqltap)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.