Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

arozanov/turboquant-mlx

TurboQuant KV cache compression for MLX with fused Metal kernels. 4.6x compression at 98% FP16 speed.

Owner
arozanov (personal account)
Stars
Stars: 114
Forks
Forks: 19
Language
Python
License
None
Created
2026
Topics
apple-siliconkv-cachellmmetalmlxquantizationturboquant
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos