Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

PacifAIst/Quansloth

Based on the implementation of Google's TurboQuant (ICLR 2026) — Quansloth brings elite KV cache compression to local LLM inference. Quansloth is a fully private, air-gapped AI server that runs massive context models natively on consumer hardware with ease

Owner
PacifAIst (personal account)
Stars
Stars: 153
Forks
Forks: 14
Language
Python
License
Apache-2.0
Created
2026
Topics
cudaturboquantquanslothvram-wall
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos