Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

quantumaikr/quant.cpp

LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.

Owner
quantumaikr (organization)
Stars
Stars: 405
Forks
Forks: 44
Language
C
License
Apache-2.0
Created
2026
Topics
delta-compressionembeddableggufkv-cachellmllm-inferencepure-cquantizationtransformerturboquant
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

Nearby in C

All C repos