Illustration: the project’s public image, pixelated by RepoMasters. Credits
StableVery rare

kvcache-ai/ktransformers

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

Owner
kvcache-ai (organization)
Stars
Stars: 19,649
Forks
Forks: 1,600
Language
Python
License
Apache-2.0
Created
2024
Tier
Stable (5,000 to 19,999 ★) What this tier means
View on GitHub

More repos by kvcache-ai

All 3 repos by kvcache-ai

Nearby in Python

All Python repos