ovg-project/kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Owner: ovg-project (organization)
Stars: Stars: 2,020
Forks: Forks: 235
Language: Python
License: Apache-2.0
Created: 2025
Topics: gpu-sharingkvcachellmsglangvllmkvcachedinference-enginegpu-mutiplexingkvcache-optimizationllm-framework
Tier: RC (2,000 to 4,999 ★) What this tier means

Nearby in Python