Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

novitalabs/pegaflow

High-performance KV cache storage for LLM inference — GPU offloading, SSD caching, and cross-node sharing via RDMA. Works with vLLM and SGLang.

Owner
novitalabs (organization)
Stars
Stars: 221
Forks
Forks: 31
Language
Rust
License
Apache-2.0
Created
2026
Topics
inferencekv-cachellmvllm
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by novitalabs

All 3 repos by novitalabs

Nearby in Rust

All Rust repos