Illustration: the project’s public image, pixelated by RepoMasters. Credits
StableVery rare

kvcache-ai/Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Owner
kvcache-ai (organization)
Stars
Stars: 6,949
Forks
Forks: 1,416
Language
C++
License
Apache-2.0
Created
2024
Topics
inferencekvcachellmrdmasglangvllmdisaggregationtokenspeedreinforcement-learningtrt-llm
Tier
Stable (5,000 to 19,999 ★) What this tier means
View on GitHub

More repos by kvcache-ai

All 3 repos by kvcache-ai

Nearby in C++

All C++ repos