AlphaUncommon
AstraNetLab/CacheRoute
CacheRoute is an innovative LLM scheduling scheme dedicated to enabling flexible KV cache reuse across LLM systems, improving task performance and system efficiency.
- Owner
- AstraNetLab (personal account)
- Stars
- Stars: 257
- Forks
- Forks: 2
- Language
- Python
- License
- Apache-2.0
- Created
- 2025
- Topics
- knowledge-injectionllm-inferencellm-task-schedulingkvcache-reusekvcachellmlmcachenetworkroutingvllm
- Tier
- Alpha (250 to 699 ★) What this tier means
Nearby in Python
All Python repos- unitreerobotics/unifolm-wlaStars: 257PythonAlpha
- img2threejs/plugin-interiorStars: 257PythonAlpha
- OpenSenseNova/SenseNova-6.8-Code2VideoStars: 257PythonAlpha
- orestis/pysmellStars: 257PythonAlpha
- simos/keyboardlayouteditorStars: 257PythonAlpha
- willhardy/django-seoStars: 257PythonAlpha