Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

xLLM-AI/xllm-service

A flexible serving framework that delivers efficient and fault-tolerant LLM inference for clustered deployments.

Owner
xLLM-AI (organization)
Stars
Stars: 100
Forks
Forks: 41
Language
C++
License
None
Created
2025
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by xLLM-AI

All 2 repos by xLLM-AI

Nearby in C++

All C++ repos