BetaRare
xLLM-AI/xllm
A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
- Owner
- xLLM-AI (organization)
- Stars
- Stars: 1,615
- Forks
- Forks: 327
- Language
- C++
- License
- Apache-2.0
- Created
- 2025
- Topics
- deepseekinferenceinference-enginellm-inferenceqwenlarge-language-modelsglm
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by xLLM-AI
All 2 repos by xLLM-AI- xLLM-AI/xllm-serviceStars: 100C++Prototype
Nearby in C++
All C++ repos- Swordpdf/PS5SX2Stars: 1,616C++Beta
- sideeffects/HoudiniEngineForUnrealStars: 1,615C++Beta
- HamletDuFromage/aio-switch-updaterStars: 1,615C++Beta
- arturadib/node-qtStars: 1,614C++Beta
- simulationcraft/simcStars: 1,613C++Beta