RCEpic
thu-pacman/chitu
High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
- Owner
- thu-pacman (organization)
- Stars
- Stars: 2,998
- Forks
- Forks: 250
- Language
- Python
- License
- Apache-2.0
- Created
- 2025
- Topics
- deepseekgpullmpytorchllm-servingmodel-serving
- Tier
- RC (2,000 to 4,999 ★) What this tier means
More repos by thu-pacman
All 6 repos by thu-pacman- thu-pacman/GeminiGraphStars: 329C++Alpha
- thu-pacman/GridGraphStars: 132C++Prototype
- thu-pacman/PETStars: 127C++Prototype
- thu-pacman/Tree-KGStars: 118Prototype
- thu-pacman/Puro-MegatronStars: 105PythonPrototype
Nearby in Python
All Python repos- BayesWitnesses/m2cgenStars: 2,999PythonRC
- jfzhang95/pytorch-deeplab-xceptionStars: 2,998PythonRC
- patrick-kidger/equinoxStars: 2,998PythonRC
- keithito/tacotronStars: 2,997PythonRC
- yangjianxin1/GPT2-chitchatStars: 2,997PythonRC