RCEpic
ModelTC/LightLLM
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
- Owner
- ModelTC (organization)
- Stars
- Stars: 4,349
- Forks
- Forks: 383
- Language
- Python
- License
- Apache-2.0
- Created
- 2023
- Topics
- deep-learninggptllamallmmodel-servingnlpopenai-triton
- Tier
- RC (2,000 to 4,999 ★) What this tier means
More repos by ModelTC
All 10 repos by ModelTC- ModelTC/LightX2VStars: 2,980PythonRC
- ModelTC/LightX2V-Qwen-Image-LightningStars: 1,364PythonBeta
- ModelTC/MQBenchStars: 887PythonBeta
- ModelTC/LightCompressStars: 753PythonBeta
- ModelTC/United-PerceptionStars: 438PythonAlpha
- ModelTC/Minimax-H3-TurboStars: 409PythonAlpha
Nearby in Python
All Python repos- Lucksi/Mr.HolmesStars: 4,354PythonRC
- MichaelGrupp/evoStars: 4,353PythonRC
- wasi-master/13ftStars: 4,351PythonRC
- MongoEngine/mongoengineStars: 4,348PythonRC
- anasty17/mirror-leech-telegram-botStars: 4,348PythonRC
- ZhengPeng7/BiRefNetStars: 4,347PythonRC