# ModelTC/LightLLM

<https://repo.masters-masters.com/en/repos/ModelTC/LightLLM>

[Home](https://repo.masters-masters.com/en) › [ModelTC](https://repo.masters-masters.com/en/owners/ModelTC) › [LightLLM](https://repo.masters-masters.com/en/repos/ModelTC/LightLLM)

ModelTC/LightLLM has 4,350 stars on GitHub. Its RepoMasters card: RC tier. LightLLM is a Python-based LLM (Large Language Model) inference and serving…

| Field | Value |
| --- | --- |
| Owner | [ModelTC](https://repo.masters-masters.com/en/owners/ModelTC) |
| Stars | 4,350 |
| Forks | 383 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | deep-learning, gpt, llama, llm, model-serving, nlp, openai-triton |
| Tier | [RC (2,000 to 4,999 ★)](https://repo.masters-masters.com/en/ranks/blockbuster) |
| View on GitHub | [ModelTC/LightLLM](https://github.com/ModelTC/LightLLM) |

## Repository

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

The tier for repos with 2,000 to 4,999 ★. Published odds per card pulled: 3%. Rarity: Epic.

## More repos by ModelTC

- [ModelTC/LightX2V · ★ 2,984 · Python · RC](https://repo.masters-masters.com/en/repos/ModelTC/LightX2V)
- [ModelTC/LightX2V-Qwen-Image-Lightning · ★ 1,364 · Python · Beta](https://repo.masters-masters.com/en/repos/ModelTC/LightX2V-Qwen-Image-Lightning)
- [ModelTC/MQBench · ★ 887 · Python · Beta](https://repo.masters-masters.com/en/repos/ModelTC/MQBench)
- [ModelTC/LightCompress · ★ 753 · Python · Beta](https://repo.masters-masters.com/en/repos/ModelTC/LightCompress)
- [ModelTC/United-Perception · ★ 438 · Python · Alpha](https://repo.masters-masters.com/en/repos/ModelTC/United-Perception)
- [ModelTC/Minimax-H3-Turbo · ★ 410 · Python · Alpha](https://repo.masters-masters.com/en/repos/ModelTC/Minimax-H3-Turbo)

## Nearby in Python

- [MichaelGrupp/evo · ★ 4,353 · Python · RC](https://repo.masters-masters.com/en/repos/MichaelGrupp/evo)
- [wasi-master/13ft · ★ 4,353 · Python · RC](https://repo.masters-masters.com/en/repos/wasi-master/13ft)
- [ZhengPeng7/BiRefNet · ★ 4,353 · Python · RC](https://repo.masters-masters.com/en/repos/ZhengPeng7/BiRefNet)
- [lintsinghua/claude-code-book · ★ 4,349 · Python · RC](https://repo.masters-masters.com/en/repos/lintsinghua/claude-code-book)
- [MongoEngine/mongoengine · ★ 4,348 · Python · RC](https://repo.masters-masters.com/en/repos/MongoEngine/mongoengine)
- [anasty17/mirror-leech-telegram-bot · ★ 4,348 · Python · RC](https://repo.masters-masters.com/en/repos/anasty17/mirror-leech-telegram-bot)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.