# alibaba/rtp-llm

<https://repo.masters-masters.com/en/repos/alibaba/rtp-llm>

[Home](https://repo.masters-masters.com/en) › [alibaba](https://repo.masters-masters.com/en/owners/alibaba) › [rtp-llm](https://repo.masters-masters.com/en/repos/alibaba/rtp-llm)

alibaba/rtp-llm has 1,387 stars on GitHub. Its RepoMasters card: Beta tier. RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

| Field | Value |
| --- | --- |
| Owner | [alibaba](https://repo.masters-masters.com/en/owners/alibaba) |
| Stars | 1,387 |
| Forks | 297 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | gpt, inference, llama, llm, llm-serving, llmops, model-serving |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [alibaba/rtp-llm](https://github.com/alibaba/rtp-llm) |

## Repository

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by alibaba

- [alibaba/open-code-review · ★ 49,385 · Go · LTS](https://repo.masters-masters.com/en/repos/alibaba/open-code-review)
- [alibaba/arthas · ★ 37,609 · Java · LTS](https://repo.masters-masters.com/en/repos/alibaba/arthas)
- [alibaba/easyexcel · ★ 33,564 · Java · LTS](https://repo.masters-masters.com/en/repos/alibaba/easyexcel)
- [alibaba/nacos · ★ 33,496 · Java · LTS](https://repo.masters-masters.com/en/repos/alibaba/nacos)
- [alibaba/p3c · ★ 30,856 · Kotlin · LTS](https://repo.masters-masters.com/en/repos/alibaba/p3c)
- [alibaba/canal · ★ 29,744 · Java · LTS](https://repo.masters-masters.com/en/repos/alibaba/canal)

## Nearby in Python

- [ali-vilab/TeaCache · ★ 1,387 · Python · Beta](https://repo.masters-masters.com/en/repos/ali-vilab/TeaCache)
- [tsinghua-fib-lab/AgentSociety · ★ 1,387 · Python · Beta](https://repo.masters-masters.com/en/repos/tsinghua-fib-lab/AgentSociety)
- [modelscope/sirchmunk · ★ 1,387 · Python · Beta](https://repo.masters-masters.com/en/repos/modelscope/sirchmunk)
- [SigmaQuan/Better-Python-59-Ways · ★ 1,387 · Python · Beta](https://repo.masters-masters.com/en/repos/SigmaQuan/Better-Python-59-Ways)
- [autonomousvision/unimatch · ★ 1,387 · Python · Beta](https://repo.masters-masters.com/en/repos/autonomousvision/unimatch)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.