Illustration: the project’s public image, pixelated by RepoMasters. Credits
BetaRare

alibaba/rtp-llm

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Owner
alibaba (organization)
Stars
Stars: 1,387
Forks
Forks: 297
Language
Python
License
Apache-2.0
Created
2023
Topics
gptinferencellamallmllm-servingllmopsmodel-serving
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

More repos by alibaba

All 292 repos by alibaba

Nearby in Python

All Python repos