Illustration: the project’s public image, pixelated by RepoMasters. Credits
LTSLegendary

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

Owner
sgl-project (organization)
Stars
Stars: 38,386
Forks
Forks: 10,105
Language
Python
License
Apache-2.0
Created
2024
Topics
cudainferencellamallmmoetransformervlmdeepseekblackwellgpt-oss
Tier
LTS (20,000 ★ and up) What this tier means
View on GitHub

More repos by sgl-project

All 10 repos by sgl-project

Nearby in Python

All Python repos