Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

tensorchord/openmodelz

Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)

Owner
tensorchord (organization)
Stars
Stars: 283
Forks
Forks: 26
Language
Go
License
Apache-2.0
Created
2023
Topics
cluster-managerinferencellmopsmlopshacktoberfestllm
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by tensorchord

All 7 repos by tensorchord

Nearby in Go

All Go repos