Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

ome-projects/ome

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

Owner
ome-projects (organization)
Stars
Stars: 522
Forks
Forks: 106
Language
Go
License
Apache-2.0
Created
2025
Topics
k8sllm-inferencemodel-as-a-servicemodel-servingmulti-node-kubernetesoracle-cloudsglangllmdeepseekkimi-k2
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

Nearby in Go

All Go repos