Illustration: the project’s public image, pixelated by RepoMasters. Credits
StableVery rare

vllm-project/semantic-router

An open, programmable decision layer for models and compute.

Owner
vllm-project (organization)
Stars
Stars: 6,385
Forks
Forks: 1,101
Language
Go
License
Apache-2.0
Created
2025
Topics
mixture-of-modelssemantic-routervllmai-gatewaykubernetesllmrouterllmguardrailsinferencepytorch
Tier
Stable (5,000 to 19,999 ★) What this tier means
View on GitHub

More repos by vllm-project

All 20 repos by vllm-project

Nearby in Go

All Go repos