AlphaUncommon
smg-project/smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant au…
- Owner
- smg-project (organization)
- Stars
- Stars: 699
- Forks
- Forks: 205
- Language
- Rust
- License
- Apache-2.0
- Created
- 2025
- Topics
- anthropicclaudegeminiinference-gatewayllmopenairoutingsglangvllmtensorrtllm
- Tier
- Alpha (250 to 699 ★) What this tier means
Nearby in Rust
All Rust repos- takahirox/riscv-rustStars: 699RustAlpha
- wfxr/csviewStars: 699RustAlpha
- tmandry/glideStars: 699RustAlpha
- ChainSafe/forestStars: 698RustAlpha