PrototypeCommon
majiayu000/litellm-rs
Self-hosted Rust LLM gateway with OpenAI-compatible APIs, load balancing, failover, and a reusable Rust kernel.
- Owner
- majiayu000 (personal account)
- Stars
- Stars: 123
- Forks
- Forks: 18
- Language
- Rust
- License
- MIT
- Created
- 2025
- Topics
- ai-gatewayanthropicapi-clientasync-rustaws-bedrockembeddingsgeminillmload-balancingmulti-provider
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by majiayu000
All 4 repos by majiayu000- majiayu000/claude-skill-registryStars: 711PythonBeta
- majiayu000/spellbookStars: 290PythonAlpha
- majiayu000/awesome-grok-botStars: 131JavaScriptPrototype
Nearby in Rust
All Rust repos- Jorji49/streamtopStars: 123RustPrototype
- ghuntley/preflightStars: 123RustPrototype
- LinkSy-mg/linksy-desktopStars: 123RustPrototype
- Geal/rust-syslogStars: 123RustPrototype
- gnzlbg/ctestStars: 123RustPrototype
- martindeegan/droneStars: 123RustPrototype