BetaRare
EricLBuehler/candle-vllm
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
- Owner
- EricLBuehler (personal account)
- Stars
- Stars: 740
- Forks
- Forks: 91
- Language
- Rust
- License
- MIT
- Created
- 2023
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by EricLBuehler
All 5 repos by EricLBuehler- EricLBuehler/mistral.rsStars: 7,796RustStable
- EricLBuehler/xloraStars: 284PythonAlpha
- EricLBuehler/candle-loraStars: 177RustPrototype
- EricLBuehler/diffusion-rsStars: 130RustPrototype
Nearby in Rust
All Rust repos- zavora-ai/adk-rustStars: 740RustBeta
- zibo-chen/SubnetDeskStars: 740RustBeta
- sahenjp/RustXNGStars: 740RustBeta
- marshallpierce/rust-base64Stars: 740RustBeta
- LaihoE/demoparserStars: 740RustBeta
- software-mansion/smelterStars: 740RustBeta