AlphaUncommon
thushan/olla
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
- Owner
- thushan (personal account)
- Stars
- Stars: 321
- Forks
- Forks: 59
- Language
- Go
- License
- Apache-2.0
- Created
- 2025
- Topics
- aillm-inferencelmstudioollamaproxyvllmgolangllamacppllm-proxyllm-router
- Tier
- Alpha (250 to 699 ★) What this tier means
Nearby in Go
All Go repos- edgelesssys/contrastStars: 321GoAlpha
- marco-liberale/PasteBombStars: 321GoAlpha
- hashgraph-online/standards-sdk-goStars: 321GoAlpha
- couchbase/go-couchbaseStars: 321GoAlpha
- andreaskoch/allmarkStars: 321GoAlpha
- strangeloop/StrangeLoop2013Stars: 321GoAlpha