# thushan/olla

<https://repo.masters-masters.com/en/repos/thushan/olla>

[Home](https://repo.masters-masters.com/en) › [thushan](https://repo.masters-masters.com/en/owners/thushan) › [olla](https://repo.masters-masters.com/en/repos/thushan/olla)

thushan/olla has 331 stars on GitHub. Its RepoMasters card: Alpha tier. High-performance lightweight proxy and load balancer for LLM infrastructure…

| Field | Value |
| --- | --- |
| Owner | [thushan](https://repo.masters-masters.com/en/owners/thushan) |
| Stars | 331 |
| Forks | 60 |
| Language | [Go](https://repo.masters-masters.com/en/languages/go) |
| License | Apache-2.0 |
| Created | 2025 |
| Topics | ai, llm-inference, lmstudio, ollama, proxy, vllm, golang, llamacpp, llm-proxy, llm-router |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [thushan/olla](https://github.com/thushan/olla) |

## Repository

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## Nearby in Go

- [rad-security/kbom · ★ 331 · Go · Alpha](https://repo.masters-masters.com/en/repos/rad-security/kbom)
- [kutovoys/xray-torrent-blocker · ★ 331 · Go · Alpha](https://repo.masters-masters.com/en/repos/kutovoys/xray-torrent-blocker)
- [CRED-CLUB/propeller · ★ 331 · Go · Alpha](https://repo.masters-masters.com/en/repos/CRED-CLUB/propeller)
- [tillberg/gut · ★ 331 · Go · Alpha](https://repo.masters-masters.com/en/repos/tillberg/gut)
- [tent/sigil · ★ 331 · Go · Alpha](https://repo.masters-masters.com/en/repos/tent/sigil)
- [koding/tunnel · ★ 331 · Go · Alpha](https://repo.masters-masters.com/en/repos/koding/tunnel)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.