# azrtydxb/Fastllm-proxy

<https://repo.masters-masters.com/en/repos/azrtydxb/Fastllm-proxy>

[Home](https://repo.masters-masters.com/en) › [azrtydxb](https://repo.masters-masters.com/en/owners/azrtydxb) › [Fastllm-proxy](https://repo.masters-masters.com/en/repos/azrtydxb/Fastllm-proxy)

azrtydxb/Fastllm-proxy has 108 stars on GitHub. Its RepoMasters card: Prototype tier. The lowest-overhead LLM router. Production-ready, highly available, one…

| Field | Value |
| --- | --- |
| Owner | [azrtydxb](https://repo.masters-masters.com/en/owners/azrtydxb) |
| Stars | 108 |
| Forks | 92 |
| Language | [Rust](https://repo.masters-masters.com/en/languages/rust) |
| License | Apache-2.0 |
| Created | 2026 |
| Topics | ai-gateway, inference, litellm, llm, llm-gateway, load-balancing, observability, openai-api, rbac, reverse-proxy |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [azrtydxb/Fastllm-proxy](https://github.com/azrtydxb/Fastllm-proxy) |

## Repository

The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by azrtydxb

- [azrtydxb/procoder · ★ 210 · Go · Prototype](https://repo.masters-masters.com/en/repos/azrtydxb/procoder)

## Nearby in Rust

- [datlechin/pitboard · ★ 108 · Rust · Prototype](https://repo.masters-masters.com/en/repos/datlechin/pitboard)
- [oMaN-Rod/Pulsar · ★ 108 · Rust · Prototype](https://repo.masters-masters.com/en/repos/oMaN-Rod/Pulsar)
- [XNinety9/Printr · ★ 108 · Rust · Prototype](https://repo.masters-masters.com/en/repos/XNinety9/Printr)
- [ruuda/robigo-luculenta · ★ 108 · Rust · Prototype](https://repo.masters-masters.com/en/repos/ruuda/robigo-luculenta)
- [deprecrated/net2-rs · ★ 108 · Rust · Prototype](https://repo.masters-masters.com/en/repos/deprecrated/net2-rs)
- [matzipan/envoyer · ★ 108 · Rust · Prototype](https://repo.masters-masters.com/en/repos/matzipan/envoyer)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.