Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

Chleba/ollamaMQ

High-performance LLM backends proxy with per-user fair-share queuing, round-robin scheduling, and a real-time TUI dashboard. Built in Rust.

Owner
Chleba (personal account)
Stars
Stars: 130
Forks
Forks: 16
Language
Rust
License
MIT
Created
2026
Topics
fair-sharellm-opsmessage-queueollamaopenai-compatibleproxyrusttui
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by Chleba

All 2 repos by Chleba

Nearby in Rust

All Rust repos