# intentee/paddler

<https://repo.masters-masters.com/en/repos/intentee/paddler>

[Home](https://repo.masters-masters.com/en) › [intentee](https://repo.masters-masters.com/en/owners/intentee) › [paddler](https://repo.masters-masters.com/en/repos/intentee/paddler)

intentee/paddler has 1,689 stars on GitHub. Its RepoMasters card: Beta tier. Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and…

| Field | Value |
| --- | --- |
| Owner | [intentee](https://repo.masters-masters.com/en/owners/intentee) |
| Stars | 1,689 |
| Forks | 98 |
| Language | [Rust](https://repo.masters-masters.com/en/languages/rust) |
| License | Apache-2.0 |
| Created | 2024 |
| Topics | ai, llamacpp, llm, llmops, load-balancer |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [intentee/paddler](https://github.com/intentee/paddler) |

## Repository

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## Nearby in Rust

- [secluso/core · ★ 1,693 · Rust · Beta](https://repo.masters-masters.com/en/repos/secluso/core)
- [ferrocene/ferrocene · ★ 1,691 · Rust · Beta](https://repo.masters-masters.com/en/repos/ferrocene/ferrocene)
- [yamafaktory/jql · ★ 1,690 · Rust · Beta](https://repo.masters-masters.com/en/repos/yamafaktory/jql)
- [cessen/ropey · ★ 1,688 · Rust · Beta](https://repo.masters-masters.com/en/repos/cessen/ropey)
- [rustfinity/rustfinity · ★ 1,688 · Rust · Beta](https://repo.masters-masters.com/en/repos/rustfinity/rustfinity)
- [cangzhang/ChampR · ★ 1,687 · Rust · Beta](https://repo.masters-masters.com/en/repos/cangzhang/ChampR)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.