# EricLBuehler/candle-vllm

<https://repo.masters-masters.com/en/repos/EricLBuehler/candle-vllm>

[Home](https://repo.masters-masters.com/en) › [EricLBuehler](https://repo.masters-masters.com/en/owners/EricLBuehler) › [candle-vllm](https://repo.masters-masters.com/en/repos/EricLBuehler/candle-vllm)

EricLBuehler/candle-vllm has 741 stars on GitHub. Its RepoMasters card: Beta tier. Efficent platform for inference and serving local LLMs including an OpenAI…

| Field | Value |
| --- | --- |
| Owner | [EricLBuehler](https://repo.masters-masters.com/en/owners/EricLBuehler) |
| Stars | 741 |
| Forks | 91 |
| Language | [Rust](https://repo.masters-masters.com/en/languages/rust) |
| License | MIT |
| Created | 2023 |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [EricLBuehler/candle-vllm](https://github.com/EricLBuehler/candle-vllm) |

## Repository

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by EricLBuehler

- [EricLBuehler/mistral.rs · ★ 7,805 · Rust · Stable](https://repo.masters-masters.com/en/repos/EricLBuehler/mistral.rs)
- [EricLBuehler/xlora · ★ 284 · Python · Alpha](https://repo.masters-masters.com/en/repos/EricLBuehler/xlora)
- [EricLBuehler/candle-lora · ★ 177 · Rust · Prototype](https://repo.masters-masters.com/en/repos/EricLBuehler/candle-lora)
- [EricLBuehler/diffusion-rs · ★ 130 · Rust · Prototype](https://repo.masters-masters.com/en/repos/EricLBuehler/diffusion-rs)

## Nearby in Rust

- [nadavrot/layout · ★ 741 · Rust · Beta](https://repo.masters-masters.com/en/repos/nadavrot/layout)
- [nik012003/ripdrag · ★ 741 · Rust · Beta](https://repo.masters-masters.com/en/repos/nik012003/ripdrag)
- [zibo-chen/SubnetDesk · ★ 741 · Rust · Beta](https://repo.masters-masters.com/en/repos/zibo-chen/SubnetDesk)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.