# gpustack/llama-box

<https://repo.masters-masters.com/en/repos/gpustack/llama-box>

[Home](https://repo.masters-masters.com/en) › [gpustack](https://repo.masters-masters.com/en/owners/gpustack) › [llama-box](https://repo.masters-masters.com/en/repos/gpustack/llama-box)

gpustack/llama-box has 291 stars on GitHub. Its RepoMasters card: Alpha tier. LM inference server implementation based on \*.cpp. Language: C++.

| Field | Value |
| --- | --- |
| Owner | [gpustack](https://repo.masters-masters.com/en/owners/gpustack) |
| Stars | 291 |
| Forks | 29 |
| Language | [C++](https://repo.masters-masters.com/en/languages/c-plus-plus) |
| License | MIT |
| Created | 2024 |
| Topics | openai-compatible-api, cpp, gguf, diffusion, transformer |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [gpustack/llama-box](https://github.com/gpustack/llama-box) |

## Repository

LM inference server implementation based on \*.cpp.

Archived: this repository is read-only

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by gpustack

- [gpustack/gpustack · ★ 5,963 · Python · Stable](https://repo.masters-masters.com/en/repos/gpustack/gpustack)
- [gpustack/gguf-parser-go · ★ 310 · Go · Alpha](https://repo.masters-masters.com/en/repos/gpustack/gguf-parser-go)
- [gpustack/vox-box · ★ 216 · Python · Prototype](https://repo.masters-masters.com/en/repos/gpustack/vox-box)

## Nearby in C++

- [orinimron123/CVE-2026-40369-EXPLOIT · ★ 291 · C++ · Alpha](https://repo.masters-masters.com/en/repos/orinimron123/CVE-2026-40369-EXPLOIT)
- [redteamfortress/PhantomKiller · ★ 291 · C++ · Alpha](https://repo.masters-masters.com/en/repos/redteamfortress/PhantomKiller)
- [Free-Ink/freeink-sdk · ★ 291 · C++ · Alpha](https://repo.masters-masters.com/en/repos/Free-Ink/freeink-sdk)
- [Comer352L/FreeSSM · ★ 291 · C++ · Alpha](https://repo.masters-masters.com/en/repos/Comer352L/FreeSSM)
- [rambo/TinyWire · ★ 291 · C++ · Alpha](https://repo.masters-masters.com/en/repos/rambo/TinyWire)
- [mabrarov/asio\_samples · ★ 291 · C++ · Alpha](https://repo.masters-masters.com/en/repos/mabrarov/asio_samples)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.
