# localai-org/vllm.cpp

<https://repo.masters-masters.com/en/repos/localai-org/vllm.cpp>

[Home](https://repo.masters-masters.com/en) › [localai-org](https://repo.masters-masters.com/en/owners/localai-org) › [vllm.cpp](https://repo.masters-masters.com/en/repos/localai-org/vllm.cpp)

localai-org/vllm.cpp has 475 stars on GitHub. Its RepoMasters card: Alpha tier. a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in…

| Field | Value |
| --- | --- |
| Owner | [localai-org](https://repo.masters-masters.com/en/owners/localai-org) |
| Stars | 475 |
| Forks | 58 |
| Language | [C++](https://repo.masters-masters.com/en/languages/c-plus-plus) |
| License | Apache-2.0 |
| Created | 2026 |
| Topics | mlx, vllm, cpp20, llm, continous-batching, paged-attention, radixattention |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [localai-org/vllm.cpp](https://github.com/localai-org/vllm.cpp) |

## Repository

a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by localai-org

- [localai-org/depth-anything.cpp · ★ 1,136 · C++ · Beta](https://repo.masters-masters.com/en/repos/localai-org/depth-anything.cpp)
- [localai-org/kimodo.cpp · ★ 948 · C++ · Beta](https://repo.masters-masters.com/en/repos/localai-org/kimodo.cpp)
- [localai-org/apex-quant · ★ 482 · Shell · Alpha](https://repo.masters-masters.com/en/repos/localai-org/apex-quant)
- [localai-org/motion-bricks.cpp · ★ 348 · C++ · Alpha](https://repo.masters-masters.com/en/repos/localai-org/motion-bricks.cpp)
- [localai-org/privacy-filter.cpp · ★ 308 · C++ · Alpha](https://repo.masters-masters.com/en/repos/localai-org/privacy-filter.cpp)
- [localai-org/LocalVQE · ★ 247 · C++ · Prototype](https://repo.masters-masters.com/en/repos/localai-org/LocalVQE)

## Nearby in C++

- [apache/tvm-ffi · ★ 475 · C++ · Alpha](https://repo.masters-masters.com/en/repos/apache/tvm-ffi)
- [carbonengine/trinity · ★ 475 · C++ · Alpha](https://repo.masters-masters.com/en/repos/carbonengine/trinity)
- [NotRexed/SkyboundTotk · ★ 475 · C++ · Alpha](https://repo.masters-masters.com/en/repos/NotRexed/SkyboundTotk)
- [jorgen/json\_struct · ★ 475 · C++ · Alpha](https://repo.masters-masters.com/en/repos/jorgen/json_struct)
- [xuzhezhaozhao/DS\_Code · ★ 475 · C++ · Alpha](https://repo.masters-masters.com/en/repos/xuzhezhaozhao/DS_Code)
- [TadasBaltrusaitis/CLM-framework · ★ 475 · C++ · Alpha](https://repo.masters-masters.com/en/repos/TadasBaltrusaitis/CLM-framework)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.