# jmaczan/tiny-vllm

<https://repo.masters-masters.com/en/repos/jmaczan/tiny-vllm>

[Home](https://repo.masters-masters.com/en) › [jmaczan](https://repo.masters-masters.com/en/owners/jmaczan) › [tiny-vllm](https://repo.masters-masters.com/en/repos/jmaczan/tiny-vllm)

jmaczan/tiny-vllm has 1,180 stars on GitHub. Its RepoMasters card: Beta tier. Build your own high performance LLM inference engine in C++ and CUDA - a smaller…

| Field | Value |
| --- | --- |
| Owner | [jmaczan](https://repo.masters-masters.com/en/owners/jmaczan) |
| Stars | 1,180 |
| Forks | 102 |
| Language | [C++](https://repo.masters-masters.com/en/languages/c-plus-plus) |
| License | Apache-2.0 |
| Created | 2026 |
| Topics | ai, hpc, llm, llm-inference, vllm, tiny-vllm, cpp, cuda, pagedattention, attention |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [jmaczan/tiny-vllm](https://github.com/jmaczan/tiny-vllm) |

## Repository

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by jmaczan

- [jmaczan/bulma-helpers · ★ 281 · CSS · Alpha](https://repo.masters-masters.com/en/repos/jmaczan/bulma-helpers)
- [jmaczan/gdansk-ai · ★ 197 · TypeScript · Prototype](https://repo.masters-masters.com/en/repos/jmaczan/gdansk-ai)

## Nearby in C++

- [TheForceEngine/TheForceEngine · ★ 1,181 · C++ · Beta](https://repo.masters-masters.com/en/repos/TheForceEngine/TheForceEngine)
- [davmac314/dinit · ★ 1,180 · C++ · Beta](https://repo.masters-masters.com/en/repos/davmac314/dinit)
- [madmann91/bvh · ★ 1,180 · C++ · Beta](https://repo.masters-masters.com/en/repos/madmann91/bvh)
- [retronx-team/sys-clk · ★ 1,179 · C++ · Beta](https://repo.masters-masters.com/en/repos/retronx-team/sys-clk)
- [aappleby/metroboy · ★ 1,179 · C++ · Beta](https://repo.masters-masters.com/en/repos/aappleby/metroboy)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.