# local-inference-lab/llm-inference-bench

<https://repo.masters-masters.com/en/repos/local-inference-lab/llm-inference-bench>

[Home](https://repo.masters-masters.com/en) › [local-inference-lab](https://repo.masters-masters.com/en/owners/local-inference-lab) › [llm-inference-bench](https://repo.masters-masters.com/en/repos/local-inference-lab/llm-inference-bench)

local-inference-lab/llm-inference-bench has 122 stars on GitHub. Its RepoMasters card: Prototype tier. LLM inference decode throughput benchmark with Rich TUI…

| Field | Value |
| --- | --- |
| Owner | [local-inference-lab](https://repo.masters-masters.com/en/owners/local-inference-lab) |
| Stars | 122 |
| Forks | 23 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2026 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [local-inference-lab/llm-inference-bench](https://github.com/local-inference-lab/llm-inference-bench) |

## Repository

LLM inference decode throughput benchmark with Rich TUI dashboard. Measures token generation speed across concurrency levels and context lengths. Supports SGLang and vLLM engines.

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by local-inference-lab

- [local-inference-lab/rtx6kpro · ★ 1,174 · Python · Beta](https://repo.masters-masters.com/en/repos/local-inference-lab/rtx6kpro)
- [local-inference-lab/b12x · ★ 269 · Python · Alpha](https://repo.masters-masters.com/en/repos/local-inference-lab/b12x)

## Nearby in Python

- [Bryce-border/McLottery-Alchemist · ★ 122 · Python · Prototype](https://repo.masters-masters.com/en/repos/Bryce-border/McLottery-Alchemist)
- [Lico124378/macau-hidden-bites · ★ 122 · Python · Prototype](https://repo.masters-masters.com/en/repos/Lico124378/macau-hidden-bites)
- [BlueKnightNet/Blue-Knight-Proxy-BotHosting · ★ 122 · Python · Prototype](https://repo.masters-masters.com/en/repos/BlueKnightNet/Blue-Knight-Proxy-BotHosting)
- [svetlyak40wt/django-fields · ★ 122 · Python · Prototype](https://repo.masters-masters.com/en/repos/svetlyak40wt/django-fields)
- [metajack/notify-webhook · ★ 122 · Python · Prototype](https://repo.masters-masters.com/en/repos/metajack/notify-webhook)
- [bmander/graphserver · ★ 122 · Python · Prototype](https://repo.masters-masters.com/en/repos/bmander/graphserver)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.