# SeraphimSerapis/tool-eval-bench

<https://repo.masters-masters.com/en/repos/SeraphimSerapis/tool-eval-bench>

[Home](https://repo.masters-masters.com/en) › [SeraphimSerapis](https://repo.masters-masters.com/en/owners/SeraphimSerapis) › [tool-eval-bench](https://repo.masters-masters.com/en/repos/SeraphimSerapis/tool-eval-bench)

SeraphimSerapis/tool-eval-bench has 409 stars on GitHub. Its RepoMasters card: Alpha tier. Tool-calling quality benchmark for LLM serving stacks. 80+…

| Field | Value |
| --- | --- |
| Owner | [SeraphimSerapis](https://repo.masters-masters.com/en/owners/SeraphimSerapis) |
| Stars | 409 |
| Forks | 55 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2026 |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [SeraphimSerapis/tool-eval-bench](https://github.com/SeraphimSerapis/tool-eval-bench) |

## Repository

Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, and structured output. Supports vLLM, SGLang, and llama.cpp.

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## Nearby in Python

- [RongLiu-AML/EvoAML · ★ 409 · Python · Alpha](https://repo.masters-masters.com/en/repos/RongLiu-AML/EvoAML)
- [hypnguyen1209/offensive-claude · ★ 409 · Python · Alpha](https://repo.masters-masters.com/en/repos/hypnguyen1209/offensive-claude)
- [0xethanq/astra-quant-agent · ★ 409 · Python · Alpha](https://repo.masters-masters.com/en/repos/0xethanq/astra-quant-agent)
- [toastdriven/itty · ★ 409 · Python · Alpha](https://repo.masters-masters.com/en/repos/toastdriven/itty)
- [Kotti/Kotti · ★ 409 · Python · Alpha](https://repo.masters-masters.com/en/repos/Kotti/Kotti)
- [sahana/eden-legacy · ★ 409 · Python · Alpha](https://repo.masters-masters.com/en/repos/sahana/eden-legacy)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.