# ferrumox/fox

<https://repo.masters-masters.com/en/repos/ferrumox/fox>

[Home](https://repo.masters-masters.com/en) › [ferrumox](https://repo.masters-masters.com/en/owners/ferrumox) › [fox](https://repo.masters-masters.com/en/repos/ferrumox/fox)

ferrumox/fox has 190 stars on GitHub. Its RepoMasters card: Prototype tier. A local LLM server built for concurrent work. Drop-in replacement for Ollama…

| Field | Value |
| --- | --- |
| Owner | [ferrumox](https://repo.masters-masters.com/en/owners/ferrumox) |
| Stars | 190 |
| Forks | 28 |
| Language | [Rust](https://repo.masters-masters.com/en/languages/rust) |
| License | None |
| Created | 2026 |
| Topics | cuda, gguf, inference-engine, llama-cpp, llm, local-llm, mlx, ollama, ollama-api, openai-api |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [ferrumox/fox](https://github.com/ferrumox/fox) |

## Repository

A local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port. Requests that share a prompt reuse each other's KV cache instead of each prefilling it. Rust, wrapping llama.cpp.

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by ferrumox

- [ferrumox/rabbit · ★ 191 · Rust · Prototype](https://repo.masters-masters.com/en/repos/ferrumox/rabbit)

## Nearby in Rust

- [Sergeydigl3/zapret-discord-youtube-rust · ★ 190 · Rust · Prototype](https://repo.masters-masters.com/en/repos/Sergeydigl3/zapret-discord-youtube-rust)
- [MontyTheSoftwareEngineer/fievel · ★ 190 · Rust · Prototype](https://repo.masters-masters.com/en/repos/MontyTheSoftwareEngineer/fievel)
- [leoliu0/texres · ★ 190 · Rust · Prototype](https://repo.masters-masters.com/en/repos/leoliu0/texres)
- [georust/proj · ★ 190 · Rust · Prototype](https://repo.masters-masters.com/en/repos/georust/proj)
- [brendanzab/approx · ★ 190 · Rust · Prototype](https://repo.masters-masters.com/en/repos/brendanzab/approx)
- [raymanfx/libv4l-rs · ★ 190 · Rust · Prototype](https://repo.masters-masters.com/en/repos/raymanfx/libv4l-rs)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.