# jundot/omlx

<https://repo.masters-masters.com/en/repos/jundot/omlx>

[Home](https://repo.masters-masters.com/en) › [jundot](https://repo.masters-masters.com/en/owners/jundot) › [omlx](https://repo.masters-masters.com/en/repos/jundot/omlx)

jundot/omlx has 23,339 stars on GitHub. Its RepoMasters card: LTS tier. LLM inference server with continuous batching & SSD caching for Apple Silicon —…

| Field | Value |
| --- | --- |
| Owner | [jundot](https://repo.masters-masters.com/en/owners/jundot) |
| Stars | 23,339 |
| Forks | 2,089 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2026 |
| Topics | apple-silicon, inference-server, llm, macos, mlx, openai-api |
| Tier | [LTS (20,000 ★ and up)](https://repo.masters-masters.com/en/ranks/masterpiece) |
| View on GitHub | [jundot/omlx](https://github.com/jundot/omlx) |

## Repository

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

The tier for repos with 20,000 ★ and up. Published odds per card pulled: 0.1%. Rarity: Legendary.

## Nearby in Python

- [saleor/saleor · ★ 23,503 · Python · LTS](https://repo.masters-masters.com/en/repos/saleor/saleor)
- [matplotlib/matplotlib · ★ 23,420 · Python · LTS](https://repo.masters-masters.com/en/repos/matplotlib/matplotlib)
- [marimo-team/marimo · ★ 23,420 · Python · LTS](https://repo.masters-masters.com/en/repos/marimo-team/marimo)
- [Skyvern-AI/skyvern · ★ 23,337 · Python · LTS](https://repo.masters-masters.com/en/repos/Skyvern-AI/skyvern)
- [mlc-ai/mlc-llm · ★ 23,301 · Python · LTS](https://repo.masters-masters.com/en/repos/mlc-ai/mlc-llm)
- [Sanster/IOPaint · ★ 23,297 · Python · LTS](https://repo.masters-masters.com/en/repos/Sanster/IOPaint)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.