# madroidmaq/mlx-omni-server

<https://repo.masters-masters.com/en/repos/madroidmaq/mlx-omni-server>

[Home](https://repo.masters-masters.com/en) › [madroidmaq](https://repo.masters-masters.com/en/owners/madroidmaq) › [mlx-omni-server](https://repo.masters-masters.com/en/repos/madroidmaq/mlx-omni-server)

madroidmaq/mlx-omni-server has 746 stars on GitHub. Its RepoMasters card: Beta tier. MLX Omni Server is a local inference server powered by Apple's MLX…

| Field | Value |
| --- | --- |
| Owner | [madroidmaq](https://repo.masters-masters.com/en/owners/madroidmaq) |
| Stars | 746 |
| Forks | 88 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2024 |
| Topics | mlx, openai, openai-api, stt, tts, function-calling, structured-output, tools, genai |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [madroidmaq/mlx-omni-server](https://github.com/madroidmaq/mlx-omni-server) |

## Repository

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference.

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## Nearby in Python

- [KovenYu/WonderWorld · ★ 746 · Python · Beta](https://repo.masters-masters.com/en/repos/KovenYu/WonderWorld)
- [agentic-box/memora · ★ 746 · Python · Beta](https://repo.masters-masters.com/en/repos/agentic-box/memora)
- [chenjin-cmd/xhs-virtual-product · ★ 746 · Python · Beta](https://repo.masters-masters.com/en/repos/chenjin-cmd/xhs-virtual-product)
- [jfoote/exploitable · ★ 746 · Python · Beta](https://repo.masters-masters.com/en/repos/jfoote/exploitable)
- [dropbox/changes · ★ 746 · Python · Beta](https://repo.masters-masters.com/en/repos/dropbox/changes)
- [duo-labs/webauthn.io · ★ 746 · Python · Beta](https://repo.masters-masters.com/en/repos/duo-labs/webauthn.io)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.